2024-09-10T11:21:22.808 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T11:21:22.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:21:22.933 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7899087' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCG/VLzeGHU8JxphcyeRsdFvPAEL2JJuizQglU2SbhvsZu3LTsdvhn+DuM+lAs4PZcoJTwOn82MoABjYyyvI6lQ= smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL9r/FoXeOpqG2+Gqt8PdLtOo9F362WfyTAabeUiIOvuc7DC+cLc8V1u+TPBgVAIxMdIbtqCASUtI4Txin0zD+M= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaXbukEAKvxgS59+F6OLTHTcAALImLeRVkbx6+6ei/cV2ednwRtEuKuZ9rfY1dkPFXIwm/F+fCCcLdzjw64enM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T11:21:22.933 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T11:21:22.934 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T11:21:22.934 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T11:21:22.935 INFO:teuthology.task.internal:Checking packages... 2024-09-10T11:21:22.955 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T11:21:22.955 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T11:21:22.955 INFO:teuthology.packaging:ref: None 2024-09-10T11:21:22.955 INFO:teuthology.packaging:tag: None 2024-09-10T11:21:22.955 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T11:21:22.955 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:21:22.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T11:21:23.109 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T11:21:23.111 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T11:21:23.117 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T11:21:23.117 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T11:21:23.134 INFO:teuthology.task.internal:Saving configuration 2024-09-10T11:21:23.154 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T11:21:23.161 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T11:21:23.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:16:24.490934', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCG/VLzeGHU8JxphcyeRsdFvPAEL2JJuizQglU2SbhvsZu3LTsdvhn+DuM+lAs4PZcoJTwOn82MoABjYyyvI6lQ='} 2024-09-10T11:21:23.204 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:16:24.492424', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL9r/FoXeOpqG2+Gqt8PdLtOo9F362WfyTAabeUiIOvuc7DC+cLc8V1u+TPBgVAIxMdIbtqCASUtI4Txin0zD+M='} 2024-09-10T11:21:23.228 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:16:24.488973', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaXbukEAKvxgS59+F6OLTHTcAALImLeRVkbx6+6ei/cV2ednwRtEuKuZ9rfY1dkPFXIwm/F+fCCcLdzjw64enM='} 2024-09-10T11:21:23.228 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T11:21:23.235 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T11:21:23.235 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T11:21:23.235 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T11:21:23.235 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T11:21:23.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c3be67be0>, signals=[15]) 2024-09-10T11:21:23.323 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T11:21:23.330 INFO:teuthology.task.internal:Opening connections... 2024-09-10T11:21:23.330 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:21:23.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:21:23.417 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-09-10T11:21:23.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:21:23.499 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T11:21:23.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:21:23.582 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T11:21:23.590 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-10T11:21:23.609 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-10T11:21:23.609 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T11:21:23.667 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-10T11:21:23.668 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T11:21:23.668 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T11:21:23.668 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T11:21:23.668 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-10T11:21:23.694 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-09-10T11:21:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-09-10T11:21:23.712 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-09-10T11:21:23.769 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T11:21:23.770 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T11:21:23.770 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-09-10T11:21:23.793 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-10T11:21:23.813 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-10T11:21:23.813 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-10T11:21:23.870 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T11:21:23.871 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-10T11:21:23.872 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T11:21:23.872 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T11:21:23.872 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T11:21:23.872 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-10T11:21:23.893 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T11:21:23.904 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T11:21:23.910 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T11:21:23.910 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:21:23.913 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:21:23.915 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:21:23.931 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T11:21:23.937 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T11:21:23.937 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:21:23.969 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:21:23.972 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:21:24.026 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T11:21:24.086 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T11:21:24.100 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T11:21:24.100 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T11:21:24.100 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T11:21:24.101 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:21:24.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:21:24.118 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-10T11:21:24.176 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-10T11:21:24.176 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-10T11:21:24.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-10T11:21:27.853 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:01 2024-09-10T11:21:29.671 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-10T11:21:35.414 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-10T11:21:37.747 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-10T11:21:38.501 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-10T11:21:44.158 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T11:21:46.280 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T11:21:46.281 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T11:21:46.389 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-10T11:21:46.399 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-10T11:21:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-10T11:21:46.399 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-10T11:21:46.399 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-10T11:21:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:21:46.401 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-10T11:21:46.401 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-10T11:21:46.401 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-10T11:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 80 kB/s | 23 kB 00:00 2024-09-10T11:21:51.842 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.4 MB/s | 35 MB 00:05 2024-09-10T11:22:00.350 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:13 2024-09-10T11:22:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 898 kB/s | 29 MB 00:32 2024-09-10T11:22:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:22:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.4 MB/s | 79 MB 00:32 2024-09-10T11:22:19.998 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-10T11:22:20.370 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-10T11:22:20.370 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-10T11:22:21.366 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-10T11:22:21.367 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-10T11:22:23.965 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-10T11:22:24.619 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:22:24.717 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:22:27.501 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:22:27.626 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:22:32.742 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:22:32.784 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:22:37.923 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:23:17.177 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:23:17.217 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:23:17.551 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:23:17.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:23:17.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:23:17.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:23:18.363 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:23:18.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:23:18.363 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:23:18.364 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-10T11:23:18.716 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:23:18.802 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:23:18.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T11:23:18.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T11:23:18.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T11:23:18.803 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T11:23:18.804 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T11:23:18.804 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:23:18.863 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:23:18.863 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:23:18.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-10T11:23:18.901 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-10T11:23:18.901 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-10T11:23:18.901 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-10T11:23:18.901 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T11:23:18.902 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:23:18.903 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T11:23:18.904 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T11:23:18.904 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-505.el9.x86_64 2024-09-10T11:23:18.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T11:23:19.562 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-10T11:23:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T11:23:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-10T11:23:20.921 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-10T11:23:20.936 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.ZrEfeBzEjF 2024-09-10T11:23:20.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZrEfeBzEjF 2024-09-10T11:23:21.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.ZrEfeBzEjF 2024-09-10T11:23:21.157 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.ZrEfeBzEjF is 6KB 2024-09-10T11:23:21.208 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.ZrEfeBzEjF 2024-09-10T11:23:21.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T11:23:21.285 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T11:23:21.286 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T11:23:21.286 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T11:23:21.286 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T11:23:21.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T11:23:21.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-10T11:23:51.437 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T11:23:51.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:23:51.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:24:09.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-10T11:24:18.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:24:18.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:25:18.921 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T11:25:30.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:25:30.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:25:31.210 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-10T11:25:31.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:25:31.569 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T11:25:31.569 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-10T11:25:31.586 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-505.el9.x86_64 2024-09-10T11:25:31.586 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T11:25:31.586 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T11:25:31.586 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T11:25:32.587 DEBUG:teuthology.parallel:result is None 2024-09-10T11:25:32.587 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T11:25:32.594 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T11:25:32.594 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:25:32.596 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:25:32.599 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:25:32.618 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T11:25:32.624 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T11:25:32.706 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T11:25:32.706 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:25:32.709 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:25:32.711 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:25:33.000 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T11:25:33.008 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T11:25:33.008 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:25:33.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:25:33.026 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:25:33.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:25:33.044 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:25:33.047 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:25:33.068 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:25:33.100 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.120 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.133 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.148 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.156 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:25:33.172 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T11:25:33.179 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T11:25:33.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:25:33.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:25:33.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:25:33.212 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T11:25:33.222 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T11:25:33.222 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:25:33.252 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:25:33.255 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:25:33.272 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.400 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:33.483 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:33.527 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:25:33.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:25:33.593 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.688 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:33.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:33.817 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:25:33.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:25:33.885 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:25:33.980 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:34.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:25:34.107 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:25:34.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:25:34.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-10T11:25:34.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-09-10T11:25:34.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-10T11:25:34.218 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:25:34.223 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:25:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:25:34.741 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T11:25:34.748 INFO:teuthology.task.internal:Starting timer... 2024-09-10T11:25:34.748 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T11:25:34.758 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T11:25:34.767 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T11:25:34.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-10T11:25:34.814 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-10T11:25:34.816 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-09-10T11:25:34.861 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-09-10T11:25:34.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-10T11:25:34.930 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-10T11:25:34.932 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T11:25:34.932 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-10T11:25:34.957 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-10T11:25:34.958 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-09-10T11:25:34.988 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-09-10T11:25:34.988 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-10T11:25:35.015 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-10T11:25:35.015 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive'} 2024-09-10T11:25:35.015 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:25:35.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:25:35.044 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:25:35.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:25:35.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:25:35.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:25:35.100 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T11:25:35.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-10T11:25:35.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-09-10T11:25:35.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-10T11:25:35.197 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T11:25:35.206 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T11:25:35.217 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T11:25:35.218 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi026.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T11:29:39.615 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2024-09-10T11:29:39.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:29:39.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:29:39.698 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-10T11:29:39.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T11:29:39.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-10T11:29:39.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:29:39.860 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-09-10T11:29:39.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-10T11:29:39.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T11:29:39.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:29:40.020 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-10T11:29:40.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T11:29:40.103 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T11:29:40.113 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T11:29:40.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:29:40.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:29:40.116 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:29:40.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:29:40.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:29:40.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:29:40.145 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T11:29:40.147 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T11:29:40.161 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T11:29:40.162 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T11:29:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T11:29:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-10T11:29:40.187 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-09-10T11:29:40.190 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T11:29:40.198 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-10T11:29:40.199 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-09-10T11:29:40.213 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T11:29:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T11:29:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-10T11:29:40.227 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-10T11:29:40.227 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T11:29:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T11:29:40.241 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T11:29:40.255 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T11:29:40.286 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:29:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.290 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.291 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:29:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-10T11:29:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.310 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-10T11:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:29:40.315 INFO:teuthology.run_tasks:Running task install... 2024-09-10T11:29:40.323 DEBUG:teuthology.task.install:project ceph 2024-09-10T11:29:40.323 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T11:29:40.323 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T11:29:40.323 INFO:teuthology.task.install:Using flavor: default 2024-09-10T11:29:40.329 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T11:29:40.329 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T11:29:40.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T11:29:40.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:29:40.333 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T11:29:40.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:29:40.334 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T11:29:40.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:29:40.492 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T11:29:40.493 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T11:29:40.497 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T11:29:40.497 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T11:29:40.498 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T11:29:40.498 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T11:29:40.605 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T11:29:40.606 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:29:40.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T11:29:40.611 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T11:29:40.611 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:29:40.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T11:29:40.620 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T11:29:40.620 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:29:40.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T11:29:40.633 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T11:29:40.633 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T11:29:40.637 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T11:29:40.637 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T11:29:40.646 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T11:29:40.646 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T11:29:40.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T11:29:40.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T11:29:40.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T11:29:40.781 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T11:29:40.781 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T11:29:40.787 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T11:29:40.845 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-09-10T11:29:40.847 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-09-10T11:29:40.847 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-10T11:29:40.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-10T11:29:40.851 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-10T11:29:40.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-10T11:29:41.077 INFO:teuthology.orchestra.run.smithi026.stdout:45 files removed 2024-09-10T11:29:41.078 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-10T11:29:41.090 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-10T11:29:41.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T11:29:41.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T11:29:41.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T11:29:41.654 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-10T11:29:41.668 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-10T11:29:41.676 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 325 kB/s | 84 kB 00:00 2024-09-10T11:29:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-09-10T11:29:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-09-10T11:29:42.135 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-09-10T11:29:42.530 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-09-10T11:29:42.536 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-09-10T11:29:42.552 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-09-10T11:29:44.347 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-10T11:29:45.460 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-10T11:29:45.844 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-09-10T11:29:48.332 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-10T11:29:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 20 MB 00:02 2024-09-10T11:29:51.203 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 20 MB 00:04 2024-09-10T11:29:53.416 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.5 MB 00:01 2024-09-10T11:29:54.782 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T11:29:54.933 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-10T11:29:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-10T11:29:56.313 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-10T11:29:56.862 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-10T11:29:57.126 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-10T11:29:58.596 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-10T11:29:59.500 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T11:30:01.152 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T11:30:02.815 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T11:30:03.429 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:03.429 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:03.441 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T11:30:03.442 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T11:30:03.443 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T11:30:03.443 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T11:30:03.445 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T11:30:03.448 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T11:30:03.449 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T11:30:03.510 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T11:30:03.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T11:30:03.533 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T11:30:03.534 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T11:30:03.535 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T11:30:03.536 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T11:30:03.537 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T11:30:03.538 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T11:30:03.539 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T11:30:03.540 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T11:30:03.541 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T11:30:03.542 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T11:30:03.543 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T11:30:03.544 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-10T11:30:03.545 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:03.546 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 226 M 2024-09-10T11:30:03.546 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-10T11:30:04.095 INFO:teuthology.orchestra.run.smithi081.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-10T11:30:04.279 INFO:teuthology.orchestra.run.smithi081.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-10T11:30:04.379 INFO:teuthology.orchestra.run.smithi081.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.4 MB/s | 145 kB 00:00 2024-09-10T11:30:04.454 INFO:teuthology.orchestra.run.smithi081.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T11:30:04.555 INFO:teuthology.orchestra.run.smithi081.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-10T11:30:04.605 INFO:teuthology.orchestra.run.smithi081.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-10T11:30:04.830 INFO:teuthology.orchestra.run.smithi081.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-10T11:30:05.180 INFO:teuthology.orchestra.run.smithi081.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 18 MB/s | 21 MB 00:01 2024-09-10T11:30:05.206 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T11:30:05.227 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:05.228 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:05.231 INFO:teuthology.orchestra.run.smithi081.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 505 kB/s | 25 kB 00:00 2024-09-10T11:30:05.242 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T11:30:05.243 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T11:30:05.244 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T11:30:05.245 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T11:30:05.247 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T11:30:05.250 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T11:30:05.251 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T11:30:05.320 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T11:30:05.330 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T11:30:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T11:30:05.332 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T11:30:05.333 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T11:30:05.334 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T11:30:05.335 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T11:30:05.336 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T11:30:05.337 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T11:30:05.338 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T11:30:05.339 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T11:30:05.340 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T11:30:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout:Install 148 Packages 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 8 Packages 2024-09-10T11:30:05.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:30:05.343 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 226 M 2024-09-10T11:30:05.343 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-10T11:30:05.423 INFO:teuthology.orchestra.run.smithi081.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 18 MB/s | 11 MB 00:00 2024-09-10T11:30:05.481 INFO:teuthology.orchestra.run.smithi081.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.8 MB/s | 228 kB 00:00 2024-09-10T11:30:05.540 INFO:teuthology.orchestra.run.smithi081.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 464 kB/s | 27 kB 00:00 2024-09-10T11:30:05.598 INFO:teuthology.orchestra.run.smithi081.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 546 kB/s | 32 kB 00:00 2024-09-10T11:30:05.690 INFO:teuthology.orchestra.run.smithi081.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-10T11:30:05.882 INFO:teuthology.orchestra.run.smithi081.stdout:(15/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 13 MB/s | 17 MB 00:01 2024-09-10T11:30:05.907 INFO:teuthology.orchestra.run.smithi081.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 754 kB/s | 164 kB 00:00 2024-09-10T11:30:05.933 INFO:teuthology.orchestra.run.smithi081.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T11:30:05.933 INFO:teuthology.orchestra.run.smithi017.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-10T11:30:05.958 INFO:teuthology.orchestra.run.smithi081.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 9.9 MB/s | 506 kB 00:00 2024-09-10T11:30:06.066 INFO:teuthology.orchestra.run.smithi081.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 417 kB/s | 45 kB 00:00 2024-09-10T11:30:06.142 INFO:teuthology.orchestra.run.smithi081.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.8 MB/s | 136 kB 00:00 2024-09-10T11:30:06.226 INFO:teuthology.orchestra.run.smithi081.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.9 MB/s | 161 kB 00:00 2024-09-10T11:30:06.334 INFO:teuthology.orchestra.run.smithi081.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-10T11:30:06.359 INFO:teuthology.orchestra.run.smithi081.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.3 MB/s | 320 kB 00:00 2024-09-10T11:30:06.393 INFO:teuthology.orchestra.run.smithi081.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.0 MB/s | 301 kB 00:00 2024-09-10T11:30:06.417 INFO:teuthology.orchestra.run.smithi017.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.8 MB/s | 897 kB 00:00 2024-09-10T11:30:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T11:30:06.452 INFO:teuthology.orchestra.run.smithi081.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-10T11:30:06.534 INFO:teuthology.orchestra.run.smithi017.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.2 MB/s | 145 kB 00:00 2024-09-10T11:30:06.544 INFO:teuthology.orchestra.run.smithi081.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-10T11:30:06.611 INFO:teuthology.orchestra.run.smithi081.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-10T11:30:06.636 INFO:teuthology.orchestra.run.smithi081.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 346 kB/s | 32 kB 00:00 2024-09-10T11:30:06.679 INFO:teuthology.orchestra.run.smithi081.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.1 MB/s | 146 kB 00:00 2024-09-10T11:30:07.112 INFO:teuthology.orchestra.run.smithi081.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 7.5 MB/s | 3.6 MB 00:00 2024-09-10T11:30:07.196 INFO:teuthology.orchestra.run.smithi081.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-10T11:30:07.221 INFO:teuthology.orchestra.run.smithi081.stdout:(33/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.2 MB/s | 249 kB 00:00 2024-09-10T11:30:07.246 INFO:teuthology.orchestra.run.smithi081.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 981 kB/s | 49 kB 00:00 2024-09-10T11:30:07.271 INFO:teuthology.orchestra.run.smithi081.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 328 kB/s | 16 kB 00:00 2024-09-10T11:30:07.292 INFO:teuthology.orchestra.run.smithi017.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-10T11:30:07.297 INFO:teuthology.orchestra.run.smithi081.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.5 MB/s | 285 kB 00:00 2024-09-10T11:30:07.460 INFO:teuthology.orchestra.run.smithi017.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-10T11:30:07.526 INFO:teuthology.orchestra.run.smithi017.stdout:(6/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-09-10T11:30:07.575 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:07.576 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:30:07.588 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T11:30:07.589 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T11:30:07.590 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T11:30:07.590 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T11:30:07.592 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T11:30:07.595 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T11:30:07.595 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T11:30:07.662 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T11:30:07.677 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T11:30:07.678 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T11:30:07.679 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T11:30:07.680 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T11:30:07.681 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T11:30:07.682 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T11:30:07.683 INFO:teuthology.orchestra.run.smithi026.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T11:30:07.684 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T11:30:07.685 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T11:30:07.685 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T11:30:07.685 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T11:30:07.686 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T11:30:07.687 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T11:30:07.688 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T11:30:07.689 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T11:30:07.690 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:30:07.691 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-10T11:30:07.691 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================== 2024-09-10T11:30:07.691 INFO:teuthology.orchestra.run.smithi026.stdout:Install 148 Packages 2024-09-10T11:30:07.691 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 8 Packages 2024-09-10T11:30:07.691 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:30:07.692 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 226 M 2024-09-10T11:30:07.692 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-10T11:30:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:(37/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 19 MB/s | 49 MB 00:02 2024-09-10T11:30:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 38 kB/s | 18 kB 00:00 2024-09-10T11:30:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:(39/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 1.4 MB/s | 766 kB 00:00 2024-09-10T11:30:07.889 INFO:teuthology.orchestra.run.smithi081.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-10T11:30:07.931 INFO:teuthology.orchestra.run.smithi081.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-10T11:30:07.982 INFO:teuthology.orchestra.run.smithi081.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-10T11:30:08.007 INFO:teuthology.orchestra.run.smithi081.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-10T11:30:08.032 INFO:teuthology.orchestra.run.smithi081.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T11:30:08.058 INFO:teuthology.orchestra.run.smithi081.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T11:30:08.083 INFO:teuthology.orchestra.run.smithi081.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T11:30:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T11:30:08.142 INFO:teuthology.orchestra.run.smithi081.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-10T11:30:08.191 INFO:teuthology.orchestra.run.smithi026.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-10T11:30:08.244 INFO:teuthology.orchestra.run.smithi017.stdout:(7/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 8.7 MB/s | 21 MB 00:02 2024-09-10T11:30:08.319 INFO:teuthology.orchestra.run.smithi017.stdout:(8/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 5.5 MB/s | 4.7 MB 00:00 2024-09-10T11:30:08.325 INFO:teuthology.orchestra.run.smithi081.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 583 kB/s | 107 kB 00:00 2024-09-10T11:30:08.384 INFO:teuthology.orchestra.run.smithi081.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T11:30:08.409 INFO:teuthology.orchestra.run.smithi081.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-10T11:30:08.419 INFO:teuthology.orchestra.run.smithi017.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 252 kB/s | 25 kB 00:00 2024-09-10T11:30:08.441 INFO:teuthology.orchestra.run.smithi026.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.5 MB/s | 897 kB 00:00 2024-09-10T11:30:08.460 INFO:teuthology.orchestra.run.smithi081.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-10T11:30:08.485 INFO:teuthology.orchestra.run.smithi081.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-10T11:30:08.510 INFO:teuthology.orchestra.run.smithi081.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T11:30:08.541 INFO:teuthology.orchestra.run.smithi026.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.4 MB/s | 145 kB 00:00 2024-09-10T11:30:08.544 INFO:teuthology.orchestra.run.smithi081.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-10T11:30:08.569 INFO:teuthology.orchestra.run.smithi081.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-10T11:30:08.611 INFO:teuthology.orchestra.run.smithi081.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-10T11:30:08.636 INFO:teuthology.orchestra.run.smithi081.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-09-10T11:30:08.704 INFO:teuthology.orchestra.run.smithi081.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-10T11:30:08.716 INFO:teuthology.orchestra.run.smithi026.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 8.2 MB/s | 5.4 MB 00:00 2024-09-10T11:30:08.762 INFO:teuthology.orchestra.run.smithi081.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 421 kB/s | 24 kB 00:00 2024-09-10T11:30:08.796 INFO:teuthology.orchestra.run.smithi081.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-10T11:30:08.821 INFO:teuthology.orchestra.run.smithi081.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-10T11:30:08.854 INFO:teuthology.orchestra.run.smithi081.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T11:30:08.892 INFO:teuthology.orchestra.run.smithi026.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-10T11:30:08.905 INFO:teuthology.orchestra.run.smithi081.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T11:30:08.938 INFO:teuthology.orchestra.run.smithi081.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T11:30:08.992 INFO:teuthology.orchestra.run.smithi026.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-10T11:30:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 12 MB/s | 11 MB 00:00 2024-09-10T11:30:09.253 INFO:teuthology.orchestra.run.smithi017.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 2.4 MB/s | 228 kB 00:00 2024-09-10T11:30:09.284 INFO:teuthology.orchestra.run.smithi026.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-10T11:30:09.303 INFO:teuthology.orchestra.run.smithi017.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 541 kB/s | 27 kB 00:00 2024-09-10T11:30:09.387 INFO:teuthology.orchestra.run.smithi017.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 380 kB/s | 32 kB 00:00 2024-09-10T11:30:09.470 INFO:teuthology.orchestra.run.smithi017.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-10T11:30:09.489 INFO:teuthology.orchestra.run.smithi081.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-10T11:30:09.520 INFO:teuthology.orchestra.run.smithi017.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T11:30:09.534 INFO:teuthology.orchestra.run.smithi026.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 14 MB/s | 21 MB 00:01 2024-09-10T11:30:09.579 INFO:teuthology.orchestra.run.smithi017.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T11:30:09.593 INFO:teuthology.orchestra.run.smithi026.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 433 kB/s | 25 kB 00:00 2024-09-10T11:30:09.663 INFO:teuthology.orchestra.run.smithi017.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 6.0 MB/s | 506 kB 00:00 2024-09-10T11:30:10.199 INFO:teuthology.orchestra.run.smithi026.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 12 MB/s | 11 MB 00:00 2024-09-10T11:30:10.264 INFO:teuthology.orchestra.run.smithi081.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-10T11:30:10.285 INFO:teuthology.orchestra.run.smithi026.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 2.6 MB/s | 228 kB 00:00 2024-09-10T11:30:10.288 INFO:teuthology.orchestra.run.smithi017.stdout:(18/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 8.6 MB/s | 5.3 MB 00:00 2024-09-10T11:30:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 13 MB/s | 910 kB 00:00 2024-09-10T11:30:10.360 INFO:teuthology.orchestra.run.smithi026.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 361 kB/s | 27 kB 00:00 2024-09-10T11:30:10.364 INFO:teuthology.orchestra.run.smithi017.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 603 kB/s | 45 kB 00:00 2024-09-10T11:30:10.389 INFO:teuthology.orchestra.run.smithi081.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T11:30:10.422 INFO:teuthology.orchestra.run.smithi017.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.3 MB/s | 136 kB 00:00 2024-09-10T11:30:10.481 INFO:teuthology.orchestra.run.smithi017.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.7 MB/s | 161 kB 00:00 2024-09-10T11:30:10.536 INFO:teuthology.orchestra.run.smithi026.stdout:(13/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 17 MB 00:01 2024-09-10T11:30:10.539 INFO:teuthology.orchestra.run.smithi017.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T11:30:10.552 INFO:teuthology.orchestra.run.smithi026.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 165 kB/s | 32 kB 00:00 2024-09-10T11:30:10.594 INFO:teuthology.orchestra.run.smithi026.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 751 kB 00:00 2024-09-10T11:30:10.620 INFO:teuthology.orchestra.run.smithi026.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.4 MB/s | 164 kB 00:00 2024-09-10T11:30:10.623 INFO:teuthology.orchestra.run.smithi017.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.5 MB/s | 301 kB 00:00 2024-09-10T11:30:10.662 INFO:teuthology.orchestra.run.smithi026.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.9 MB/s | 127 kB 00:00 2024-09-10T11:30:10.721 INFO:teuthology.orchestra.run.smithi017.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T11:30:10.724 INFO:teuthology.orchestra.run.smithi026.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 6.6 MB/s | 506 kB 00:00 2024-09-10T11:30:10.741 INFO:teuthology.orchestra.run.smithi017.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-10T11:30:10.746 INFO:teuthology.orchestra.run.smithi026.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 900 kB/s | 45 kB 00:00 2024-09-10T11:30:10.765 INFO:teuthology.orchestra.run.smithi081.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.7 MB/s | 4.9 MB 00:01 2024-09-10T11:30:10.840 INFO:teuthology.orchestra.run.smithi081.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-10T11:30:10.855 INFO:teuthology.orchestra.run.smithi026.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.2 MB/s | 136 kB 00:00 2024-09-10T11:30:10.899 INFO:teuthology.orchestra.run.smithi081.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T11:30:10.946 INFO:teuthology.orchestra.run.smithi026.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.7 MB/s | 161 kB 00:00 2024-09-10T11:30:11.038 INFO:teuthology.orchestra.run.smithi026.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.4 MB/s | 320 kB 00:00 2024-09-10T11:30:11.122 INFO:teuthology.orchestra.run.smithi026.stdout:(23/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-10T11:30:11.147 INFO:teuthology.orchestra.run.smithi026.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.7 MB/s | 301 kB 00:00 2024-09-10T11:30:11.149 INFO:teuthology.orchestra.run.smithi017.stdout:(26/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 7.6 MB/s | 3.1 MB 00:00 2024-09-10T11:30:11.189 INFO:teuthology.orchestra.run.smithi026.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.5 MB/s | 99 kB 00:00 2024-09-10T11:30:11.215 INFO:teuthology.orchestra.run.smithi026.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-10T11:30:11.224 INFO:teuthology.orchestra.run.smithi017.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-10T11:30:11.232 INFO:teuthology.orchestra.run.smithi081.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-10T11:30:11.266 INFO:teuthology.orchestra.run.smithi081.stdout:(74/156): postgresql-13.16-1.el9.x86_64.rpm 914 kB/s | 1.6 MB 00:01 2024-09-10T11:30:11.291 INFO:teuthology.orchestra.run.smithi081.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T11:30:11.298 INFO:teuthology.orchestra.run.smithi026.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.0 MB/s | 170 kB 00:00 2024-09-10T11:30:11.308 INFO:teuthology.orchestra.run.smithi017.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 382 kB/s | 32 kB 00:00 2024-09-10T11:30:11.325 INFO:teuthology.orchestra.run.smithi081.stdout:(76/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-10T11:30:11.350 INFO:teuthology.orchestra.run.smithi081.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T11:30:11.373 INFO:teuthology.orchestra.run.smithi026.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 425 kB/s | 32 kB 00:00 2024-09-10T11:30:11.375 INFO:teuthology.orchestra.run.smithi081.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-10T11:30:11.392 INFO:teuthology.orchestra.run.smithi017.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.7 MB/s | 146 kB 00:00 2024-09-10T11:30:11.392 INFO:teuthology.orchestra.run.smithi081.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 382 kB/s | 26 kB 00:00 2024-09-10T11:30:11.418 INFO:teuthology.orchestra.run.smithi081.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-10T11:30:11.434 INFO:teuthology.orchestra.run.smithi081.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T11:30:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 591 kB/s | 35 kB 00:00 2024-09-10T11:30:11.482 INFO:teuthology.orchestra.run.smithi026.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-10T11:30:11.486 INFO:teuthology.orchestra.run.smithi081.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.7 MB/s | 250 kB 00:00 2024-09-10T11:30:11.507 INFO:teuthology.orchestra.run.smithi026.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.1 MB/s | 146 kB 00:00 2024-09-10T11:30:11.511 INFO:teuthology.orchestra.run.smithi081.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.6 MB/s | 222 kB 00:00 2024-09-10T11:30:11.545 INFO:teuthology.orchestra.run.smithi081.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T11:30:11.596 INFO:teuthology.orchestra.run.smithi081.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 504 kB/s | 42 kB 00:00 2024-09-10T11:30:11.621 INFO:teuthology.orchestra.run.smithi081.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T11:30:11.654 INFO:teuthology.orchestra.run.smithi081.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T11:30:11.722 INFO:teuthology.orchestra.run.smithi081.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-10T11:30:11.747 INFO:teuthology.orchestra.run.smithi081.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-10T11:30:11.772 INFO:teuthology.orchestra.run.smithi081.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-10T11:30:11.797 INFO:teuthology.orchestra.run.smithi081.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-09-10T11:30:11.831 INFO:teuthology.orchestra.run.smithi081.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-10T11:30:11.856 INFO:teuthology.orchestra.run.smithi081.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-10T11:30:11.889 INFO:teuthology.orchestra.run.smithi081.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T11:30:11.932 INFO:teuthology.orchestra.run.smithi081.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-10T11:30:11.957 INFO:teuthology.orchestra.run.smithi081.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-10T11:30:11.966 INFO:teuthology.orchestra.run.smithi026.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 7.4 MB/s | 3.6 MB 00:00 2024-09-10T11:30:11.984 INFO:teuthology.orchestra.run.smithi017.stdout:(30/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 6.0 MB/s | 3.6 MB 00:00 2024-09-10T11:30:11.990 INFO:teuthology.orchestra.run.smithi081.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T11:30:12.016 INFO:teuthology.orchestra.run.smithi081.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-10T11:30:12.049 INFO:teuthology.orchestra.run.smithi081.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T11:30:12.074 INFO:teuthology.orchestra.run.smithi081.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T11:30:12.108 INFO:teuthology.orchestra.run.smithi081.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-10T11:30:12.342 INFO:teuthology.orchestra.run.smithi081.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-10T11:30:12.400 INFO:teuthology.orchestra.run.smithi081.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T11:30:12.425 INFO:teuthology.orchestra.run.smithi026.stdout:(32/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 17 MB/s | 49 MB 00:02 2024-09-10T11:30:12.442 INFO:teuthology.orchestra.run.smithi081.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-10T11:30:12.450 INFO:teuthology.orchestra.run.smithi026.stdout:(33/156): ceph-mgr-modules-core-19.1.1-305.g1cf 515 kB/s | 249 kB 00:00 2024-09-10T11:30:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 989 kB/s | 49 kB 00:00 2024-09-10T11:30:12.509 INFO:teuthology.orchestra.run.smithi026.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 282 kB/s | 16 kB 00:00 2024-09-10T11:30:12.601 INFO:teuthology.orchestra.run.smithi026.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 6.7 MB/s | 7.4 MB 00:01 2024-09-10T11:30:12.609 INFO:teuthology.orchestra.run.smithi081.stdout:(106/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-10T11:30:12.626 INFO:teuthology.orchestra.run.smithi026.stdout:(37/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 1.8 MB/s | 285 kB 00:00 2024-09-10T11:30:12.634 INFO:teuthology.orchestra.run.smithi081.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 101 kB/s | 19 kB 00:00 2024-09-10T11:30:12.643 INFO:teuthology.orchestra.run.smithi026.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 437 kB/s | 18 kB 00:00 2024-09-10T11:30:12.659 INFO:teuthology.orchestra.run.smithi017.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-10T11:30:12.677 INFO:teuthology.orchestra.run.smithi081.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 765 kB/s | 26 kB 00:00 2024-09-10T11:30:12.677 INFO:teuthology.orchestra.run.smithi026.stdout:(39/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 4.5 MB/s | 766 kB 00:00 2024-09-10T11:30:12.702 INFO:teuthology.orchestra.run.smithi081.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-10T11:30:12.718 INFO:teuthology.orchestra.run.smithi017.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.2 MB/s | 249 kB 00:00 2024-09-10T11:30:12.727 INFO:teuthology.orchestra.run.smithi081.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T11:30:12.760 INFO:teuthology.orchestra.run.smithi017.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 1.2 MB/s | 49 kB 00:00 2024-09-10T11:30:12.760 INFO:teuthology.orchestra.run.smithi081.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T11:30:12.801 INFO:teuthology.orchestra.run.smithi017.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 399 kB/s | 16 kB 00:00 2024-09-10T11:30:12.819 INFO:teuthology.orchestra.run.smithi081.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-10T11:30:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-10T11:30:12.912 INFO:teuthology.orchestra.run.smithi081.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-10T11:30:12.937 INFO:teuthology.orchestra.run.smithi081.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 579 kB/s | 43 kB 00:00 2024-09-10T11:30:12.962 INFO:teuthology.orchestra.run.smithi081.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-10T11:30:12.985 INFO:teuthology.orchestra.run.smithi017.stdout:(35/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 3.1 MB/s | 17 MB 00:05 2024-09-10T11:30:12.987 INFO:teuthology.orchestra.run.smithi081.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T11:30:13.010 INFO:teuthology.orchestra.run.smithi017.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 1.3 MB/s | 285 kB 00:00 2024-09-10T11:30:13.046 INFO:teuthology.orchestra.run.smithi081.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-10T11:30:13.068 INFO:teuthology.orchestra.run.smithi026.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 181 kB/s | 80 kB 00:00 2024-09-10T11:30:13.071 INFO:teuthology.orchestra.run.smithi081.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-09-10T11:30:13.085 INFO:teuthology.orchestra.run.smithi017.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 243 kB/s | 18 kB 00:00 2024-09-10T11:30:13.096 INFO:teuthology.orchestra.run.smithi081.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-10T11:30:13.122 INFO:teuthology.orchestra.run.smithi081.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-10T11:30:13.147 INFO:teuthology.orchestra.run.smithi081.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-10T11:30:13.172 INFO:teuthology.orchestra.run.smithi081.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T11:30:13.198 INFO:teuthology.orchestra.run.smithi081.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-10T11:30:13.223 INFO:teuthology.orchestra.run.smithi081.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T11:30:13.248 INFO:teuthology.orchestra.run.smithi081.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T11:30:13.273 INFO:teuthology.orchestra.run.smithi081.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T11:30:13.277 INFO:teuthology.orchestra.run.smithi026.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 318 kB/s | 191 kB 00:00 2024-09-10T11:30:13.299 INFO:teuthology.orchestra.run.smithi081.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T11:30:13.311 INFO:teuthology.orchestra.run.smithi017.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 2.3 MB/s | 766 kB 00:00 2024-09-10T11:30:13.324 INFO:teuthology.orchestra.run.smithi081.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T11:30:13.335 INFO:teuthology.orchestra.run.smithi026.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-09-10T11:30:13.349 INFO:teuthology.orchestra.run.smithi081.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T11:30:13.384 INFO:teuthology.orchestra.run.smithi081.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T11:30:13.386 INFO:teuthology.orchestra.run.smithi026.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-10T11:30:13.416 INFO:teuthology.orchestra.run.smithi081.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T11:30:13.445 INFO:teuthology.orchestra.run.smithi026.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 979 kB/s | 106 kB 00:00 2024-09-10T11:30:13.450 INFO:teuthology.orchestra.run.smithi081.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-10T11:30:13.467 INFO:teuthology.orchestra.run.smithi081.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-10T11:30:13.492 INFO:teuthology.orchestra.run.smithi081.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T11:30:13.495 INFO:teuthology.orchestra.run.smithi026.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T11:30:13.509 INFO:teuthology.orchestra.run.smithi081.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-10T11:30:13.511 INFO:teuthology.orchestra.run.smithi017.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 188 kB/s | 80 kB 00:00 2024-09-10T11:30:13.526 INFO:teuthology.orchestra.run.smithi081.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 916 kB/s | 31 kB 00:00 2024-09-10T11:30:13.543 INFO:teuthology.orchestra.run.smithi081.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-10T11:30:13.553 INFO:teuthology.orchestra.run.smithi026.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-10T11:30:13.568 INFO:teuthology.orchestra.run.smithi081.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-10T11:30:13.585 INFO:teuthology.orchestra.run.smithi081.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 861 kB/s | 36 kB 00:00 2024-09-10T11:30:13.604 INFO:teuthology.orchestra.run.smithi026.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-10T11:30:13.610 INFO:teuthology.orchestra.run.smithi081.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-10T11:30:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-10T11:30:13.703 INFO:teuthology.orchestra.run.smithi081.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2024-09-10T11:30:13.728 INFO:teuthology.orchestra.run.smithi081.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-10T11:30:13.737 INFO:teuthology.orchestra.run.smithi026.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-09-10T11:30:13.753 INFO:teuthology.orchestra.run.smithi081.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-10T11:30:13.778 INFO:teuthology.orchestra.run.smithi081.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T11:30:13.786 INFO:teuthology.orchestra.run.smithi017.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 695 kB/s | 191 kB 00:00 2024-09-10T11:30:13.804 INFO:teuthology.orchestra.run.smithi081.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T11:30:13.854 INFO:teuthology.orchestra.run.smithi081.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T11:30:13.863 INFO:teuthology.orchestra.run.smithi026.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T11:30:13.888 INFO:teuthology.orchestra.run.smithi026.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 711 kB/s | 107 kB 00:00 2024-09-10T11:30:13.922 INFO:teuthology.orchestra.run.smithi026.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-10T11:30:13.963 INFO:teuthology.orchestra.run.smithi026.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 216 kB/s | 22 kB 00:00 2024-09-10T11:30:13.996 INFO:teuthology.orchestra.run.smithi017.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-10T11:30:14.005 INFO:teuthology.orchestra.run.smithi026.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T11:30:14.030 INFO:teuthology.orchestra.run.smithi026.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-10T11:30:14.046 INFO:teuthology.orchestra.run.smithi081.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-10T11:30:14.104 INFO:teuthology.orchestra.run.smithi017.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-10T11:30:14.106 INFO:teuthology.orchestra.run.smithi026.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-10T11:30:14.113 INFO:teuthology.orchestra.run.smithi081.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-10T11:30:14.131 INFO:teuthology.orchestra.run.smithi026.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-10T11:30:14.155 INFO:teuthology.orchestra.run.smithi081.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 984 kB/s | 41 kB 00:00 2024-09-10T11:30:14.205 INFO:teuthology.orchestra.run.smithi081.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-10T11:30:14.212 INFO:teuthology.orchestra.run.smithi017.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-10T11:30:14.215 INFO:teuthology.orchestra.run.smithi026.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-10T11:30:14.240 INFO:teuthology.orchestra.run.smithi026.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T11:30:14.264 INFO:teuthology.orchestra.run.smithi081.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-10T11:30:14.321 INFO:teuthology.orchestra.run.smithi017.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T11:30:14.322 INFO:teuthology.orchestra.run.smithi081.stdout:(154/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 6.1 MB/s | 3.2 MB 00:00 2024-09-10T11:30:14.324 INFO:teuthology.orchestra.run.smithi026.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-10T11:30:14.355 INFO:teuthology.orchestra.run.smithi017.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-09-10T11:30:14.366 INFO:teuthology.orchestra.run.smithi026.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-10T11:30:14.381 INFO:teuthology.orchestra.run.smithi081.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-10T11:30:14.422 INFO:teuthology.orchestra.run.smithi017.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T11:30:14.424 INFO:teuthology.orchestra.run.smithi026.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.5 MB/s | 3.0 MB 00:00 2024-09-10T11:30:14.448 INFO:teuthology.orchestra.run.smithi081.stdout:(156/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.1 MB/s | 3.4 MB 00:00 2024-09-10T11:30:14.449 INFO:teuthology.orchestra.run.smithi026.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-10T11:30:14.454 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:30:14.454 INFO:teuthology.orchestra.run.smithi081.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-10T11:30:14.464 INFO:teuthology.orchestra.run.smithi017.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-10T11:30:14.475 INFO:teuthology.orchestra.run.smithi026.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-10T11:30:14.567 INFO:teuthology.orchestra.run.smithi026.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T11:30:14.592 INFO:teuthology.orchestra.run.smithi026.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-10T11:30:14.867 INFO:teuthology.orchestra.run.smithi026.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 660 kB/s | 292 kB 00:00 2024-09-10T11:30:15.009 INFO:teuthology.orchestra.run.smithi026.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-10T11:30:15.064 INFO:teuthology.orchestra.run.smithi017.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-10T11:30:15.151 INFO:teuthology.orchestra.run.smithi026.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-10T11:30:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-10T11:30:15.206 INFO:teuthology.orchestra.run.smithi017.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-09-10T11:30:15.249 INFO:teuthology.orchestra.run.smithi017.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-10T11:30:15.324 INFO:teuthology.orchestra.run.smithi017.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 33 kB 00:00 2024-09-10T11:30:15.391 INFO:teuthology.orchestra.run.smithi017.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-09-10T11:30:15.418 INFO:teuthology.orchestra.run.smithi026.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 515 kB/s | 137 kB 00:00 2024-09-10T11:30:15.457 INFO:teuthology.orchestra.run.smithi017.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-09-10T11:30:15.525 INFO:teuthology.orchestra.run.smithi017.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-10T11:30:15.650 INFO:teuthology.orchestra.run.smithi017.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T11:30:15.693 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-10T11:30:15.725 INFO:teuthology.orchestra.run.smithi017.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-09-10T11:30:15.847 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-10T11:30:15.847 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-10T11:30:16.025 INFO:teuthology.orchestra.run.smithi017.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T11:30:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-10T11:30:16.359 INFO:teuthology.orchestra.run.smithi017.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 327 kB/s | 24 kB 00:00 2024-09-10T11:30:16.434 INFO:teuthology.orchestra.run.smithi017.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 633 kB/s | 47 kB 00:00 2024-09-10T11:30:16.618 INFO:teuthology.orchestra.run.smithi017.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-09-10T11:30:16.643 INFO:teuthology.orchestra.run.smithi017.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-10T11:30:16.710 INFO:teuthology.orchestra.run.smithi017.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-10T11:30:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T11:30:16.801 INFO:teuthology.orchestra.run.smithi026.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-10T11:30:17.060 INFO:teuthology.orchestra.run.smithi026.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 740 kB/s | 1.6 MB 00:02 2024-09-10T11:30:17.244 INFO:teuthology.orchestra.run.smithi026.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-09-10T11:30:17.645 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-10T11:30:17.646 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-10T11:30:17.861 INFO:teuthology.orchestra.run.smithi017.stdout:(66/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 5.2 MB/s | 49 MB 00:09 2024-09-10T11:30:18.203 INFO:teuthology.orchestra.run.smithi026.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 738 kB/s | 1.0 MB 00:01 2024-09-10T11:30:18.303 INFO:teuthology.orchestra.run.smithi026.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2024-09-10T11:30:18.395 INFO:teuthology.orchestra.run.smithi017.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-09-10T11:30:18.461 INFO:teuthology.orchestra.run.smithi017.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.8 MB/s | 4.9 MB 00:01 2024-09-10T11:30:18.529 INFO:teuthology.orchestra.run.smithi017.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T11:30:18.645 INFO:teuthology.orchestra.run.smithi026.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 716 kB/s | 245 kB 00:00 2024-09-10T11:30:18.729 INFO:teuthology.orchestra.run.smithi017.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-10T11:30:18.986 INFO:teuthology.orchestra.run.smithi026.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 727 kB/s | 248 kB 00:00 2024-09-10T11:30:19.021 INFO:teuthology.orchestra.run.smithi017.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-10T11:30:19.087 INFO:teuthology.orchestra.run.smithi026.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-10T11:30:19.088 INFO:teuthology.orchestra.run.smithi017.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T11:30:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:(73/156): postgresql-13.16-1.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-09-10T11:30:19.187 INFO:teuthology.orchestra.run.smithi026.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-10T11:30:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 526 kB/s | 61 kB 00:00 2024-09-10T11:30:19.422 INFO:teuthology.orchestra.run.smithi017.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-10T11:30:19.454 INFO:teuthology.orchestra.run.smithi026.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 646 kB/s | 172 kB 00:00 2024-09-10T11:30:19.562 INFO:teuthology.orchestra.run.smithi026.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-10T11:30:19.589 INFO:teuthology.orchestra.run.smithi017.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-10T11:30:19.656 INFO:teuthology.orchestra.run.smithi017.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-10T11:30:19.723 INFO:teuthology.orchestra.run.smithi017.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-10T11:30:19.857 INFO:teuthology.orchestra.run.smithi017.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T11:30:19.932 INFO:teuthology.orchestra.run.smithi017.stdout:(80/156): postgresql-server-13.16-1.el9.x86_64. 4.1 MB/s | 5.8 MB 00:01 2024-09-10T11:30:19.949 INFO:teuthology.orchestra.run.smithi017.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 379 kB/s | 35 kB 00:00 2024-09-10T11:30:20.124 INFO:teuthology.orchestra.run.smithi017.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-10T11:30:20.249 INFO:teuthology.orchestra.run.smithi017.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-10T11:30:20.333 INFO:teuthology.orchestra.run.smithi017.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 926 kB/s | 77 kB 00:00 2024-09-10T11:30:20.408 INFO:teuthology.orchestra.run.smithi017.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-09-10T11:30:20.433 INFO:teuthology.orchestra.run.smithi017.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-10T11:30:20.526 INFO:teuthology.orchestra.run.smithi017.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-10T11:30:20.551 INFO:teuthology.orchestra.run.smithi017.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T11:30:20.651 INFO:teuthology.orchestra.run.smithi017.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-10T11:30:20.676 INFO:teuthology.orchestra.run.smithi017.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-09-10T11:30:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-10T11:30:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-10T11:30:20.894 INFO:teuthology.orchestra.run.smithi017.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-09-10T11:30:21.011 INFO:teuthology.orchestra.run.smithi017.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-09-10T11:30:21.036 INFO:teuthology.orchestra.run.smithi017.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-10T11:30:21.078 INFO:teuthology.orchestra.run.smithi017.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-10T11:30:21.103 INFO:teuthology.orchestra.run.smithi017.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-10T11:30:21.187 INFO:teuthology.orchestra.run.smithi017.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-10T11:30:21.213 INFO:teuthology.orchestra.run.smithi017.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 531 kB/s | 58 kB 00:00 2024-09-10T11:30:21.255 INFO:teuthology.orchestra.run.smithi017.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-10T11:30:21.313 INFO:teuthology.orchestra.run.smithi017.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-10T11:30:21.330 INFO:teuthology.orchestra.run.smithi017.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 543 kB/s | 64 kB 00:00 2024-09-10T11:30:21.872 INFO:teuthology.orchestra.run.smithi017.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-09-10T11:30:21.922 INFO:teuthology.orchestra.run.smithi017.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T11:30:21.956 INFO:teuthology.orchestra.run.smithi017.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T11:30:21.973 INFO:teuthology.orchestra.run.smithi017.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T11:30:22.090 INFO:teuthology.orchestra.run.smithi017.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-10T11:30:22.106 INFO:teuthology.orchestra.run.smithi017.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-10T11:30:22.123 INFO:teuthology.orchestra.run.smithi017.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-10T11:30:22.149 INFO:teuthology.orchestra.run.smithi017.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T11:30:22.174 INFO:teuthology.orchestra.run.smithi017.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T11:30:22.225 INFO:teuthology.orchestra.run.smithi017.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T11:30:22.258 INFO:teuthology.orchestra.run.smithi017.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T11:30:22.300 INFO:teuthology.orchestra.run.smithi017.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 890 kB/s | 863 kB 00:00 2024-09-10T11:30:22.317 INFO:teuthology.orchestra.run.smithi017.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-10T11:30:22.343 INFO:teuthology.orchestra.run.smithi017.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 875 kB/s | 14 kB 00:00 2024-09-10T11:30:22.359 INFO:teuthology.orchestra.run.smithi017.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-10T11:30:22.385 INFO:teuthology.orchestra.run.smithi017.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.2 MB/s | 172 kB 00:00 2024-09-10T11:30:22.427 INFO:teuthology.orchestra.run.smithi017.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T11:30:22.452 INFO:teuthology.orchestra.run.smithi017.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T11:30:22.486 INFO:teuthology.orchestra.run.smithi017.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T11:30:22.511 INFO:teuthology.orchestra.run.smithi017.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T11:30:22.536 INFO:teuthology.orchestra.run.smithi017.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-10T11:30:22.561 INFO:teuthology.orchestra.run.smithi017.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-10T11:30:22.587 INFO:teuthology.orchestra.run.smithi017.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 922 kB/s | 23 kB 00:00 2024-09-10T11:30:22.612 INFO:teuthology.orchestra.run.smithi017.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-10T11:30:22.638 INFO:teuthology.orchestra.run.smithi017.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-10T11:30:22.696 INFO:teuthology.orchestra.run.smithi017.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-10T11:30:22.747 INFO:teuthology.orchestra.run.smithi017.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.9 MB/s | 2.0 MB 00:00 2024-09-10T11:30:22.772 INFO:teuthology.orchestra.run.smithi017.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-09-10T11:30:22.797 INFO:teuthology.orchestra.run.smithi017.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T11:30:22.822 INFO:teuthology.orchestra.run.smithi017.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T11:30:22.848 INFO:teuthology.orchestra.run.smithi017.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T11:30:22.873 INFO:teuthology.orchestra.run.smithi017.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T11:30:22.898 INFO:teuthology.orchestra.run.smithi017.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T11:30:22.924 INFO:teuthology.orchestra.run.smithi017.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T11:30:22.941 INFO:teuthology.orchestra.run.smithi017.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-10T11:30:22.966 INFO:teuthology.orchestra.run.smithi017.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T11:30:22.983 INFO:teuthology.orchestra.run.smithi017.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-10T11:30:23.008 INFO:teuthology.orchestra.run.smithi017.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T11:30:23.034 INFO:teuthology.orchestra.run.smithi017.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T11:30:23.059 INFO:teuthology.orchestra.run.smithi017.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T11:30:23.084 INFO:teuthology.orchestra.run.smithi017.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T11:30:23.109 INFO:teuthology.orchestra.run.smithi017.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-10T11:30:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T11:30:23.160 INFO:teuthology.orchestra.run.smithi017.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T11:30:23.219 INFO:teuthology.orchestra.run.smithi017.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T11:30:23.313 INFO:teuthology.orchestra.run.smithi026.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 749 kB/s | 5.8 MB 00:07 2024-09-10T11:30:23.527 INFO:teuthology.orchestra.run.smithi017.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-10T11:30:23.663 INFO:teuthology.orchestra.run.smithi026.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 716 kB/s | 250 kB 00:00 2024-09-10T11:30:23.905 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-10T11:30:23.961 INFO:teuthology.orchestra.run.smithi017.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 4.3 MB/s | 3.2 MB 00:00 2024-09-10T11:30:24.018 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T11:30:24.030 INFO:teuthology.orchestra.run.smithi026.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 606 kB/s | 222 kB 00:00 2024-09-10T11:30:24.056 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T11:30:24.213 INFO:teuthology.orchestra.run.smithi026.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-09-10T11:30:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T11:30:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T11:30:24.322 INFO:teuthology.orchestra.run.smithi026.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-10T11:30:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T11:30:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T11:30:24.669 INFO:teuthology.orchestra.run.smithi017.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-10T11:30:24.769 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T11:30:24.780 INFO:teuthology.orchestra.run.smithi026.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 588 kB/s | 269 kB 00:00 2024-09-10T11:30:24.811 INFO:teuthology.orchestra.run.smithi017.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 288 kB/s | 41 kB 00:00 2024-09-10T11:30:24.829 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:24.953 INFO:teuthology.orchestra.run.smithi017.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-10T11:30:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:25.031 INFO:teuthology.orchestra.run.smithi026.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 635 kB/s | 159 kB 00:00 2024-09-10T11:30:25.037 INFO:teuthology.orchestra.run.smithi017.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-10T11:30:25.071 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:30:25.104 INFO:teuthology.orchestra.run.smithi017.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-10T11:30:25.114 INFO:teuthology.orchestra.run.smithi026.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 776 kB/s | 6.0 MB 00:07 2024-09-10T11:30:25.148 INFO:teuthology.orchestra.run.smithi026.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T11:30:25.223 INFO:teuthology.orchestra.run.smithi026.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-10T11:30:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T11:30:25.265 INFO:teuthology.orchestra.run.smithi026.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 459 kB/s | 54 kB 00:00 2024-09-10T11:30:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T11:30:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:25.390 INFO:teuthology.orchestra.run.smithi026.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-09-10T11:30:25.404 INFO:teuthology.orchestra.run.smithi017.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-09-10T11:30:25.438 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:25.468 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:25.499 INFO:teuthology.orchestra.run.smithi026.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-10T11:30:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:25.563 INFO:teuthology.orchestra.run.smithi017.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-10T11:30:25.569 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:30:25.569 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 226 MB 00:20 2024-09-10T11:30:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:25.625 INFO:teuthology.orchestra.run.smithi026.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-10T11:30:25.741 INFO:teuthology.orchestra.run.smithi026.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-10T11:30:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:25.850 INFO:teuthology.orchestra.run.smithi026.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-10T11:30:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:26.035 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T11:30:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:26.284 INFO:teuthology.orchestra.run.smithi026.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 701 kB/s | 304 kB 00:00 2024-09-10T11:30:26.384 INFO:teuthology.orchestra.run.smithi026.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 579 kB/s | 58 kB 00:00 2024-09-10T11:30:26.436 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:26.509 INFO:teuthology.orchestra.run.smithi026.stdout:(99/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 751 kB/s | 5.1 MB 00:06 2024-09-10T11:30:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T11:30:26.609 INFO:teuthology.orchestra.run.smithi026.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 425 kB/s | 96 kB 00:00 2024-09-10T11:30:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T11:30:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T11:30:26.701 INFO:teuthology.orchestra.run.smithi026.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-10T11:30:26.718 INFO:teuthology.orchestra.run.smithi026.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-10T11:30:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T11:30:26.785 INFO:teuthology.orchestra.run.smithi026.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-10T11:30:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T11:30:26.809 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-10T11:30:26.844 INFO:teuthology.orchestra.run.smithi026.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T11:30:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T11:30:26.877 INFO:teuthology.orchestra.run.smithi026.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T11:30:26.892 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T11:30:26.902 INFO:teuthology.orchestra.run.smithi026.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-10T11:30:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T11:30:26.936 INFO:teuthology.orchestra.run.smithi026.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-10T11:30:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T11:30:26.976 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-10T11:30:26.977 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-10T11:30:26.978 INFO:teuthology.orchestra.run.smithi026.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-09-10T11:30:26.996 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T11:30:27.003 INFO:teuthology.orchestra.run.smithi026.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T11:30:27.029 INFO:teuthology.orchestra.run.smithi026.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T11:30:27.054 INFO:teuthology.orchestra.run.smithi026.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-10T11:30:27.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T11:30:27.113 INFO:teuthology.orchestra.run.smithi026.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-10T11:30:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T11:30:27.154 INFO:teuthology.orchestra.run.smithi026.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T11:30:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T11:30:27.180 INFO:teuthology.orchestra.run.smithi026.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T11:30:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T11:30:27.205 INFO:teuthology.orchestra.run.smithi026.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T11:30:27.230 INFO:teuthology.orchestra.run.smithi026.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-10T11:30:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T11:30:27.305 INFO:teuthology.orchestra.run.smithi026.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T11:30:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T11:30:27.339 INFO:teuthology.orchestra.run.smithi026.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-09-10T11:30:27.355 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T11:30:27.364 INFO:teuthology.orchestra.run.smithi026.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T11:30:27.384 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T11:30:27.390 INFO:teuthology.orchestra.run.smithi026.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T11:30:27.415 INFO:teuthology.orchestra.run.smithi026.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T11:30:27.449 INFO:teuthology.orchestra.run.smithi026.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T11:30:27.453 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T11:30:27.474 INFO:teuthology.orchestra.run.smithi026.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 421 kB/s | 11 kB 00:00 2024-09-10T11:30:27.498 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T11:30:27.499 INFO:teuthology.orchestra.run.smithi026.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-10T11:30:27.525 INFO:teuthology.orchestra.run.smithi026.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-10T11:30:27.550 INFO:teuthology.orchestra.run.smithi026.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-10T11:30:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T11:30:27.575 INFO:teuthology.orchestra.run.smithi026.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-10T11:30:27.626 INFO:teuthology.orchestra.run.smithi026.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-10T11:30:27.676 INFO:teuthology.orchestra.run.smithi026.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-09-10T11:30:27.701 INFO:teuthology.orchestra.run.smithi026.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-09-10T11:30:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T11:30:27.735 INFO:teuthology.orchestra.run.smithi026.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-10T11:30:27.760 INFO:teuthology.orchestra.run.smithi026.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-09-10T11:30:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T11:30:27.785 INFO:teuthology.orchestra.run.smithi026.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-10T11:30:27.810 INFO:teuthology.orchestra.run.smithi026.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T11:30:27.836 INFO:teuthology.orchestra.run.smithi026.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T11:30:27.861 INFO:teuthology.orchestra.run.smithi026.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-10T11:30:27.886 INFO:teuthology.orchestra.run.smithi026.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-10T11:30:27.912 INFO:teuthology.orchestra.run.smithi026.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T11:30:27.937 INFO:teuthology.orchestra.run.smithi026.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T11:30:27.954 INFO:teuthology.orchestra.run.smithi026.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 854 kB/s | 36 kB 00:00 2024-09-10T11:30:27.979 INFO:teuthology.orchestra.run.smithi026.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-10T11:30:28.005 INFO:teuthology.orchestra.run.smithi026.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T11:30:28.030 INFO:teuthology.orchestra.run.smithi026.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T11:30:28.046 INFO:teuthology.orchestra.run.smithi026.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T11:30:28.072 INFO:teuthology.orchestra.run.smithi026.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T11:30:28.105 INFO:teuthology.orchestra.run.smithi026.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-10T11:30:28.164 INFO:teuthology.orchestra.run.smithi026.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-10T11:30:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T11:30:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T11:30:28.390 INFO:teuthology.orchestra.run.smithi026.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T11:30:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T11:30:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T11:30:28.490 INFO:teuthology.orchestra.run.smithi026.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-10T11:30:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T11:30:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T11:30:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T11:30:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T11:30:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T11:30:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T11:30:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T11:30:28.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T11:30:29.005 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T11:30:29.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T11:30:29.082 INFO:teuthology.orchestra.run.smithi026.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 3.4 MB/s | 2.3 MB 00:00 2024-09-10T11:30:29.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T11:30:29.126 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T11:30:29.190 INFO:teuthology.orchestra.run.smithi026.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 377 kB/s | 41 kB 00:00 2024-09-10T11:30:29.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T11:30:29.278 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-10T11:30:29.278 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-10T11:30:29.299 INFO:teuthology.orchestra.run.smithi026.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-10T11:30:29.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T11:30:29.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T11:30:29.349 INFO:teuthology.orchestra.run.smithi026.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 2.1 MB/s | 1.8 MB 00:00 2024-09-10T11:30:29.425 INFO:teuthology.orchestra.run.smithi026.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-10T11:30:29.447 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T11:30:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T11:30:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T11:30:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T11:30:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T11:30:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T11:30:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T11:30:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T11:30:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T11:30:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T11:30:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T11:30:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T11:30:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T11:30:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T11:30:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T11:30:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T11:30:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T11:30:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T11:30:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T11:30:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T11:30:30.592 INFO:teuthology.orchestra.run.smithi026.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-10T11:30:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T11:30:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T11:30:31.399 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T11:30:31.446 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T11:30:31.471 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T11:30:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T11:30:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T11:30:31.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T11:30:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T11:30:31.782 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T11:30:31.965 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T11:30:31.988 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T11:30:32.066 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T11:30:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T11:30:32.828 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T11:30:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T11:30:34.117 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T11:30:34.145 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T11:30:34.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T11:30:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T11:30:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:30:34.624 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:30:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T11:30:34.691 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T11:30:35.173 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T11:30:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:30:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:30:35.387 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T11:30:36.103 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-10T11:30:36.201 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T11:30:36.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T11:30:36.443 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T11:30:36.519 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T11:30:36.544 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T11:30:36.607 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T11:30:36.961 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T11:30:37.061 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:37.186 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:37.212 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:37.305 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:37.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:30:37.515 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T11:30:37.574 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T11:30:37.602 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:37.817 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:37.846 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:37.867 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:37.969 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:38.009 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:38.055 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T11:30:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:38.552 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:30:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:30:38.682 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T11:30:38.682 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T11:30:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:30:38.817 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:38.929 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T11:30:39.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T11:30:39.060 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T11:30:39.094 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T11:30:39.169 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T11:30:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T11:30:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T11:30:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T11:30:39.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T11:30:39.364 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T11:30:39.436 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T11:30:39.496 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T11:30:39.551 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T11:30:39.603 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T11:30:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T11:30:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T11:30:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T11:30:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T11:30:39.876 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T11:30:39.925 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T11:30:40.003 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T11:30:40.148 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T11:30:40.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T11:30:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T11:30:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T11:30:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T11:30:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T11:30:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T11:30:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T11:30:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T11:30:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T11:30:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T11:30:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T11:30:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T11:30:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T11:30:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T11:30:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T11:30:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T11:30:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T11:30:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T11:30:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T11:30:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T11:30:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T11:30:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T11:30:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T11:30:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T11:30:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T11:30:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T11:30:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T11:30:42.483 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T11:30:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T11:30:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T11:30:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T11:30:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T11:30:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T11:30:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T11:30:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T11:30:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T11:30:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T11:30:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T11:30:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T11:30:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T11:30:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T11:30:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T11:30:43.917 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T11:30:43.961 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T11:30:43.995 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T11:30:44.098 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T11:30:44.143 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T11:30:44.188 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T11:30:44.287 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T11:30:44.323 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T11:30:44.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T11:30:44.546 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T11:30:44.626 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T11:30:44.766 INFO:teuthology.orchestra.run.smithi026.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 852 kB/s | 16 MB 00:19 2024-09-10T11:30:44.771 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:30:44.771 INFO:teuthology.orchestra.run.smithi026.stdout:Total 6.1 MB/s | 226 MB 00:37 2024-09-10T11:30:45.312 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T11:30:45.423 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T11:30:45.957 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-10T11:30:46.121 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-10T11:30:46.122 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-10T11:30:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T11:30:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T11:30:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T11:30:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T11:30:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T11:30:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:30:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:30:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T11:30:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T11:30:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T11:30:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:30:48.020 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-10T11:30:48.021 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-10T11:30:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:30:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T11:30:50.502 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:50.545 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:30:50.781 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-10T11:30:50.781 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-10T11:30:50.781 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-10T11:30:50.782 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-10T11:30:50.782 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-10T11:30:50.782 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-10T11:30:50.782 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-10T11:30:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:30:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:30:50.977 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:50.978 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T11:30:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:51.132 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:30:51.174 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:30:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:30:51.256 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T11:30:51.256 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T11:30:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:30:51.292 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:30:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:30:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:52.705 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:30:52.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:30:53.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:53.294 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T11:30:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T11:30:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T11:30:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T11:30:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T11:30:53.708 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T11:30:53.796 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T11:30:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T11:30:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T11:30:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T11:30:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T11:30:54.368 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-10T11:30:54.502 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T11:30:54.536 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:30:54.549 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T11:30:54.564 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:30:54.611 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T11:30:54.629 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T11:30:54.648 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T11:30:54.670 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T11:30:54.692 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T11:30:54.713 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T11:30:54.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:30:55.061 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T11:30:55.171 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:55.296 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:30:55.330 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:55.422 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:30:55.468 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:30:55.624 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T11:30:55.682 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T11:30:55.710 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:30:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:30:55.815 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:30:55.844 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:55.915 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T11:30:55.937 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:55.962 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:30:56.139 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:56.289 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:30:56.427 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T11:30:56.523 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:56.603 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:30:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:30:56.819 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:30:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:30:56.927 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T11:30:57.023 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T11:30:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T11:30:57.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T11:30:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:30:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T11:30:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:30:57.116 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:57.116 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T11:30:57.116 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:30:57.116 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:30:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:30:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:30:57.185 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T11:30:57.244 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T11:30:57.269 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T11:30:57.284 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T11:30:57.316 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T11:30:57.328 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T11:30:57.369 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T11:30:57.405 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T11:30:57.476 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T11:30:57.536 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T11:30:57.566 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T11:30:57.602 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T11:30:57.680 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T11:30:57.712 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T11:30:57.756 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T11:30:57.793 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T11:30:57.874 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T11:30:57.921 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T11:30:57.997 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T11:30:58.142 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T11:30:58.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T11:30:58.252 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T11:30:58.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:30:58.302 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:30:58.302 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:58.302 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T11:30:58.303 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:30:58.303 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:30:58.303 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:58.346 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:30:58.369 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:30:58.369 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:58.369 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T11:30:58.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:30:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:30:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T11:30:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:30:58.446 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:30:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:30:58.748 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:30:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:30:58.844 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T11:30:58.879 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T11:30:58.923 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T11:30:58.969 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T11:30:59.010 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T11:30:59.182 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T11:30:59.247 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T11:30:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T11:30:59.402 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T11:30:59.448 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T11:30:59.492 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T11:30:59.549 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T11:30:59.583 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T11:30:59.627 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T11:30:59.669 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T11:30:59.811 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T11:30:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T11:30:59.921 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T11:31:00.028 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T11:31:00.062 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T11:31:00.102 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T11:31:00.127 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T11:31:00.152 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T11:31:00.230 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T11:31:00.366 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T11:31:00.401 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T11:31:00.429 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T11:31:00.472 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T11:31:00.511 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T11:31:00.551 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T11:31:00.581 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T11:31:00.615 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T11:31:00.648 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T11:31:00.690 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T11:31:00.725 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T11:31:00.814 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T11:31:00.864 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T11:31:00.903 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T11:31:01.011 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T11:31:01.063 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T11:31:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T11:31:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T11:31:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T11:31:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T11:31:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T11:31:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T11:31:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T11:31:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T11:31:02.711 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T11:31:02.743 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T11:31:02.823 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T11:31:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T11:31:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T11:31:03.434 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T11:31:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T11:31:03.484 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T11:31:03.496 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T11:31:03.524 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:31:03.524 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-10T11:31:03.524 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-10T11:31:03.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:03.610 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T11:31:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T11:31:03.704 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:31:03.707 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T11:31:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T11:31:03.738 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:31:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T11:31:03.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T11:31:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T11:31:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:04.903 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T11:31:04.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T11:31:05.016 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T11:31:05.049 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T11:31:05.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:31:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:31:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T11:31:05.374 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T11:31:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T11:31:05.428 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:31:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T11:31:05.520 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T11:31:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T11:31:05.550 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:31:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T11:31:05.558 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T11:31:05.574 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:31:05.574 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:05.574 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T11:31:05.574 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:31:05.575 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:31:05.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T11:31:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:05.603 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T11:31:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:05.671 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:05.754 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:05.779 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T11:31:05.785 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:05.785 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:06.049 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:31:06.085 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:31:06.086 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:06.086 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T11:31:06.086 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:31:06.086 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:31:06.086 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:06.109 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T11:31:06.113 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:06.140 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:31:06.198 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T11:31:06.211 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T11:31:06.242 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T11:31:06.281 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T11:31:06.345 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T11:31:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T11:31:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T11:31:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T11:31:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T11:31:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T11:31:06.961 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T11:31:06.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T11:31:07.020 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T11:31:07.467 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:31:07.494 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:31:07.525 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T11:31:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T11:31:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:31:08.667 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:31:08.706 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:31:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:31:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:31:09.277 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T11:31:09.319 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:31:09.394 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T11:31:09.394 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T11:31:09.394 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T11:31:09.394 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:09.429 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:31:09.784 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:31:09.810 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:31:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:31:10.088 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T11:31:10.112 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:31:10.138 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:10.188 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:31:10.200 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:31:10.302 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T11:31:10.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T11:31:11.349 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T11:31:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:31:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:31:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T11:31:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:31:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:31:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:11.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:31:11.483 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:31:11.483 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:11.483 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T11:31:11.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:31:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:31:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T11:31:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:31:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:31:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:11.709 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:11.709 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T11:31:11.709 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:31:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T11:31:11.711 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T11:31:11.712 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T11:31:11.712 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T11:31:11.712 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T11:31:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T11:31:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T11:31:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T11:31:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T11:31:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T11:31:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T11:31:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T11:31:11.731 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T11:31:11.732 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T11:31:11.733 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T11:31:11.734 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T11:31:11.734 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T11:31:11.876 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:31:11.901 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:31:11.901 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:11.902 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T11:31:11.902 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:31:11.902 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:31:11.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:14.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:14.396 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:31:14.396 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-10T11:31:14.396 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:14.396 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.397 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.398 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T11:31:14.399 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T11:31:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T11:31:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T11:31:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T11:31:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T11:31:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T11:31:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T11:31:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T11:31:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T11:31:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T11:31:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:31:14.409 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-10T11:31:14.820 DEBUG:teuthology.parallel:result is None 2024-09-10T11:31:16.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T11:31:16.797 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T11:31:16.838 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T11:31:16.870 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T11:31:16.897 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T11:31:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T11:31:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T11:31:17.191 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T11:31:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T11:31:17.275 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T11:31:17.900 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:17.939 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:17.961 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:18.880 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T11:31:18.970 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T11:31:19.020 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T11:31:19.121 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T11:31:19.156 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T11:31:19.181 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T11:31:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T11:31:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:19.275 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:19.342 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:19.368 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T11:31:19.373 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:19.373 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:19.561 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:19.561 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:19.646 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:19.722 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:21.828 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T11:31:21.828 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-09-10T11:31:21.828 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-09-10T11:31:21.828 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-09-10T11:31:21.829 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-09-10T11:31:21.829 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-09-10T11:31:21.829 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-09-10T11:31:21.829 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-09-10T11:31:21.829 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:22.013 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:31:22.029 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T11:31:22.029 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:22.029 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T11:31:22.029 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:23.566 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:31:23.592 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T11:31:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T11:31:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:31:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:31:23.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:23.834 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:31:23.856 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T11:31:23.856 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:23.857 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T11:31:23.857 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:31:23.857 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:31:23.857 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:24.318 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:31:24.340 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T11:31:24.341 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:24.341 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T11:31:24.341 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:31:24.341 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:31:24.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:24.457 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T11:31:24.515 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T11:31:24.579 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T11:31:24.779 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T11:31:24.827 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T11:31:24.907 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T11:31:24.997 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T11:31:25.140 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T11:31:25.186 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T11:31:25.217 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T11:31:25.245 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T11:31:25.261 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:25.261 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T11:31:25.261 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T11:31:25.261 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:31:25.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T11:31:25.263 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T11:31:25.264 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T11:31:25.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T11:31:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T11:31:25.267 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T11:31:25.268 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T11:31:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T11:31:25.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T11:31:25.271 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T11:31:25.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T11:31:25.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T11:31:25.274 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T11:31:25.275 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T11:31:25.717 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:31:25.743 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T11:31:25.775 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T11:31:25.840 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T11:31:25.866 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:31:26.968 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T11:31:27.001 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:31:28.014 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T11:31:28.043 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:31:28.150 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:28.170 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.171 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.172 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T11:31:28.173 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.174 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T11:31:28.175 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T11:31:28.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:28.178 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T11:31:28.179 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T11:31:28.180 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.181 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:31:28.182 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-10T11:31:28.321 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T11:31:28.345 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:31:28.368 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T11:31:28.368 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:28.368 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T11:31:28.369 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:31:28.369 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:31:28.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:28.421 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:31:28.432 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T11:31:28.534 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T11:31:28.586 DEBUG:teuthology.parallel:result is None 2024-09-10T11:31:28.586 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T11:31:29.562 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T11:31:29.589 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:31:29.612 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T11:31:29.612 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:29.613 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T11:31:29.613 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:31:29.613 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:31:29.613 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:29.657 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:31:29.679 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T11:31:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:29.679 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T11:31:29.679 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:29.724 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:31:29.746 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T11:31:29.746 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:29.747 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T11:31:29.747 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:31:29.747 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:31:29.747 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:30.066 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:31:30.089 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:34.904 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T11:31:34.948 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T11:31:34.987 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T11:31:35.018 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T11:31:35.045 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T11:31:35.248 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T11:31:35.292 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T11:31:35.322 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T11:31:35.351 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T11:31:35.398 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T11:31:36.038 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:36.070 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:36.091 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:31:36.996 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T11:31:37.084 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T11:31:37.125 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T11:31:37.209 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T11:31:37.245 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T11:31:37.270 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T11:31:37.296 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T11:31:37.296 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:37.380 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:31:37.380 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:37.473 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:31:37.497 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T11:31:37.502 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:37.502 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:31:37.691 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:37.792 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:31:37.867 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:43.538 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T11:31:43.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T11:31:43.540 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T11:31:43.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T11:31:43.554 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T11:31:43.554 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T11:31:43.554 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T11:31:43.555 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T11:31:43.556 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T11:31:43.557 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T11:31:43.558 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T11:31:43.559 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T11:31:43.560 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T11:31:43.561 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T11:31:43.562 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T11:31:43.563 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T11:31:43.564 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T11:31:43.565 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T11:31:43.565 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T11:31:43.565 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T11:31:43.565 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T11:31:46.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:31:46.610 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:46.610 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-09-10T11:31:46.610 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:46.610 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T11:31:46.611 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.612 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T11:31:46.613 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.614 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T11:31:46.615 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T11:31:46.616 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T11:31:46.617 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T11:31:46.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:46.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T11:31:46.620 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T11:31:46.621 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.622 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T11:31:46.623 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:31:46.624 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-10T11:31:47.070 DEBUG:teuthology.parallel:result is None 2024-09-10T11:31:47.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:47.219 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T11:31:47.247 INFO:teuthology.orchestra.run.smithi017.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.247 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.247 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T11:31:47.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:47.394 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T11:31:47.416 INFO:teuthology.orchestra.run.smithi026.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.416 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.417 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T11:31:47.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:47.568 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T11:31:47.595 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.595 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T11:31:47.595 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T11:31:47.597 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T11:31:47.598 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:31:47.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:31:47.631 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:31:47.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:31:47.659 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:31:47.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:31:47.690 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T11:31:47.690 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:31:47.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:31:47.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:31:47.790 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:31:47.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:31:47.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:31:47.883 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:31:47.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:31:47.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:31:47.982 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T11:31:47.982 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:31:47.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:31:48.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:31:48.080 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:31:48.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:31:48.106 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:31:48.172 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:31:48.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:31:48.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:31:48.261 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T11:31:48.262 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:31:48.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:31:48.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:31:48.354 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:31:48.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:31:48.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:31:48.446 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:31:48.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:31:48.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:31:48.535 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T11:31:48.626 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T11:31:48.626 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:48.627 INFO:tasks.cephadm:Cluster fsid is 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:31:48.627 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T11:31:48.627 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.26', 'mon.c': '172.21.15.81'} 2024-09-10T11:31:48.627 INFO:tasks.cephadm:First mon is mon.a on smithi017 2024-09-10T11:31:48.627 INFO:tasks.cephadm:First mgr is x 2024-09-10T11:31:48.628 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T11:31:48.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-09-10T11:31:48.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname $(hostname -s) 2024-09-10T11:31:48.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-10T11:31:48.734 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T11:31:48.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:48.897 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T11:31:49.043 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:31:49.045 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T11:31:49.045 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T11:31:49.045 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:49.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 11:31 /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:49.444 DEBUG:teuthology.orchestra.run.smithi026:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:49.832 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 11:31 /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:49.832 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:50.215 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 11:31 /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:50.215 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:50.236 DEBUG:teuthology.orchestra.run.smithi026:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:50.255 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T11:31:50.292 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T11:31:50.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T11:31:50.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T11:31:50.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T11:31:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T11:31:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T11:31:51.898 INFO:teuthology.orchestra.run.smithi026.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T11:32:26.791 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout: "repo_digests": [ 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2024-09-10T11:32:26.792 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-09-10T11:32:32.851 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T11:32:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T11:32:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T11:32:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-10T11:32:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T11:32:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T11:32:32.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T11:32:49.413 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:32:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T11:32:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T11:32:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-09-10T11:32:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T11:32:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:32:49.414 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:32:49.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-09-10T11:32:49.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph 2024-09-10T11:32:49.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-10T11:32:49.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-09-10T11:32:49.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /etc/ceph 2024-09-10T11:32:49.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-10T11:32:49.636 INFO:tasks.cephadm:Writing seed config... 2024-09-10T11:32:49.637 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T11:32:49.637 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T11:32:49.638 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T11:32:49.639 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T11:32:49.640 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T11:32:49.641 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T11:32:49.642 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:32:49.642 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T11:32:49.659 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 44611ec8-6f68-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T11:32:49.660 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T11:32:49.703 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T11:32:49.746 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T11:32:49.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:32:49.956 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:32:49.956 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', '44611ec8-6f68-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-09-10T11:32:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T11:32:49.957 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-09-10T11:32:49.980 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-10T11:32:49.981 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-09-10T11:32:49.981 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-09-10T11:32:49.988 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T11:32:49.988 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T11:32:49.995 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T11:32:49.995 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:32:50.002 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-10T11:32:50.008 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-10T11:32:50.009 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-10T11:32:50.009 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-09-10T11:32:50.031 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-10T11:32:50.031 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T11:32:50.031 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-09-10T11:32:50.032 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-09-10T11:32:50.038 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T11:32:50.038 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T11:32:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T11:32:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:32:50.051 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140035300783104 on /run/cephadm/44611ec8-6f68-11ef-bcea-c7b262605968.lock 2024-09-10T11:32:50.058 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140035300783104 acquired on /run/cephadm/44611ec8-6f68-11ef-bcea-c7b262605968.lock 2024-09-10T11:32:50.059 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-09-10T11:32:50.059 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-09-10T11:32:50.059 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-10T11:32:50.062 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-09-10T11:32:50.062 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-09-10T11:32:50.065 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T11:32:50.065 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T11:32:50.066 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-10T11:32:50.067 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T11:32:50.068 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T11:32:50.068 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T11:32:50.068 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T11:32:50.068 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T11:32:50.068 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T11:32:50.069 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-10T11:32:50.069 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-10T11:32:50.069 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T11:32:50.069 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T11:32:50.070 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T11:32:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T11:32:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T11:32:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T11:32:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T11:32:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T11:32:52.241 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-09-10T11:32:52.241 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-09-10T11:32:53.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBkLuBmq0Q3IhAA63QHDrWG4BWbJlkmAuoiHw== 2024-09-10T11:32:54.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBlLuBmuqaPHBAAibCfznDjQoYh1OJ0+yGIKA== 2024-09-10T11:32:54.990 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBmLuBm6l32FxAAyL3V4x50AzxYWBn9Z9TECw== 2024-09-10T11:32:54.991 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T11:32:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:32:55.889 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-09-10T11:32:56.917 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2024-09-10T11:32:57.144 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T11:32:57.287 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T11:32:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target. 2024-09-10T11:32:57.485 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target. 2024-09-10T11:32:57.720 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a 2024-09-10T11:32:57.720 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T11:32:57.890 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target.wants/ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968@.service. 2024-09-10T11:32:58.357 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T11:32:58.358 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-10T11:32:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T11:32:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:32:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-10T11:32:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T11:32:58.365 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-09-10T11:32:58.366 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-09-10T11:32:58.478 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:58 smithi017 systemd[1]: Started Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:32:59.402 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T11:32:59.408 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.546087s) 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T11:32:59.409 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.783+0000 7f5136fed640 1 Processor -- start 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.783+0000 7f5136fed640 1 -- start start 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5136fed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5136fed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51301070d0 con 0x7f5130106700 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5134d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5134d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52902/0 (socket says 172.21.15.17:52902) 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5134d89640 1 -- 172.21.15.17:0/3182241166 learned_addr learned my addr 172.21.15.17:0/3182241166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.784+0000 7f5134d89640 1 -- 172.21.15.17:0/3182241166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5130107900 con 0x7f5130106700 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.786+0000 7f5134d89640 1 --2- 172.21.15.17:0/3182241166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5124009820 tx=0x7f512402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7b6fd171e83c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.786+0000 7f512f7fe640 1 -- 172.21.15.17:0/3182241166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5124037070 con 0x7f5130106700 2024-09-10T11:32:59.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.786+0000 7f512f7fe640 1 -- 172.21.15.17:0/3182241166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124032440 con 0x7f5130106700 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.786+0000 7f512f7fe640 1 -- 172.21.15.17:0/3182241166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5124032740 con 0x7f5130106700 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 -- 172.21.15.17:0/3182241166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 msgr2=0x7f5130106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 --2- 172.21.15.17:0/3182241166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5124009820 tx=0x7f512402a270 comp rx=0 tx=0).stop 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 -- 172.21.15.17:0/3182241166 shutdown_connections 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 --2- 172.21.15.17:0/3182241166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f5130106b00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 -- 172.21.15.17:0/3182241166 >> 172.21.15.17:0/3182241166 conn(0x7f5130101e70 msgr2=0x7f51301042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 -- 172.21.15.17:0/3182241166 shutdown_connections 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.787+0000 7f5136fed640 1 -- 172.21.15.17:0/3182241166 wait complete. 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5136fed640 1 Processor -- start 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5136fed640 1 -- start start 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5136fed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5136fed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5130107e30 con 0x7f5130106700 2024-09-10T11:32:59.411 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5134d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5134d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52914/0 (socket says 172.21.15.17:52914) 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.788+0000 7f5134d89640 1 -- 172.21.15.17:0/2681113930 learned_addr learned my addr 172.21.15.17:0/2681113930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f5134d89640 1 -- 172.21.15.17:0/2681113930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513019b4d0 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f5134d89640 1 --2- 172.21.15.17:0/2681113930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f51240090b0 tx=0x7f51240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5124041070 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512403c7a0 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513019b760 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5124037040 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5124044070 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.789+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513019e450 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.790+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5124046450 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.790+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5130108480 con 0x7f5130106700 2024-09-10T11:32:59.412 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.793+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5124046650 con 0x7f5130106700 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.854+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f5130194ac0 con 0x7f5130106700 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.854+0000 7f512dffb640 1 -- 172.21.15.17:0/2681113930 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f5124046830 con 0x7f5130106700 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 msgr2=0x7f513019af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 --2- 172.21.15.17:0/2681113930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f51240090b0 tx=0x7f51240046c0 comp rx=0 tx=0).stop 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 shutdown_connections 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 --2- 172.21.15.17:0/2681113930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130106700 0x7f513019af90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 >> 172.21.15.17:0/2681113930 conn(0x7f5130101e70 msgr2=0x7f5130191c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 shutdown_connections 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:58.855+0000 7f5136fed640 1 -- 172.21.15.17:0/2681113930 wait complete. 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-09-10T11:32:59.413 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: monmap epoch 1 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: last_changed 2024-09-10T11:32:55.302750+0000 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: min_mon_release 19 (squid) 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: election_strategy: 1 2024-09-10T11:32:59.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:32:59.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: fsmap 2024-09-10T11:32:59.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T11:32:59.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: mgrmap e1: no daemons active 2024-09-10T11:32:59.510 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:32:59 smithi017 ceph-mon[30455]: from='client.? 172.21.15.17:0/2681113930' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T11:33:00.581 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:00 smithi017 ceph-mon[30455]: from='client.? 172.21.15.17:0/2505437979' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T11:33:00.581 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:00 smithi017 ceph-mon[30455]: from='client.? 172.21.15.17:0/2505437979' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:00.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.944+0000 7f3f1b02c640 1 Processor -- start 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.944+0000 7f3f1b02c640 1 -- start start 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.944+0000 7f3f1b02c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.944+0000 7f3f1b02c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141081f0 con 0x7f3f14107820 2024-09-10T11:33:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.945+0000 7f3f18dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.945+0000 7f3f18dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52930/0 (socket says 172.21.15.17:52930) 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.945+0000 7f3f18dc8640 1 -- 172.21.15.17:0/1965386443 learned_addr learned my addr 172.21.15.17:0/1965386443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.945+0000 7f3f18dc8640 1 -- 172.21.15.17:0/1965386443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f14108a20 con 0x7f3f14107820 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f18dc8640 1 --2- 172.21.15.17:0/1965386443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009820 tx=0x7f3f0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca54692fae7645e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f137fe640 1 -- 172.21.15.17:0/1965386443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f04037070 con 0x7f3f14107820 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f137fe640 1 -- 172.21.15.17:0/1965386443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04032440 con 0x7f3f14107820 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f137fe640 1 -- 172.21.15.17:0/1965386443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f04032740 con 0x7f3f14107820 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 -- 172.21.15.17:0/1965386443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 msgr2=0x7f3f14107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 --2- 172.21.15.17:0/1965386443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009820 tx=0x7f3f0402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 -- 172.21.15.17:0/1965386443 shutdown_connections 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 --2- 172.21.15.17:0/1965386443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f14107c20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:00.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 -- 172.21.15.17:0/1965386443 >> 172.21.15.17:0/1965386443 conn(0x7f3f14102fd0 msgr2=0x7f3f141053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 -- 172.21.15.17:0/1965386443 shutdown_connections 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.946+0000 7f3f1b02c640 1 -- 172.21.15.17:0/1965386443 wait complete. 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f1b02c640 1 Processor -- start 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f1b02c640 1 -- start start 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f1b02c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f1b02c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14108f50 con 0x7f3f14107820 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f18dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f18dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52938/0 (socket says 172.21.15.17:52938) 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.947+0000 7f3f18dc8640 1 -- 172.21.15.17:0/2505437979 learned_addr learned my addr 172.21.15.17:0/2505437979 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f18dc8640 1 -- 172.21.15.17:0/2505437979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1419b490 con 0x7f3f14107820 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f18dc8640 1 --2- 172.21.15.17:0/2505437979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f040090b0 tx=0x7f3f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f04041070 con 0x7f3f14107820 2024-09-10T11:33:00.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0403c7a0 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1419b720 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f04037040 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.948+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1419e410 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.949+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f04044070 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.949+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f0403d3f0 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.949+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f141095a0 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:32:59.952+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3f04046450 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.011+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3f1419fae0 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.014+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+454 (secure 0 0 0) 0x7f3f04046630 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.015+0000 7f3f11ffb640 1 -- 172.21.15.17:0/2505437979 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f04056070 con 0x7f3f14107820 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 msgr2=0x7f3f1419af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:00.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 --2- 172.21.15.17:0/2505437979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f040090b0 tx=0x7f3f040046c0 comp rx=0 tx=0).stop 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 shutdown_connections 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 --2- 172.21.15.17:0/2505437979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f14107820 0x7f3f1419af50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 >> 172.21.15.17:0/2505437979 conn(0x7f3f14102fd0 msgr2=0x7f3f1418f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 shutdown_connections 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:00.016+0000 7f3f1b02c640 1 -- 172.21.15.17:0/2505437979 wait complete. 2024-09-10T11:33:00.594 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-09-10T11:33:01.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:01 smithi017 ceph-mon[30455]: from='client.? 172.21.15.17:0/2773506780' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902c2df640 1 Processor -- start 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902c2df640 1 -- start start 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902c2df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902c2df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90241081f0 con 0x7f9024107820 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902a07b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902a07b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52954/0 (socket says 172.21.15.17:52954) 2024-09-10T11:33:01.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.074+0000 7f902a07b640 1 -- 172.21.15.17:0/3796164678 learned_addr learned my addr 172.21.15.17:0/3796164678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.075+0000 7f902a07b640 1 -- 172.21.15.17:0/3796164678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9024108a20 con 0x7f9024107820 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.075+0000 7f902a07b640 1 --2- 172.21.15.17:0/3796164678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9020009820 tx=0x7f902002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e77f1196f0c813f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.075+0000 7f9029079640 1 -- 172.21.15.17:0/3796164678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020037070 con 0x7f9024107820 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.075+0000 7f9029079640 1 -- 172.21.15.17:0/3796164678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9020032900 con 0x7f9024107820 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.075+0000 7f9029079640 1 -- 172.21.15.17:0/3796164678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020030850 con 0x7f9024107820 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 -- 172.21.15.17:0/3796164678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 msgr2=0x7f9024107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 --2- 172.21.15.17:0/3796164678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9020009820 tx=0x7f902002a270 comp rx=0 tx=0).stop 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 -- 172.21.15.17:0/3796164678 shutdown_connections 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 --2- 172.21.15.17:0/3796164678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f9024107c20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 -- 172.21.15.17:0/3796164678 >> 172.21.15.17:0/3796164678 conn(0x7f9024102fd0 msgr2=0x7f90241053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 -- 172.21.15.17:0/3796164678 shutdown_connections 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.076+0000 7f902c2df640 1 -- 172.21.15.17:0/3796164678 wait complete. 2024-09-10T11:33:01.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902c2df640 1 Processor -- start 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902c2df640 1 -- start start 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902c2df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902c2df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f902410bdd0 con 0x7f9024107820 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902a07b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902a07b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52956/0 (socket says 172.21.15.17:52956) 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902a07b640 1 -- 172.21.15.17:0/2773506780 learned_addr learned my addr 172.21.15.17:0/2773506780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.077+0000 7f902a07b640 1 -- 172.21.15.17:0/2773506780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902419bd90 con 0x7f9024107820 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f902a07b640 1 --2- 172.21.15.17:0/2773506780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9020009940 tx=0x7f9020032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020042070 con 0x7f9024107820 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90200308c0 con 0x7f9024107820 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902419c020 con 0x7f9024107820 2024-09-10T11:33:01.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020037040 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902419ed10 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9020045070 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.078+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9020047b70 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.079+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9024107ca0 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.081+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f90200327b0 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.141+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f902419eee0 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f901b7fe640 1 -- 172.21.15.17:0/2773506780 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f902003c760 con 0x7f9024107820 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 msgr2=0x7f902419b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 --2- 172.21.15.17:0/2773506780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9020009940 tx=0x7f9020032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 shutdown_connections 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 --2- 172.21.15.17:0/2773506780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9024107820 0x7f902419b850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 >> 172.21.15.17:0/2773506780 conn(0x7f9024102fd0 msgr2=0x7f9024103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:01.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 shutdown_connections 2024-09-10T11:33:01.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:01.142+0000 7f902c2df640 1 -- 172.21.15.17:0/2773506780 wait complete. 2024-09-10T11:33:01.697 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-09-10T11:33:01.990 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:01 smithi017 systemd[1]: Stopping Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:33:02.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:01 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a[30451]: 2024-09-10T11:33:01.988+0000 7f0f7b874640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:33:02.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:01 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a[30451]: 2024-09-10T11:33:01.988+0000 7f0f7b874640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T11:33:02.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 podman[30696]: 2024-09-10 11:33:02.183206165 +0000 UTC m=+0.316118336 container died bd9915ef22c99895766e31716b15370a167388ee7c0492230df00a9164268d26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T11:33:02.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 podman[30696]: 2024-09-10 11:33:02.554956225 +0000 UTC m=+0.687868396 container cleanup bd9915ef22c99895766e31716b15370a167388ee7c0492230df00a9164268d26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T11:33:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 bash[30696]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a 2024-09-10T11:33:03.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 podman[30708]: 2024-09-10 11:33:02.822720557 +0000 UTC m=+0.641615799 container remove bd9915ef22c99895766e31716b15370a167388ee7c0492230df00a9164268d26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T11:33:03.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T11:33:03.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 systemd[1]: Stopped Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:33:03.166 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:02 smithi017 systemd[1]: Starting Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:33:03.417 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 podman[30799]: 2024-09-10 11:33:03.165009843 +0000 UTC m=+0.090953831 container create 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 podman[30799]: 2024-09-10 11:33:03.090411892 +0000 UTC m=+0.016355838 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 podman[30799]: 2024-09-10 11:33:03.358650179 +0000 UTC m=+0.284594125 container init 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 podman[30799]: 2024-09-10 11:33:03.361759916 +0000 UTC m=+0.287703863 container start 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: pidfile_write: ignore empty --pid-file 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: load: jerasure load: lrc 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: RocksDB version: 7.9.2 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Git sha 0 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T11:33:03.418 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: DB SUMMARY 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: DB Session ID: TEY6D7UDU17SHBAKC0O7 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: CURRENT file: CURRENT 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T11:33:03.419 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106050 ; 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.error_if_exists: 0 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.create_if_missing: 0 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.paranoid_checks: 1 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.env: 0x5612f0b38940 2024-09-10T11:33:03.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.info_log: 0x5612f2c6f6e0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.statistics: (nil) 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.use_fsync: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_log_file_size: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_fallocate: 1 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.use_direct_reads: 0 2024-09-10T11:33:03.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.db_log_dir: 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.wal_dir: 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.write_buffer_manager: 0x5612f2c7edc0 2024-09-10T11:33:03.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.unordered_write: 0 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.row_cache: None 2024-09-10T11:33:03.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.wal_filter: None 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.two_write_queues: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.wal_compression: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.atomic_flush: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.log_readahead_size: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T11:33:03.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_background_jobs: 2 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_background_compactions: -1 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_subcompactions: 1 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T11:33:03.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_open_files: -1 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_background_flushes: -1 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Compression algorithms supported: 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kZSTD supported: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kXpressCompression supported: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kBZip2Compression supported: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T11:33:03.426 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kLZ4Compression supported: 1 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kZlibCompression supported: 1 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: kSnappyCompression supported: 1 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.merge_operator: 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_filter: None 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T11:33:03.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5612f2c6f320) 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x5612f2c631f0 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-10T11:33:03.428 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2024-09-10T11:33:03.429 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T11:33:03.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression: NoCompression 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.num_levels: 7 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T11:33:03.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T11:33:03.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T11:33:03.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T11:33:03.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T11:33:03.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T11:33:03.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T11:33:03.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.inplace_update_support: 0 2024-09-10T11:33:03.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T11:33:03.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.bloom_locality: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.max_successive_merges: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.ttl: 2592000 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T11:33:03.436 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enable_blob_files: false 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.min_blob_size: 0 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T11:33:03.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1627b3e6-9d25-457a-8d2c-c18fc810c9da 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725967983388490, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725967983389513, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100986, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 98880, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14514, "raw_average_key_size": 49, "raw_value_size": 91071, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725967983, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1627b3e6-9d25-457a-8d2c-c18fc810c9da", "db_session_id": "TEY6D7UDU17SHBAKC0O7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725967983389611, "job": 1, "event": "recovery_finished"} 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5612f2c90e00 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: DB pointer 0x5612f2d8c000 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T11:33:03.438 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 100.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 100.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.439 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T11:33:03.440 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 29.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 29.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x5612f2c631f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???) e1 preinit fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).mds e1 new map 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).mds e1 print_map 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: btime 2024-09-10T11:32:58:309970+0000 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T11:33:03.441 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 bash[30799]: 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a 2024-09-10T11:33:03.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 systemd[1]: Started Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:33:03.442 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T11:33:03.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: monmap epoch 1 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: last_changed 2024-09-10T11:32:55.302750+0000 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: min_mon_release 19 (squid) 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: election_strategy: 1 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: fsmap 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T11:33:03.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:03 smithi017 ceph-mon[30817]: mgrmap e1: no daemons active 2024-09-10T11:33:07.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:07 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3330038925' entity='client.admin' 2024-09-10T11:33:12.536 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.377+0000 7f5938be7640 1 Processor -- start 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.377+0000 7f5938be7640 1 -- start start 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f5938be7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f5938be7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f59341081f0 con 0x7f5934107820 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f593259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f593259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48120/0 (socket says 172.21.15.17:48120) 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f593259c640 1 -- 172.21.15.17:0/805801639 learned_addr learned my addr 172.21.15.17:0/805801639 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.378+0000 7f593259c640 1 -- 172.21.15.17:0/805801639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934108a20 con 0x7f5934107820 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.380+0000 7f593259c640 1 --2- 172.21.15.17:0/805801639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5924009e80 tx=0x7f592402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80f671f763ba72f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.380+0000 7f593159a640 1 -- 172.21.15.17:0/805801639 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5924036070 con 0x7f5934107820 2024-09-10T11:33:12.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.380+0000 7f593159a640 1 -- 172.21.15.17:0/805801639 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59240318c0 con 0x7f5934107820 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f593159a640 1 -- 172.21.15.17:0/805801639 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5924007ab0 con 0x7f5934107820 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 -- 172.21.15.17:0/805801639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 msgr2=0x7f5934107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 --2- 172.21.15.17:0/805801639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5924009e80 tx=0x7f592402a7a0 comp rx=0 tx=0).stop 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 -- 172.21.15.17:0/805801639 shutdown_connections 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 --2- 172.21.15.17:0/805801639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f5934107c20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 -- 172.21.15.17:0/805801639 >> 172.21.15.17:0/805801639 conn(0x7f5934102fd0 msgr2=0x7f59341053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 -- 172.21.15.17:0/805801639 shutdown_connections 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.381+0000 7f5938be7640 1 -- 172.21.15.17:0/805801639 wait complete. 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.382+0000 7f5938be7640 1 Processor -- start 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.382+0000 7f5938be7640 1 -- start start 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.382+0000 7f5938be7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.382+0000 7f5938be7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f593410bdd0 con 0x7f5934107820 2024-09-10T11:33:12.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f593259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f593259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48136/0 (socket says 172.21.15.17:48136) 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f593259c640 1 -- 172.21.15.17:0/3330038925 learned_addr learned my addr 172.21.15.17:0/3330038925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f593259c640 1 -- 172.21.15.17:0/3330038925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593419dfb0 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f593259c640 1 --2- 172.21.15.17:0/3330038925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f592402acc0 tx=0x7f5924031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5924036050 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5924037040 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593419e240 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f592403d8c0 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.383+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59341a0f30 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.384+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5924044020 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.384+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5924042020 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.385+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934107ca0 con 0x7f5934107820 2024-09-10T11:33:12.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.387+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f592404b020 con 0x7f5934107820 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.447+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f59341a14c0 con 0x7f5934107820 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.449+0000 7f592b7fe640 1 -- 172.21.15.17:0/3330038925 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f59240073b0 con 0x7f5934107820 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 msgr2=0x7f593419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 --2- 172.21.15.17:0/3330038925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f592402acc0 tx=0x7f5924031ca0 comp rx=0 tx=0).stop 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 shutdown_connections 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 --2- 172.21.15.17:0/3330038925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5934107820 0x7f593419da70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 >> 172.21.15.17:0/3330038925 conn(0x7f5934102fd0 msgr2=0x7f5934103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 shutdown_connections 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:06.450+0000 7f5938be7640 1 -- 172.21.15.17:0/3330038925 wait complete. 2024-09-10T11:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T11:33:12.773 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:33:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-09-10T11:33:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T11:33:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T11:33:13.726 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x 2024-09-10T11:33:13.727 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T11:33:14.018 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968.target.wants/ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-44611ec8-6f68-11ef-bcea-c7b262605968@.service. 2024-09-10T11:33:14.570 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T11:33:14.571 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-10T11:33:14.577 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T11:33:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:33:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-10T11:33:14.578 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T11:33:14.586 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T11:33:14.587 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-09-10T11:33:14.595 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-09-10T11:33:15.100 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:15.057+0000 7f4357c86040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:15.394 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3496781918' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T11:33:15.394 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:15.208+0000 7f4357c86040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:33:15.652 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:15.541+0000 7f4357c86040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:33:15.652 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:15.604+0000 7f4357c86040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T11:33:15.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T11:33:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T11:33:15.668 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T11:32:58:309970+0000", 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T11:33:15.669 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T11:32:58.310596+0000", 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee8a4c640 1 Processor -- start 2024-09-10T11:33:15.670 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee8a4c640 1 -- start start 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee8a4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee8a4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee41070d0 con 0x7f8ee4106700 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39924/0 (socket says 172.21.15.17:39924) 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.029+0000 7f8ee259c640 1 -- 172.21.15.17:0/571946411 learned_addr learned my addr 172.21.15.17:0/571946411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.030+0000 7f8ee259c640 1 -- 172.21.15.17:0/571946411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee4107900 con 0x7f8ee4106700 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.030+0000 7f8ee259c640 1 --2- 172.21.15.17:0/571946411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009820 tx=0x7f8ed402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a760382a9e90b4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee1d9b640 1 -- 172.21.15.17:0/571946411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed4037070 con 0x7f8ee4106700 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee1d9b640 1 -- 172.21.15.17:0/571946411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ed4032900 con 0x7f8ee4106700 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee1d9b640 1 -- 172.21.15.17:0/571946411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed4030850 con 0x7f8ee4106700 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/571946411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 msgr2=0x7f8ee4106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee8a4c640 1 --2- 172.21.15.17:0/571946411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009820 tx=0x7f8ed402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:15.671 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/571946411 shutdown_connections 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee8a4c640 1 --2- 172.21.15.17:0/571946411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee4106b00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.031+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/571946411 >> 172.21.15.17:0/571946411 conn(0x7f8ee4101e70 msgr2=0x7f8ee41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.032+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/571946411 shutdown_connections 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.032+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/571946411 wait complete. 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.032+0000 7f8ee8a4c640 1 Processor -- start 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.032+0000 7f8ee8a4c640 1 -- start start 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee8a4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee8a4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee410acb0 con 0x7f8ee4106700 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39928/0 (socket says 172.21.15.17:39928) 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee259c640 1 -- 172.21.15.17:0/3496781918 learned_addr learned my addr 172.21.15.17:0/3496781918 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:15.672 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee259c640 1 -- 172.21.15.17:0/3496781918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee419bd30 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee259c640 1 --2- 172.21.15.17:0/3496781918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009940 tx=0x7f8ed4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed4042070 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ed40308c0 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee419bfc0 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.033+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed4037040 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.034+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee419ecb0 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.034+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ed4045070 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.034+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ed4047bc0 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.035+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee4106b80 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.037+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8ed40327b0 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.099+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8ee402d940 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.099+0000 7f8edb7fe640 1 -- 172.21.15.17:0/3496781918 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f8ed403c870 con 0x7f8ee4106700 2024-09-10T11:33:15.673 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.100+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 msgr2=0x7f8ee419b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.100+0000 7f8ee8a4c640 1 --2- 172.21.15.17:0/3496781918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009940 tx=0x7f8ed4032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.101+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 shutdown_connections 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.101+0000 7f8ee8a4c640 1 --2- 172.21.15.17:0/3496781918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee4106700 0x7f8ee419b7f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.101+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 >> 172.21.15.17:0/3496781918 conn(0x7f8ee4101e70 msgr2=0x7f8ee4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.101+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 shutdown_connections 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:15.101+0000 7f8ee8a4c640 1 -- 172.21.15.17:0/3496781918 wait complete. 2024-09-10T11:33:15.674 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-09-10T11:33:16.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:15.802+0000 7f4357c86040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:33:17.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:16.723+0000 7f4357c86040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:33:17.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:16.793+0000 7f4357c86040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:33:17.827 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:17.544+0000 7f4357c86040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:33:17.828 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:17.664+0000 7f4357c86040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:33:17.828 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:17.826+0000 7f4357c86040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:18.101 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:17.889+0000 7f4357c86040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:33:18.101 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.047+0000 7f4357c86040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:33:18.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/568496596' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T11:33:18.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.122+0000 7f4357c86040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:33:18.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.193+0000 7f4357c86040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:33:18.364 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.362+0000 7f4357c86040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:33:18.659 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.434+0000 7f4357c86040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:33:18.659 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.504+0000 7f4357c86040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:33:18.659 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.594+0000 7f4357c86040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:33:18.659 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.658+0000 7f4357c86040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:33:18.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:18.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:18.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:33:18.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T11:33:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T11:33:18.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T11:33:18.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T11:33:18.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T11:33:18.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T11:33:18.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T11:32:58:309970+0000", 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T11:33:18.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T11:32:58.310596+0000", 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.100+0000 7f7311cfa640 1 Processor -- start 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.100+0000 7f7311cfa640 1 -- start start 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.100+0000 7f7311cfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.100+0000 7f7311cfa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f730c109800 con 0x7f730c108e30 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.101+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.101+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39930/0 (socket says 172.21.15.17:39930) 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.101+0000 7f730b7fe640 1 -- 172.21.15.17:0/3238275456 learned_addr learned my addr 172.21.15.17:0/3238275456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.101+0000 7f730b7fe640 1 -- 172.21.15.17:0/3238275456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c109980 con 0x7f730c108e30 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.102+0000 7f730b7fe640 1 --2- 172.21.15.17:0/3238275456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009820 tx=0x7f72fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d4e3a99e0c3574 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.102+0000 7f730affd640 1 -- 172.21.15.17:0/3238275456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc037070 con 0x7f730c108e30 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.102+0000 7f730affd640 1 -- 172.21.15.17:0/3238275456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72fc032900 con 0x7f730c108e30 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.102+0000 7f730affd640 1 -- 172.21.15.17:0/3238275456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc030850 con 0x7f730c108e30 2024-09-10T11:33:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 -- 172.21.15.17:0/3238275456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 msgr2=0x7f730c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:18.795 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 --2- 172.21.15.17:0/3238275456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009820 tx=0x7f72fc02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:18.795 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 -- 172.21.15.17:0/3238275456 shutdown_connections 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 --2- 172.21.15.17:0/3238275456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c109230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 -- 172.21.15.17:0/3238275456 >> 172.21.15.17:0/3238275456 conn(0x7f730c1015e0 msgr2=0x7f730c103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 -- 172.21.15.17:0/3238275456 shutdown_connections 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.103+0000 7f7311cfa640 1 -- 172.21.15.17:0/3238275456 wait complete. 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f7311cfa640 1 Processor -- start 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f7311cfa640 1 -- start start 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f7311cfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f7311cfa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f730c106710 con 0x7f730c108e30 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39940/0 (socket says 172.21.15.17:39940) 2024-09-10T11:33:18.796 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.104+0000 7f730b7fe640 1 -- 172.21.15.17:0/568496596 learned_addr learned my addr 172.21.15.17:0/568496596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f730b7fe640 1 -- 172.21.15.17:0/568496596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c19bd10 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f730b7fe640 1 --2- 172.21.15.17:0/568496596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009940 tx=0x7f72fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc042070 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72fc0308c0 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c19bfa0 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.105+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c19ec90 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.106+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc037040 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.106+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72fc045070 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.106+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72fc047be0 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.106+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec0052c0 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.109+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f72fc047440 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.171+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f72ec005880 con 0x7f730c108e30 2024-09-10T11:33:18.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.171+0000 7f73097fa640 1 -- 172.21.15.17:0/568496596 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f72fc0327b0 con 0x7f730c108e30 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 msgr2=0x7f730c19b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 --2- 172.21.15.17:0/568496596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009940 tx=0x7f72fc032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 shutdown_connections 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 --2- 172.21.15.17:0/568496596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f730c108e30 0x7f730c19b7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 >> 172.21.15.17:0/568496596 conn(0x7f730c1015e0 msgr2=0x7f730c102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 shutdown_connections 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:18.173+0000 7f7311cfa640 1 -- 172.21.15.17:0/568496596 wait complete. 2024-09-10T11:33:18.798 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-09-10T11:33:19.022 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:18.721+0000 7f4357c86040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:33:19.771 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:19.563+0000 7f4357c86040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: Activating manager daemon x 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: mgrmap e2: x(active, starting, since 0.00326932s) 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:33:19.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: Manager daemon x is now available 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' 2024-09-10T11:33:19.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:19 smithi017 ceph-mon[30817]: from='mgr.14100 172.21.15.17:0/1590976851' entity='mgr.x' 2024-09-10T11:33:21.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:21 smithi017 ceph-mon[30817]: mgrmap e3: x(active, since 1.00635s) 2024-09-10T11:33:21.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:21 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3882889423' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T11:33:22.023 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:22.023 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T11:33:22.024 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T11:33:22.025 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T11:33:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T11:32:58:309970+0000", 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T11:33:22.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T11:32:58.310596+0000", 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T11:33:22.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.173+0000 7f0fdf4b8640 1 Processor -- start 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.173+0000 7f0fdf4b8640 1 -- start start 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdf4b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdf4b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd81070d0 con 0x7f0fd8106700 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdd254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdd254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40032/0 (socket says 172.21.15.17:40032) 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdd254640 1 -- 172.21.15.17:0/1205336844 learned_addr learned my addr 172.21.15.17:0/1205336844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.174+0000 7f0fdd254640 1 -- 172.21.15.17:0/1205336844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd8107900 con 0x7f0fd8106700 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.175+0000 7f0fdd254640 1 --2- 172.21.15.17:0/1205336844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009820 tx=0x7f0fd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc69535afc38bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.175+0000 7f0fcffff640 1 -- 172.21.15.17:0/1205336844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd4037070 con 0x7f0fd8106700 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.175+0000 7f0fcffff640 1 -- 172.21.15.17:0/1205336844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd4032900 con 0x7f0fd8106700 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.175+0000 7f0fcffff640 1 -- 172.21.15.17:0/1205336844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd4030850 con 0x7f0fd8106700 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/1205336844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 msgr2=0x7f0fd8106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/1205336844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009820 tx=0x7f0fd402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/1205336844 shutdown_connections 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/1205336844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd8106b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/1205336844 >> 172.21.15.17:0/1205336844 conn(0x7f0fd8101e70 msgr2=0x7f0fd81042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/1205336844 shutdown_connections 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.176+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/1205336844 wait complete. 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdf4b8640 1 Processor -- start 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdf4b8640 1 -- start start 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdf4b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdf4b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd810acb0 con 0x7f0fd8106700 2024-09-10T11:33:22.038 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdd254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdd254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40048/0 (socket says 172.21.15.17:40048) 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdd254640 1 -- 172.21.15.17:0/3882889423 learned_addr learned my addr 172.21.15.17:0/3882889423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.177+0000 7f0fdd254640 1 -- 172.21.15.17:0/3882889423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd819e540 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fdd254640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009940 tx=0x7f0fd4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd4042070 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd40308c0 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd819e710 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd4037040 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.178+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd819eb30 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.179+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f0fd4045070 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.179+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd8106b80 con 0x7f0fd8106700 2024-09-10T11:33:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.179+0000 7f0fce7fc640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 0x7f0fc403b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.179+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0fd406bf20 con 0x7f0fd8106700 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.179+0000 7f0fdca53640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 0x7f0fc403b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.180+0000 7f0fdca53640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 0x7f0fc403b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098c0 tx=0x7f0fc8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.184+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fd403cd90 con 0x7f0fd8106700 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.432+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0fd819a870 con 0x7f0fd8106700 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.433+0000 7f0fce7fc640 1 -- 172.21.15.17:0/3882889423 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f0fd403c870 con 0x7f0fd8106700 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.435+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 msgr2=0x7f0fc403b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 0x7f0fc403b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098c0 tx=0x7f0fc8006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 msgr2=0x7f0fd807ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009940 tx=0x7f0fd4032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 shutdown_connections 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7f0fc4038e10 0x7f0fc403b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 --2- 172.21.15.17:0/3882889423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd8106700 0x7f0fd807ba10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 >> 172.21.15.17:0/3882889423 conn(0x7f0fd8101e70 msgr2=0x7f0fd8102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 shutdown_connections 2024-09-10T11:33:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:21.436+0000 7f0fdf4b8640 1 -- 172.21.15.17:0/3882889423 wait complete. 2024-09-10T11:33:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-09-10T11:33:22.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:22 smithi017 ceph-mon[30817]: mgrmap e4: x(active, since 2s) 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:23.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.400+0000 7fc33f0f3640 1 Processor -- start 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.400+0000 7fc33f0f3640 1 -- start start 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.400+0000 7fc33f0f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.400+0000 7fc33f0f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381081f0 con 0x7fc338107820 2024-09-10T11:33:23.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.401+0000 7fc33ce8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.401+0000 7fc33ce8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38566/0 (socket says 172.21.15.17:38566) 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.401+0000 7fc33ce8f640 1 -- 172.21.15.17:0/1587362740 learned_addr learned my addr 172.21.15.17:0/1587362740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.401+0000 7fc33ce8f640 1 -- 172.21.15.17:0/1587362740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc338108a20 con 0x7fc338107820 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33ce8f640 1 --2- 172.21.15.17:0/1587362740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009820 tx=0x7fc32c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6da7d74a95deb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc3377fe640 1 -- 172.21.15.17:0/1587362740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc32c037070 con 0x7fc338107820 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc3377fe640 1 -- 172.21.15.17:0/1587362740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc32c032900 con 0x7fc338107820 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc3377fe640 1 -- 172.21.15.17:0/1587362740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc32c030850 con 0x7fc338107820 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33f0f3640 1 -- 172.21.15.17:0/1587362740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 msgr2=0x7fc338107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/1587362740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009820 tx=0x7fc32c02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33f0f3640 1 -- 172.21.15.17:0/1587362740 shutdown_connections 2024-09-10T11:33:23.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/1587362740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc338107c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.402+0000 7fc33f0f3640 1 -- 172.21.15.17:0/1587362740 >> 172.21.15.17:0/1587362740 conn(0x7fc338102fd0 msgr2=0x7fc3381053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 -- 172.21.15.17:0/1587362740 shutdown_connections 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 -- 172.21.15.17:0/1587362740 wait complete. 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 Processor -- start 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 -- start start 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33f0f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc33810bdd0 con 0x7fc338107820 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33ce8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33ce8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38582/0 (socket says 172.21.15.17:38582) 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.403+0000 7fc33ce8f640 1 -- 172.21.15.17:0/90274923 learned_addr learned my addr 172.21.15.17:0/90274923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc33ce8f640 1 -- 172.21.15.17:0/90274923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33819bd90 con 0x7fc338107820 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc33ce8f640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097f0 tx=0x7fc32c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:23.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc32c037040 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc32c040070 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33819c020 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc32c03a390 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.404+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33819ed10 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.405+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fc32c03a5e0 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.405+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc338107ca0 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.405+0000 7fc335ffb640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 0x7fc32803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.405+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc32c06c080 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.405+0000 7fc337fff640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 0x7fc32803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.406+0000 7fc337fff640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 0x7fc32803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc3240098c0 tx=0x7fc324006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.410+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc32c042310 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.584+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc33819eee0 con 0x7fc338107820 2024-09-10T11:33:23.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.584+0000 7fc335ffb640 1 -- 172.21.15.17:0/90274923 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+454 (secure 0 0 0) 0x7fc32c0371e0 con 0x7fc338107820 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.586+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 msgr2=0x7fc32803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.586+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 0x7fc32803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc3240098c0 tx=0x7fc324006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 msgr2=0x7fc33819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097f0 tx=0x7fc32c030d80 comp rx=0 tx=0).stop 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 shutdown_connections 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fc328038f70 0x7fc32803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 --2- 172.21.15.17:0/90274923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc338107820 0x7fc33819b850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 >> 172.21.15.17:0/90274923 conn(0x7fc338102fd0 msgr2=0x7fc338103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 shutdown_connections 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:22.587+0000 7fc33f0f3640 1 -- 172.21.15.17:0/90274923 wait complete. 2024-09-10T11:33:23.131 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-09-10T11:33:23.723 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:23 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/90274923' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T11:33:24.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2159985268' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T11:33:24.930 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ignoring --setuser ceph since I am not root 2024-09-10T11:33:24.931 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ignoring --setgroup ceph since I am not root 2024-09-10T11:33:24.931 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:24.722+0000 7f6c3317c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:33:24.931 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:24.781+0000 7f6c3317c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:33:25.190 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:24.936+0000 7f6c3317c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:33:25.190 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.006+0000 7f6c3317c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:33:25.190 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.159+0000 7f6c3317c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:25.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.490+0000 7fccb0810640 1 Processor -- start 2024-09-10T11:33:25.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.490+0000 7fccb0810640 1 -- start start 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccb0810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccb0810640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1070d0 con 0x7fccac106700 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccaa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccaa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38590/0 (socket says 172.21.15.17:38590) 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccaa59c640 1 -- 172.21.15.17:0/2733262699 learned_addr learned my addr 172.21.15.17:0/2733262699 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.491+0000 7fccaa59c640 1 -- 172.21.15.17:0/2733262699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac107900 con 0x7fccac106700 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.492+0000 7fccaa59c640 1 --2- 172.21.15.17:0/2733262699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009820 tx=0x7fcc9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2c3fd9f579cf2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.492+0000 7fcca959a640 1 -- 172.21.15.17:0/2733262699 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c037070 con 0x7fccac106700 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.492+0000 7fcca959a640 1 -- 172.21.15.17:0/2733262699 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc9c032900 con 0x7fccac106700 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.492+0000 7fcca959a640 1 -- 172.21.15.17:0/2733262699 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c030850 con 0x7fccac106700 2024-09-10T11:33:25.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 -- 172.21.15.17:0/2733262699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 msgr2=0x7fccac106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 --2- 172.21.15.17:0/2733262699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009820 tx=0x7fcc9c02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 -- 172.21.15.17:0/2733262699 shutdown_connections 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 --2- 172.21.15.17:0/2733262699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac106b00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 -- 172.21.15.17:0/2733262699 >> 172.21.15.17:0/2733262699 conn(0x7fccac101e70 msgr2=0x7fccac1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 -- 172.21.15.17:0/2733262699 shutdown_connections 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.493+0000 7fccb0810640 1 -- 172.21.15.17:0/2733262699 wait complete. 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccb0810640 1 Processor -- start 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccb0810640 1 -- start start 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccb0810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccb0810640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccac10acb0 con 0x7fccac106700 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccaa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccaa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38606/0 (socket says 172.21.15.17:38606) 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccaa59c640 1 -- 172.21.15.17:0/2159985268 learned_addr learned my addr 172.21.15.17:0/2159985268 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccaa59c640 1 -- 172.21.15.17:0/2159985268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac19bd90 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.494+0000 7fccaa59c640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0097f0 tx=0x7fcc9c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.495+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c037040 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.495+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc9c040070 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.495+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac19c020 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.495+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9c03a390 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.495+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac19ed10 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fcc9c03a5e0 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fcc9b7fe640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 0x7fcc9403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac106b80 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc9c06c1b0 con 0x7fccac106700 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fcca9d9b640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 0x7fcc9403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:25.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.496+0000 7fcca9d9b640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 0x7fcc9403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098c0 tx=0x7fcca0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.501+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc9c069550 con 0x7fccac106700 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:23.722+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fccac195760 con 0x7fccac106700 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.574+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fcc9c043760 con 0x7fccac106700 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.576+0000 7fcc9b7fe640 1 -- 172.21.15.17:0/2159985268 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fcc9c03a8d0 con 0x7fccac106700 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 msgr2=0x7fcc9403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 0x7fcc9403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098c0 tx=0x7fcca0006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 msgr2=0x7fccac19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0097f0 tx=0x7fcc9c030d80 comp rx=0 tx=0).stop 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 shutdown_connections 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fcc94038f70 0x7fcc9403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 --2- 172.21.15.17:0/2159985268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccac106700 0x7fccac19b850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.577+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 >> 172.21.15.17:0/2159985268 conn(0x7fccac101e70 msgr2=0x7fccac102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:25.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.578+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 shutdown_connections 2024-09-10T11:33:25.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:24.578+0000 7fccb0810640 1 -- 172.21.15.17:0/2159985268 wait complete. 2024-09-10T11:33:25.444 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.310+0000 7f6c3317c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:33:25.709 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.644+0000 7f6c3317c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:33:25.709 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2159985268' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T11:33:25.709 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-mon[30817]: mgrmap e5: x(active, since 5s) 2024-09-10T11:33:26.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.708+0000 7f6c3317c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:33:26.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:25.906+0000 7f6c3317c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:33:26.714 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:26 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/330749357' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T11:33:26.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:26.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.604+0000 7fbb2135b640 1 Processor -- start 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.604+0000 7fbb2135b640 1 -- start start 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.604+0000 7fbb2135b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.604+0000 7fbb2135b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c07bdb0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.605+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.605+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38632/0 (socket says 172.21.15.17:38632) 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.605+0000 7fbb1affd640 1 -- 172.21.15.17:0/2044153366 learned_addr learned my addr 172.21.15.17:0/2044153366 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:26.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.605+0000 7fbb1affd640 1 -- 172.21.15.17:0/2044153366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c10ac20 con 0x7fbb1c1082f0 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb1affd640 1 --2- 172.21.15.17:0/2044153366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009820 tx=0x7fbb0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fd2081dace5018 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb1a7fc640 1 -- 172.21.15.17:0/2044153366 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c037070 con 0x7fbb1c1082f0 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb1a7fc640 1 -- 172.21.15.17:0/2044153366 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb0c032900 con 0x7fbb1c1082f0 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb1a7fc640 1 -- 172.21.15.17:0/2044153366 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c030850 con 0x7fbb1c1082f0 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb2135b640 1 -- 172.21.15.17:0/2044153366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 msgr2=0x7fbb1c10a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.606+0000 7fbb2135b640 1 --2- 172.21.15.17:0/2044153366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009820 tx=0x7fbb0c02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- 172.21.15.17:0/2044153366 shutdown_connections 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 --2- 172.21.15.17:0/2044153366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c10a6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- 172.21.15.17:0/2044153366 >> 172.21.15.17:0/2044153366 conn(0x7fbb1c101e70 msgr2=0x7fbb1c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- 172.21.15.17:0/2044153366 shutdown_connections 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- 172.21.15.17:0/2044153366 wait complete. 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 Processor -- start 2024-09-10T11:33:26.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- start start 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.607+0000 7fbb2135b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c10bb90 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38634/0 (socket says 172.21.15.17:38634) 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb1affd640 1 -- 172.21.15.17:0/330749357 learned_addr learned my addr 172.21.15.17:0/330749357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb1affd640 1 -- 172.21.15.17:0/330749357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c1080b0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb1affd640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c032ce0 tx=0x7fbb0c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c042070 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb0c0308c0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1062a0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c037040 con 0x7fbb1c1082f0 2024-09-10T11:33:26.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.608+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1067e0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.609+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbb0c045070 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.609+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c108750 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.610+0000 7fbb18ff9640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 0x7fbb0803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.610+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb0c06bfa0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.610+0000 7fbb13fff640 1 -- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 msgr2=0x7fbb0803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.610+0000 7fbb13fff640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 0x7fbb0803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.614+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb0c03cdd0 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.811+0000 7fbb13fff640 1 -- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 msgr2=0x7fbb0803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.811+0000 7fbb13fff640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 0x7fbb0803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.840+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbb1c106a60 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.840+0000 7fbb18ff9640 1 -- 172.21.15.17:0/330749357 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fbb0c045520 con 0x7fbb1c1082f0 2024-09-10T11:33:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 msgr2=0x7fbb0803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 0x7fbb0803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 msgr2=0x7fbb1c107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c032ce0 tx=0x7fbb0c032d10 comp rx=0 tx=0).stop 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 shutdown_connections 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbb08038f70 0x7fbb0803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 --2- 172.21.15.17:0/330749357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb1c1082f0 0x7fbb1c107b70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 >> 172.21.15.17:0/330749357 conn(0x7fbb1c101e70 msgr2=0x7fbb1c102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 shutdown_connections 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:25.843+0000 7fbb2135b640 1 -- 172.21.15.17:0/330749357 wait complete. 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-10T11:33:26.725 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-09-10T11:33:27.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:26.834+0000 7f6c3317c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:33:27.021 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:26.905+0000 7f6c3317c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:33:27.928 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:27.657+0000 7f6c3317c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:33:27.928 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:27.778+0000 7f6c3317c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:33:28.218 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:27.927+0000 7f6c3317c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:28.218 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:27.990+0000 7f6c3317c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:33:28.218 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.146+0000 7f6c3317c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:33:28.218 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.216+0000 7f6c3317c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:33:28.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.279+0000 7f6c3317c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:33:28.512 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.444+0000 7f6c3317c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:33:28.771 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.512+0000 7f6c3317c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:33:28.772 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.581+0000 7f6c3317c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:33:28.772 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.667+0000 7f6c3317c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:33:28.772 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.729+0000 7f6c3317c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:33:29.271 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:28.790+0000 7f6c3317c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:33:29.771 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:29.645+0000 7f6c3317c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: Active manager daemon x restarted 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: Activating manager daemon x 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: mgrmap e6: x(active, starting, since 0.00356134s) 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:33:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: Manager daemon x is now available 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:33:29.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:29 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.102+0000 7fbb177d4640 1 Processor -- start 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.102+0000 7fbb177d4640 1 -- start start 2024-09-10T11:33:31.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb177d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb177d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10107100 con 0x7fbb10106730 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb15570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb15570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38640/0 (socket says 172.21.15.17:38640) 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb15570640 1 -- 172.21.15.17:0/2650041102 learned_addr learned my addr 172.21.15.17:0/2650041102 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.103+0000 7fbb15570640 1 -- 172.21.15.17:0/2650041102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb10107930 con 0x7fbb10106730 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.104+0000 7fbb15570640 1 --2- 172.21.15.17:0/2650041102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009820 tx=0x7fbb0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a293a84b0dcfbaa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.104+0000 7fbb07fff640 1 -- 172.21.15.17:0/2650041102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c037070 con 0x7fbb10106730 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.104+0000 7fbb07fff640 1 -- 172.21.15.17:0/2650041102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb0c032900 con 0x7fbb10106730 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.104+0000 7fbb07fff640 1 -- 172.21.15.17:0/2650041102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c030850 con 0x7fbb10106730 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 -- 172.21.15.17:0/2650041102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 msgr2=0x7fbb10106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 --2- 172.21.15.17:0/2650041102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009820 tx=0x7fbb0c02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 -- 172.21.15.17:0/2650041102 shutdown_connections 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 --2- 172.21.15.17:0/2650041102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb10106b30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 -- 172.21.15.17:0/2650041102 >> 172.21.15.17:0/2650041102 conn(0x7fbb10101e80 msgr2=0x7fbb10104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 -- 172.21.15.17:0/2650041102 shutdown_connections 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.105+0000 7fbb177d4640 1 -- 172.21.15.17:0/2650041102 wait complete. 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb177d4640 1 Processor -- start 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb177d4640 1 -- start start 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb177d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb177d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1010ace0 con 0x7fbb10106730 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb15570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb15570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38648/0 (socket says 172.21.15.17:38648) 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb15570640 1 -- 172.21.15.17:0/3044173304 learned_addr learned my addr 172.21.15.17:0/3044173304 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:31.180 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb15570640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1019e580 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb15570640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009940 tx=0x7fbb0c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.106+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c042070 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.107+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb0c032be0 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.107+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1019e750 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.107+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c037040 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.107+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1019eaf0 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbb0c045070 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb067fc640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbafc03bb90 con 0x7fbafc038fc0 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb0c06beb0 con 0x7fbb10106730 2024-09-10T11:33:31.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb14d6f640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 msgr2=0x7fbafc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.108+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.309+0000 7fbb14d6f640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 msgr2=0x7fbafc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.309+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.710+0000 7fbb14d6f640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 msgr2=0x7fbafc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:27.710+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:28.511+0000 7fbb14d6f640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 msgr2=0x7fbafc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/817290704 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:28.511+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:29.649+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fbb0c06a970 con 0x7fbb10106730 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:29.649+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 msgr2=0x7fbafc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:29.649+0000 7fbb067fc640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.650+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fbb0c06ac90 con 0x7fbb10106730 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.650+0000 7fbb067fc640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 0x7fbafc03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:31.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.650+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbb0c064fe0 con 0x7fbafc03c8f0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.651+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 0x7fbafc03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.652+0000 7fbb14d6f640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 0x7fbafc03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb00003980 tx=0x7fbb000092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.652+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbb0c064fe0 con 0x7fbafc03c8f0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.659+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbb10106bb0 con 0x7fbafc03c8f0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb067fc640 1 -- 172.21.15.17:0/3044173304 <== mgr.14118 v2:172.21.15.17:6800/2456904864 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fbb10106bb0 con 0x7fbafc03c8f0 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 msgr2=0x7fbafc03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 0x7fbafc03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb00003980 tx=0x7fbb000092b0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 msgr2=0x7fbb1007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009940 tx=0x7fbb0c0326e0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 shutdown_connections 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7fbafc03c8f0 0x7fbafc03ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:6800/817290704,v1:172.21.15.17:6801/817290704] conn(0x7fbafc038fc0 0x7fbafc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 --2- 172.21.15.17:0/3044173304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb10106730 0x7fbb1007b9d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 >> 172.21.15.17:0/3044173304 conn(0x7fbb10101e80 msgr2=0x7fbb10102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 shutdown_connections 2024-09-10T11:33:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:30.660+0000 7fbb177d4640 1 -- 172.21.15.17:0/3044173304 wait complete. 2024-09-10T11:33:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-09-10T11:33:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-09-10T11:33:31.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-mon[30817]: Found migration_current of "None". Setting to last migration. 2024-09-10T11:33:31.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:31.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:31.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-mon[30817]: mgrmap e7: x(active, since 1.00611s) 2024-09-10T11:33:32.074 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:31.805+0000 7f6b9a4d6640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:11:33:31] ENGINE Error in HTTPServer.serve 2024-09-10T11:33:32.074 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: Traceback (most recent call last): 2024-09-10T11:33:32.074 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:33:32.074 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._connections.run(self.expiration_interval) 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._run(expiration_interval) 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: s = self.context.wrap_socket( 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: return self.sslsocket_class._create( 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self.do_handshake() 2024-09-10T11:33:32.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:33:32.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._sslobj.do_handshake() 2024-09-10T11:33:32.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:33:32.076 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13fae98640 1 Processor -- start 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13fae98640 1 -- start start 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13fae98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13fae98640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4107100 con 0x7f13f4106730 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13f8c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:32.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13f8c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39888/0 (socket says 172.21.15.17:39888) 2024-09-10T11:33:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.525+0000 7f13f8c34640 1 -- 172.21.15.17:0/3607743351 learned_addr learned my addr 172.21.15.17:0/3607743351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.526+0000 7f13f8c34640 1 -- 172.21.15.17:0/3607743351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f4107930 con 0x7f13f4106730 2024-09-10T11:33:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.526+0000 7f13f8c34640 1 --2- 172.21.15.17:0/3607743351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009820 tx=0x7f13e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c674f5a13b3165 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.526+0000 7f13f37fe640 1 -- 172.21.15.17:0/3607743351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e8037070 con 0x7f13f4106730 2024-09-10T11:33:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13f37fe640 1 -- 172.21.15.17:0/3607743351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13e8032900 con 0x7f13f4106730 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13f37fe640 1 -- 172.21.15.17:0/3607743351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e8030850 con 0x7f13f4106730 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 -- 172.21.15.17:0/3607743351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 msgr2=0x7f13f4106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 --2- 172.21.15.17:0/3607743351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009820 tx=0x7f13e802a270 comp rx=0 tx=0).stop 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 -- 172.21.15.17:0/3607743351 shutdown_connections 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 --2- 172.21.15.17:0/3607743351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f4106b30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 -- 172.21.15.17:0/3607743351 >> 172.21.15.17:0/3607743351 conn(0x7f13f4101ee0 msgr2=0x7f13f4104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 -- 172.21.15.17:0/3607743351 shutdown_connections 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.527+0000 7f13fae98640 1 -- 172.21.15.17:0/3607743351 wait complete. 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13fae98640 1 Processor -- start 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13fae98640 1 -- start start 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13fae98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13fae98640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13f410ace0 con 0x7f13f4106730 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13f8c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13f8c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39892/0 (socket says 172.21.15.17:39892) 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13f8c34640 1 -- 172.21.15.17:0/3999748184 learned_addr learned my addr 172.21.15.17:0/3999748184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.528+0000 7f13f8c34640 1 -- 172.21.15.17:0/3999748184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f419bd40 con 0x7f13f4106730 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13f8c34640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13e80097f0 tx=0x7f13e8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e8037040 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13e8040070 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f419bfd0 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e803a390 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.529+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f419ecc0 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.530+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f13e803a630 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.530+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f4106bb0 con 0x7f13f4106730 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.530+0000 7f13f1ffb640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 0x7f13e403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.530+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f13e806c430 con 0x7f13f4106730 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.530+0000 7f13f3fff640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 0x7f13e403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.531+0000 7f13f3fff640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 0x7f13e403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098c0 tx=0x7f13e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.535+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13e803b430 con 0x7f13f4106730 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.725+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f13f402da60 con 0x7f13e4038e60 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.729+0000 7f13f1ffb640 1 -- 172.21.15.17:0/3999748184 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f13f402da60 con 0x7f13e4038e60 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.731+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 msgr2=0x7f13e403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 0x7f13e403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098c0 tx=0x7f13e0006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 msgr2=0x7f13f419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13e80097f0 tx=0x7f13e8030d80 comp rx=0 tx=0).stop 2024-09-10T11:33:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 shutdown_connections 2024-09-10T11:33:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f13e4038e60 0x7f13e403b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 --2- 172.21.15.17:0/3999748184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4106730 0x7f13f419b800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 >> 172.21.15.17:0/3999748184 conn(0x7f13f4101ee0 msgr2=0x7f13f4102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 shutdown_connections 2024-09-10T11:33:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:31.732+0000 7f13fae98640 1 -- 172.21.15.17:0/3999748184 wait complete. 2024-09-10T11:33:32.718 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T11:33:32.718 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T11:33:32.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:31] ENGINE Bus STARTING 2024-09-10T11:33:32.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:32.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:32.719 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:32 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2222d89640 1 Processor -- start 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2222d89640 1 -- start start 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2222d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2222d89640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f221c108210 con 0x7f221c107840 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2220b25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2220b25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39910/0 (socket says 172.21.15.17:39910) 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.732+0000 7f2220b25640 1 -- 172.21.15.17:0/626418028 learned_addr learned my addr 172.21.15.17:0/626418028 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:33.539 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.733+0000 7f2220b25640 1 -- 172.21.15.17:0/626418028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c108a40 con 0x7f221c107840 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.733+0000 7f2220b25640 1 --2- 172.21.15.17:0/626418028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2210009820 tx=0x7f221002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41199e9d6d9379c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.733+0000 7f221b7fe640 1 -- 172.21.15.17:0/626418028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2210037070 con 0x7f221c107840 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.733+0000 7f221b7fe640 1 -- 172.21.15.17:0/626418028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2210032900 con 0x7f221c107840 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.733+0000 7f221b7fe640 1 -- 172.21.15.17:0/626418028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2210030850 con 0x7f221c107840 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 -- 172.21.15.17:0/626418028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 msgr2=0x7f221c107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 --2- 172.21.15.17:0/626418028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2210009820 tx=0x7f221002a270 comp rx=0 tx=0).stop 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 -- 172.21.15.17:0/626418028 shutdown_connections 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 --2- 172.21.15.17:0/626418028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c107c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 -- 172.21.15.17:0/626418028 >> 172.21.15.17:0/626418028 conn(0x7f221c102ff0 msgr2=0x7f221c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 -- 172.21.15.17:0/626418028 shutdown_connections 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.734+0000 7f2222d89640 1 -- 172.21.15.17:0/626418028 wait complete. 2024-09-10T11:33:33.540 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2222d89640 1 Processor -- start 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2222d89640 1 -- start start 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2222d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2222d89640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f221c10bdf0 con 0x7f221c107840 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2220b25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2220b25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39916/0 (socket says 172.21.15.17:39916) 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2220b25640 1 -- 172.21.15.17:0/209789264 learned_addr learned my addr 172.21.15.17:0/209789264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.735+0000 7f2220b25640 1 -- 172.21.15.17:0/209789264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c07e8c0 con 0x7f221c107840 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2220b25640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f2210030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2210042070 con 0x7f221c107840 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2210032ca0 con 0x7f221c107840 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2210037040 con 0x7f221c107840 2024-09-10T11:33:33.541 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221c07cab0 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.736+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221c07cff0 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.737+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2210045070 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.737+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221c107cc0 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.737+0000 7f2219ffb640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 0x7f220c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.737+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f221006bf40 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.737+0000 7f221bfff640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 0x7f220c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.738+0000 7f221bfff640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 0x7f220c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22080098c0 tx=0x7f2208006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.742+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f221004b170 con 0x7f221c107840 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.918+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f221c07d940 con 0x7f220c038fc0 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.919+0000 7f2219ffb640 1 -- 172.21.15.17:0/209789264 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f221c07d940 con 0x7f220c038fc0 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 msgr2=0x7f220c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 0x7f220c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22080098c0 tx=0x7f2208006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:33.542 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 msgr2=0x7f221c07e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f2210030ec0 comp rx=0 tx=0).stop 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 shutdown_connections 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f220c038fc0 0x7f220c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 --2- 172.21.15.17:0/209789264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c107840 0x7f221c07e380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 >> 172.21.15.17:0/209789264 conn(0x7f221c102ff0 msgr2=0x7f221c103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 shutdown_connections 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:32.921+0000 7f2222d89640 1 -- 172.21.15.17:0/209789264 wait complete. 2024-09-10T11:33:33.543 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:31] ENGINE Serving on http://172.21.15.17:8765 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:31] ENGINE Serving on https://172.21.15.17:7150 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:31] ENGINE Bus STARTED 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:31] ENGINE Error in HTTPServer.serve 2024-09-10T11:33:33.925 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-10T11:33:33.926 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:33:33.927 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-10T11:33:33.927 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:33:33.927 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-10T11:33:33.927 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:33:33.927 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:33 smithi017 ceph-mon[30817]: mgrmap e8: x(active, since 2s) 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: Generating public/private rsa key pair. 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: Your identification has been saved in /tmp/tmpw873f0ez/key 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: Your public key has been saved in /tmp/tmpw873f0ez/key.pub 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: The key fingerprint is: 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: SHA256:MPbw2UhbglvsPyC2IN+BAo9xOoRmWlO8EShLPvqJaBw ceph-44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:34.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: The key's randomart image is: 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: +---[RSA 3072]----+ 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: | oo. | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |o...o o | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |**+ o* = . | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |*@ ..o @ B | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |* = o = S . | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |.E + + + o | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |oo... o o | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |ooo . | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: |. | 2024-09-10T11:33:34.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: +----[SHA256]-----+ 2024-09-10T11:33:34.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-mon[30817]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:34.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:34.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:34 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:34.885 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.009+0000 7f4be050c640 1 Processor -- start 2024-09-10T11:33:34.885 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.009+0000 7f4be050c640 1 -- start start 2024-09-10T11:33:34.885 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.009+0000 7f4be050c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.009+0000 7f4be050c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd807c620 con 0x7f4bd8108340 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.010+0000 7f4bde2a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.010+0000 7f4bde2a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39932/0 (socket says 172.21.15.17:39932) 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.010+0000 7f4bde2a8640 1 -- 172.21.15.17:0/3609606371 learned_addr learned my addr 172.21.15.17:0/3609606371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.010+0000 7f4bde2a8640 1 -- 172.21.15.17:0/3609606371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd810ac70 con 0x7f4bd8108340 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.011+0000 7f4bde2a8640 1 --2- 172.21.15.17:0/3609606371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009820 tx=0x7f4bd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f4cf427ed64c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.011+0000 7f4bdd2a6640 1 -- 172.21.15.17:0/3609606371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4037070 con 0x7f4bd8108340 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.011+0000 7f4bdd2a6640 1 -- 172.21.15.17:0/3609606371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bd4032900 con 0x7f4bd8108340 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.011+0000 7f4bdd2a6640 1 -- 172.21.15.17:0/3609606371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4030850 con 0x7f4bd8108340 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- 172.21.15.17:0/3609606371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 msgr2=0x7f4bd810a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 --2- 172.21.15.17:0/3609606371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009820 tx=0x7f4bd402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:34.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- 172.21.15.17:0/3609606371 shutdown_connections 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 --2- 172.21.15.17:0/3609606371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd810a730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- 172.21.15.17:0/3609606371 >> 172.21.15.17:0/3609606371 conn(0x7f4bd8101ee0 msgr2=0x7f4bd8104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- 172.21.15.17:0/3609606371 shutdown_connections 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- 172.21.15.17:0/3609606371 wait complete. 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 Processor -- start 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.012+0000 7f4be050c640 1 -- start start 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4be050c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4be050c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd810bbe0 con 0x7f4bd8108340 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bde2a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bde2a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39936/0 (socket says 172.21.15.17:39936) 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bde2a8640 1 -- 172.21.15.17:0/2959715933 learned_addr learned my addr 172.21.15.17:0/2959715933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bde2a8640 1 -- 172.21.15.17:0/2959715933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd819bcc0 con 0x7f4bd8108340 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bde2a8640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4032ce0 tx=0x7f4bd4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:34.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4042070 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bd40308c0 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd819bf50 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.013+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4037040 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.014+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd819ec40 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.014+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4bd4045070 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.015+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd81087a0 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.015+0000 7f4bcf7fe640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 0x7f4bc403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.015+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4bd406bfd0 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.015+0000 7f4bddaa7640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 0x7f4bc403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.015+0000 7f4bddaa7640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 0x7f4bc403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098c0 tx=0x7f4bc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.020+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bd403c780 con 0x7f4bd8108340 2024-09-10T11:33:34.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.196+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4bd81031d0 con 0x7f4bc4038fc0 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.306+0000 7f4bcf7fe640 1 -- 172.21.15.17:0/2959715933 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4bd81031d0 con 0x7f4bc4038fc0 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 msgr2=0x7f4bc403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 0x7f4bc403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80098c0 tx=0x7f4bc8006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 msgr2=0x7f4bd819b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4032ce0 tx=0x7f4bd4032d10 comp rx=0 tx=0).stop 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 shutdown_connections 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f4bc4038fc0 0x7f4bc403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 --2- 172.21.15.17:0/2959715933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd8108340 0x7f4bd819b780 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 >> 172.21.15.17:0/2959715933 conn(0x7f4bd8101ee0 msgr2=0x7f4bd8102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 shutdown_connections 2024-09-10T11:33:34.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:34.308+0000 7f4be050c640 1 -- 172.21.15.17:0/2959715933 wait complete. 2024-09-10T11:33:35.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:35 smithi017 ceph-mon[30817]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:35 smithi017 ceph-mon[30817]: Generating ssh key... 2024-09-10T11:33:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f69a0f10640 1 Processor -- start 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f69a0f10640 1 -- start start 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f69a0f10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f69a0f10640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f699c1081f0 con 0x7f699c107820 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f699a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f699a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39948/0 (socket says 172.21.15.17:39948) 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.258+0000 7f699a59c640 1 -- 172.21.15.17:0/457447730 learned_addr learned my addr 172.21.15.17:0/457447730 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.259+0000 7f699a59c640 1 -- 172.21.15.17:0/457447730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c108a20 con 0x7f699c107820 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.259+0000 7f699a59c640 1 --2- 172.21.15.17:0/457447730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f698c009820 tx=0x7f698c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdedea31a5c714 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.259+0000 7f699959a640 1 -- 172.21.15.17:0/457447730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c037070 con 0x7f699c107820 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f699959a640 1 -- 172.21.15.17:0/457447730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f698c032900 con 0x7f699c107820 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f699959a640 1 -- 172.21.15.17:0/457447730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c030850 con 0x7f699c107820 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 -- 172.21.15.17:0/457447730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 msgr2=0x7f699c107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 --2- 172.21.15.17:0/457447730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f698c009820 tx=0x7f698c02a270 comp rx=0 tx=0).stop 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 -- 172.21.15.17:0/457447730 shutdown_connections 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 --2- 172.21.15.17:0/457447730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c107c20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 -- 172.21.15.17:0/457447730 >> 172.21.15.17:0/457447730 conn(0x7f699c102fd0 msgr2=0x7f699c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 -- 172.21.15.17:0/457447730 shutdown_connections 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.260+0000 7f69a0f10640 1 -- 172.21.15.17:0/457447730 wait complete. 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f69a0f10640 1 Processor -- start 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f69a0f10640 1 -- start start 2024-09-10T11:33:35.994 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f69a0f10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f69a0f10640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f699c10bdd0 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f699a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f699a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39962/0 (socket says 172.21.15.17:39962) 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.261+0000 7f699a59c640 1 -- 172.21.15.17:0/4038138213 learned_addr learned my addr 172.21.15.17:0/4038138213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f699a59c640 1 -- 172.21.15.17:0/4038138213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c19bd90 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f699a59c640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f698c009940 tx=0x7f698c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c042070 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f698c0308c0 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c19c020 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698c037040 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.262+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c19ed10 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.263+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f698c045070 con 0x7f699c107820 2024-09-10T11:33:35.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.263+0000 7f698b7fe640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 0x7f698403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.263+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f698c06bfe0 con 0x7f699c107820 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.263+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c107ca0 con 0x7f699c107820 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.264+0000 7f6999d9b640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 0x7f698403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.264+0000 7f6999d9b640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 0x7f698403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69900098c0 tx=0x7f6990006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.268+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f698c0327b0 con 0x7f699c107820 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.447+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f699c1041f0 con 0x7f6984038fc0 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.447+0000 7f698b7fe640 1 -- 172.21.15.17:0/4038138213 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f699c1041f0 con 0x7f6984038fc0 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 msgr2=0x7f698403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 0x7f698403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69900098c0 tx=0x7f6990006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 msgr2=0x7f699c19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:35.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f698c009940 tx=0x7f698c032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 shutdown_connections 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6984038fc0 0x7f698403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 --2- 172.21.15.17:0/4038138213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f699c107820 0x7f699c19b850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 >> 172.21.15.17:0/4038138213 conn(0x7f699c102fd0 msgr2=0x7f699c103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 shutdown_connections 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:35.450+0000 7f69a0f10640 1 -- 172.21.15.17:0/4038138213 wait complete. 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T11:33:35.997 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-09-10T11:33:36.791 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:36 smithi017 ceph-mon[30817]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:37.904 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:37 smithi017 ceph-mon[30817]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:38.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:38 smithi017 ceph-mon[30817]: Deploying cephadm binary to smithi017 2024-09-10T11:33:41.041 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.344+0000 7f6f5a9b8640 1 Processor -- start 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f5a9b8640 1 -- start start 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f5a9b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f5a9b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541081f0 con 0x7f6f54107820 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39966/0 (socket says 172.21.15.17:39966) 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f53fff640 1 -- 172.21.15.17:0/3624970778 learned_addr learned my addr 172.21.15.17:0/3624970778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.345+0000 7f6f53fff640 1 -- 172.21.15.17:0/3624970778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f54108a20 con 0x7f6f54107820 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.346+0000 7f6f53fff640 1 --2- 172.21.15.17:0/3624970778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009820 tx=0x7f6f4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968c8487ec724d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.346+0000 7f6f52ffd640 1 -- 172.21.15.17:0/3624970778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f44037070 con 0x7f6f54107820 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.346+0000 7f6f52ffd640 1 -- 172.21.15.17:0/3624970778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f44032900 con 0x7f6f54107820 2024-09-10T11:33:41.042 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.346+0000 7f6f52ffd640 1 -- 172.21.15.17:0/3624970778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f44030850 con 0x7f6f54107820 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/3624970778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 msgr2=0x7f6f54107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/3624970778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009820 tx=0x7f6f4402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/3624970778 shutdown_connections 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/3624970778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f54107c20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/3624970778 >> 172.21.15.17:0/3624970778 conn(0x7f6f54102fd0 msgr2=0x7f6f541053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/3624970778 shutdown_connections 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/3624970778 wait complete. 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 Processor -- start 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.347+0000 7f6f5a9b8640 1 -- start start 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f5a9b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f5a9b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5410bdd0 con 0x7f6f54107820 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39972/0 (socket says 172.21.15.17:39972) 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f53fff640 1 -- 172.21.15.17:0/1317325938 learned_addr learned my addr 172.21.15.17:0/1317325938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f53fff640 1 -- 172.21.15.17:0/1317325938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5419bd90 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f53fff640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097f0 tx=0x7f6f44030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.348+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f44037040 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.349+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f44040070 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.349+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5419c020 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.349+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4403a390 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.349+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5419ed10 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.349+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6f4403a630 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.350+0000 7f6f517fa640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 0x7f6f3c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.350+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6f4406c470 con 0x7f6f54107820 2024-09-10T11:33:41.044 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.350+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54107ca0 con 0x7f6f54107820 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.350+0000 7f6f537fe640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 0x7f6f3c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.350+0000 7f6f537fe640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 0x7f6f3c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f480098c0 tx=0x7f6f48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.355+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f4404a200 con 0x7f6f54107820 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:36.535+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) -- 0x7f6f541041f0 con 0x7f6f3c038f70 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.479+0000 7f6f517fa640 1 -- 172.21.15.17:0/1317325938 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6f541041f0 con 0x7f6f3c038f70 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 msgr2=0x7f6f3c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 0x7f6f3c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f480098c0 tx=0x7f6f48006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 msgr2=0x7f6f5419b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097f0 tx=0x7f6f44030d80 comp rx=0 tx=0).stop 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 shutdown_connections 2024-09-10T11:33:41.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f6f3c038f70 0x7f6f3c03b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:41.046 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 --2- 172.21.15.17:0/1317325938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f54107820 0x7f6f5419b850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:41.046 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 >> 172.21.15.17:0/1317325938 conn(0x7f6f54102fd0 msgr2=0x7f6f54103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:41.046 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 shutdown_connections 2024-09-10T11:33:41.046 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:40.482+0000 7f6f5a9b8640 1 -- 172.21.15.17:0/1317325938 wait complete. 2024-09-10T11:33:41.046 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2024-09-10T11:33:41.738 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:41 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:41.738 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:41 smithi017 ceph-mon[30817]: Added host smithi017 2024-09-10T11:33:41.738 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:41 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.509+0000 7f89ee6c1640 1 Processor -- start 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.509+0000 7f89ee6c1640 1 -- start start 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89ee6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89ee6c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f89e81070d0 con 0x7f89e8106700 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:42.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32874/0 (socket says 172.21.15.17:32874) 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89e7fff640 1 -- 172.21.15.17:0/3411053504 learned_addr learned my addr 172.21.15.17:0/3411053504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.510+0000 7f89e7fff640 1 -- 172.21.15.17:0/3411053504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8107900 con 0x7f89e8106700 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.511+0000 7f89e7fff640 1 --2- 172.21.15.17:0/3411053504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009820 tx=0x7f89d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa11df3d6e74919 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.511+0000 7f89e77fe640 1 -- 172.21.15.17:0/3411053504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8037070 con 0x7f89e8106700 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.511+0000 7f89e77fe640 1 -- 172.21.15.17:0/3411053504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89d8032900 con 0x7f89e8106700 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.511+0000 7f89e77fe640 1 -- 172.21.15.17:0/3411053504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8030850 con 0x7f89e8106700 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3411053504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 msgr2=0x7f89e8106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3411053504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009820 tx=0x7f89d802a270 comp rx=0 tx=0).stop 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3411053504 shutdown_connections 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3411053504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e8106b00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3411053504 >> 172.21.15.17:0/3411053504 conn(0x7f89e8101e70 msgr2=0x7f89e81042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3411053504 shutdown_connections 2024-09-10T11:33:42.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3411053504 wait complete. 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 Processor -- start 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- start start 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.512+0000 7f89ee6c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f89e810acb0 con 0x7f89e8106700 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32890/0 (socket says 172.21.15.17:32890) 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e7fff640 1 -- 172.21.15.17:0/3393748369 learned_addr learned my addr 172.21.15.17:0/3393748369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e7fff640 1 -- 172.21.15.17:0/3393748369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8191e00 con 0x7f89e8106700 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e7fff640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009940 tx=0x7f89d8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8042070 con 0x7f89e8106700 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e818fff0 con 0x7f89e8106700 2024-09-10T11:33:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89d80308c0 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8037040 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.513+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e8190530 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.514+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f89d8045070 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.514+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e8106b80 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.515+0000 7f89e5ffb640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 0x7f89d403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.515+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f89d806c1e0 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.515+0000 7f89dffff640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 0x7f89d403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.515+0000 7f89dffff640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 0x7f89d403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89d00098c0 tx=0x7f89d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.519+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89d803bdd0 con 0x7f89e8106700 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.736+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f89e81956b0 con 0x7f89d4038f70 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.740+0000 7f89e5ffb640 1 -- 172.21.15.17:0/3393748369 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f89e81956b0 con 0x7f89d4038f70 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 msgr2=0x7f89d403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:42.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 0x7f89d403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89d00098c0 tx=0x7f89d0006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 msgr2=0x7f89e81918c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009940 tx=0x7f89d8032ce0 comp rx=0 tx=0).stop 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 shutdown_connections 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f89d4038f70 0x7f89d403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 --2- 172.21.15.17:0/3393748369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89e8106700 0x7f89e81918c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 >> 172.21.15.17:0/3393748369 conn(0x7f89e8101e70 msgr2=0x7f89e8102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 shutdown_connections 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:41.743+0000 7f89ee6c1640 1 -- 172.21.15.17:0/3393748369 wait complete. 2024-09-10T11:33:42.475 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2024-09-10T11:33:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:42 smithi017 ceph-mon[30817]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:42 smithi017 ceph-mon[30817]: Saving service mon spec with placement count:5 2024-09-10T11:33:43.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:42 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.224+0000 7f03eb96b640 1 Processor -- start 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.224+0000 7f03eb96b640 1 -- start start 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03eb96b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03eb96b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41070d0 con 0x7f03e4106700 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03e9707640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03e9707640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32904/0 (socket says 172.21.15.17:32904) 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03e9707640 1 -- 172.21.15.17:0/2184953398 learned_addr learned my addr 172.21.15.17:0/2184953398 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.225+0000 7f03e9707640 1 -- 172.21.15.17:0/2184953398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e4107900 con 0x7f03e4106700 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.226+0000 7f03e9707640 1 --2- 172.21.15.17:0/2184953398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03e000bac0 tx=0x7f03e002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7e6355956043b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.226+0000 7f03dbfff640 1 -- 172.21.15.17:0/2184953398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e00326d0 con 0x7f03e4106700 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.226+0000 7f03dbfff640 1 -- 172.21.15.17:0/2184953398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03e0038070 con 0x7f03e4106700 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.226+0000 7f03dbfff640 1 -- 172.21.15.17:0/2184953398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e0033d70 con 0x7f03e4106700 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 -- 172.21.15.17:0/2184953398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 msgr2=0x7f03e4106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 --2- 172.21.15.17:0/2184953398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03e000bac0 tx=0x7f03e002c920 comp rx=0 tx=0).stop 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 -- 172.21.15.17:0/2184953398 shutdown_connections 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 --2- 172.21.15.17:0/2184953398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e4106b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 -- 172.21.15.17:0/2184953398 >> 172.21.15.17:0/2184953398 conn(0x7f03e4101e70 msgr2=0x7f03e41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 -- 172.21.15.17:0/2184953398 shutdown_connections 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 -- 172.21.15.17:0/2184953398 wait complete. 2024-09-10T11:33:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.227+0000 7f03eb96b640 1 Processor -- start 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03eb96b640 1 -- start start 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03eb96b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03eb96b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03e407af50 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03e9707640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03e9707640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32910/0 (socket says 172.21.15.17:32910) 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03e9707640 1 -- 172.21.15.17:0/3791837704 learned_addr learned my addr 172.21.15.17:0/3791837704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03e9707640 1 -- 172.21.15.17:0/3791837704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e4199b00 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03e9707640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03e000b2c0 tx=0x7f03e00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e0042070 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03e0032b70 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.228+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e4199d90 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.229+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e003c580 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.229+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e419ca80 con 0x7f03e4106700 2024-09-10T11:33:44.250 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f03e003c7f0 con 0x7f03e4106700 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e4106b00 con 0x7f03e4106700 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03da7fc640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 0x7f03d003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f03e0030050 con 0x7f03e4106700 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03e8f06640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 0x7f03d003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.230+0000 7f03e8f06640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 0x7f03d003b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03d40098c0 tx=0x7f03d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.235+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03e0032d90 con 0x7f03e4106700 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.421+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f03e4062630 con 0x7f03d0038fc0 2024-09-10T11:33:44.251 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.425+0000 7f03da7fc640 1 -- 172.21.15.17:0/3791837704 <== mgr.14118 v2:172.21.15.17:6800/2456904864 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f03e4062630 con 0x7f03d0038fc0 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 msgr2=0x7f03d003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 0x7f03d003b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03d40098c0 tx=0x7f03d4006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 msgr2=0x7f03e41995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f03e000b2c0 tx=0x7f03e00327d0 comp rx=0 tx=0).stop 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 shutdown_connections 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f03d0038fc0 0x7f03d003b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 --2- 172.21.15.17:0/3791837704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e4106700 0x7f03e41995c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 >> 172.21.15.17:0/3791837704 conn(0x7f03e4101e70 msgr2=0x7f03e418fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 shutdown_connections 2024-09-10T11:33:44.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:43.427+0000 7f03eb96b640 1 -- 172.21.15.17:0/3791837704 wait complete. 2024-09-10T11:33:44.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:44 smithi017 ceph-mon[30817]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:44.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:44 smithi017 ceph-mon[30817]: Saving service mgr spec with placement count:2 2024-09-10T11:33:44.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:44 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:44.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:44 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:44.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:44 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:45.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b55335640 1 Processor -- start 2024-09-10T11:33:45.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b55335640 1 -- start start 2024-09-10T11:33:45.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b55335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:45.438 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b55335640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5007d0e0 con 0x7f5b5007e6b0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32918/0 (socket says 172.21.15.17:32918) 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.652+0000 7f5b4effd640 1 -- 172.21.15.17:0/2751749789 learned_addr learned my addr 172.21.15.17:0/2751749789 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.653+0000 7f5b4effd640 1 -- 172.21.15.17:0/2751749789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5007d260 con 0x7f5b5007e6b0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.653+0000 7f5b4effd640 1 --2- 172.21.15.17:0/2751749789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009820 tx=0x7f5b4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5ce591a8546ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b4e7fc640 1 -- 172.21.15.17:0/2751749789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b40037070 con 0x7f5b5007e6b0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b4e7fc640 1 -- 172.21.15.17:0/2751749789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b40032920 con 0x7f5b5007e6b0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b4e7fc640 1 -- 172.21.15.17:0/2751749789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b40030810 con 0x7f5b5007e6b0 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b55335640 1 -- 172.21.15.17:0/2751749789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 msgr2=0x7f5b5007cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b55335640 1 --2- 172.21.15.17:0/2751749789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009820 tx=0x7f5b4002a270 comp rx=0 tx=0).stop 2024-09-10T11:33:45.439 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b55335640 1 -- 172.21.15.17:0/2751749789 shutdown_connections 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.654+0000 7f5b55335640 1 --2- 172.21.15.17:0/2751749789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5007cb10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 -- 172.21.15.17:0/2751749789 >> 172.21.15.17:0/2751749789 conn(0x7f5b50102fd0 msgr2=0x7f5b501053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 -- 172.21.15.17:0/2751749789 shutdown_connections 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 -- 172.21.15.17:0/2751749789 wait complete. 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 Processor -- start 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 -- start start 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.655+0000 7f5b55335640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5010de80 con 0x7f5b5007e6b0 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32934/0 (socket says 172.21.15.17:32934) 2024-09-10T11:33:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4effd640 1 -- 172.21.15.17:0/4021414654 learned_addr learned my addr 172.21.15.17:0/4021414654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4effd640 1 -- 172.21.15.17:0/4021414654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5019df00 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4effd640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b40030380 tx=0x7f5b40032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b40037040 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5019e190 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b40040070 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4003a7b0 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.656+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b501a0e80 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.657+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5007cb90 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.657+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5b4003a9e0 con 0x7f5b5007e6b0 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.658+0000 7f5b4cff9640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 0x7f5b3c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:45.441 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.658+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5b4006c600 con 0x7f5b5007e6b0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.658+0000 7f5b47fff640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 0x7f5b3c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.658+0000 7f5b47fff640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 0x7f5b3c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b380098c0 tx=0x7f5b38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.663+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b40041270 con 0x7f5b5007e6b0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.848+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5b501a1470 con 0x7f5b5007e6b0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.850+0000 7f5b4cff9640 1 -- 172.21.15.17:0/4021414654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f5b4003add0 con 0x7f5b5007e6b0 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 msgr2=0x7f5b3c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 0x7f5b3c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5b380098c0 tx=0x7f5b38006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 msgr2=0x7f5b5019d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b40030380 tx=0x7f5b40032670 comp rx=0 tx=0).stop 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 shutdown_connections 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f5b3c038fc0 0x7f5b3c03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:45.442 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 --2- 172.21.15.17:0/4021414654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b5007e6b0 0x7f5b5019d9c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:45.443 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 >> 172.21.15.17:0/4021414654 conn(0x7f5b50102fd0 msgr2=0x7f5b50103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:45.443 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 shutdown_connections 2024-09-10T11:33:45.443 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:44.853+0000 7f5b55335640 1 -- 172.21.15.17:0/4021414654 wait complete. 2024-09-10T11:33:46.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:45 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4021414654' entity='client.admin' 2024-09-10T11:33:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.350+0000 7f79a8e57640 1 Processor -- start 2024-09-10T11:33:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.350+0000 7f79a8e57640 1 -- start start 2024-09-10T11:33:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.350+0000 7f79a8e57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.350+0000 7f79a8e57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41081f0 con 0x7f79a4107820 2024-09-10T11:33:47.122 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.351+0000 7f79a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.351+0000 7f79a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32942/0 (socket says 172.21.15.17:32942) 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.351+0000 7f79a259c640 1 -- 172.21.15.17:0/861718555 learned_addr learned my addr 172.21.15.17:0/861718555 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.351+0000 7f79a259c640 1 -- 172.21.15.17:0/861718555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a41089d0 con 0x7f79a4107820 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.351+0000 7f79a259c640 1 --2- 172.21.15.17:0/861718555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7994009820 tx=0x7f799402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a329a2eaf86a0d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a159a640 1 -- 172.21.15.17:0/861718555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7994037070 con 0x7f79a4107820 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a159a640 1 -- 172.21.15.17:0/861718555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7994032920 con 0x7f79a4107820 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a159a640 1 -- 172.21.15.17:0/861718555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7994030810 con 0x7f79a4107820 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a8e57640 1 -- 172.21.15.17:0/861718555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 msgr2=0x7f79a4107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a8e57640 1 --2- 172.21.15.17:0/861718555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7994009820 tx=0x7f799402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a8e57640 1 -- 172.21.15.17:0/861718555 shutdown_connections 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a8e57640 1 --2- 172.21.15.17:0/861718555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a4107c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:47.123 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.352+0000 7f79a8e57640 1 -- 172.21.15.17:0/861718555 >> 172.21.15.17:0/861718555 conn(0x7f79a4103070 msgr2=0x7f79a4105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.353+0000 7f79a8e57640 1 -- 172.21.15.17:0/861718555 shutdown_connections 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.353+0000 7f79a8e57640 1 -- 172.21.15.17:0/861718555 wait complete. 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.353+0000 7f79a8e57640 1 Processor -- start 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.353+0000 7f79a8e57640 1 -- start start 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a8e57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a8e57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410bd80 con 0x7f79a4107820 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32948/0 (socket says 172.21.15.17:32948) 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a259c640 1 -- 172.21.15.17:0/1222657528 learned_addr learned my addr 172.21.15.17:0/1222657528 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a259c640 1 -- 172.21.15.17:0/1222657528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a419bcd0 con 0x7f79a4107820 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a259c640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7994030560 tx=0x7f7994032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7994037040 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7994040070 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a419bf60 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.354+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f799403a740 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.355+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a419ec50 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.356+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f799403bb90 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.356+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a4107ca0 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.356+0000 7f79937fe640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 0x7f798c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.356+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f799406c520 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.356+0000 7f79a1d9b640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 0x7f798c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.357+0000 7f79a1d9b640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 0x7f798c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79980098c0 tx=0x7f7998006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.361+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7994031e80 con 0x7f79a4107820 2024-09-10T11:33:47.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.539+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f79a419f2b0 con 0x7f79a4107820 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.541+0000 7f79937fe640 1 -- 172.21.15.17:0/1222657528 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f799404a200 con 0x7f79a4107820 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 msgr2=0x7f798c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 0x7f798c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79980098c0 tx=0x7f7998006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 msgr2=0x7f79a419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7994030560 tx=0x7f7994032670 comp rx=0 tx=0).stop 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 shutdown_connections 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f798c038fc0 0x7f798c03b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 --2- 172.21.15.17:0/1222657528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4107820 0x7f79a419b790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 >> 172.21.15.17:0/1222657528 conn(0x7f79a4103070 msgr2=0x7f79a4103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 shutdown_connections 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:46.544+0000 7f79a8e57640 1 -- 172.21.15.17:0/1222657528 wait complete. 2024-09-10T11:33:47.126 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-09-10T11:33:47.374 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:47 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:47.374 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:47 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1222657528' entity='client.admin' 2024-09-10T11:33:48.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-mon[30817]: from='mgr.14118 172.21.15.17:0/2389962509' entity='mgr.x' 2024-09-10T11:33:48.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3396590230' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T11:33:48.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ignoring --setuser ceph since I am not root 2024-09-10T11:33:48.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ignoring --setgroup ceph since I am not root 2024-09-10T11:33:48.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.330+0000 7f60ce966040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:33:48.620 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.391+0000 7f60ce966040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:33:48.620 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.547+0000 7f60ce966040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:33:48.925 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.617+0000 7f60ce966040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:33:48.925 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.773+0000 7f60ce966040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:48.925 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:48.922+0000 7f60ce966040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:33:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.566+0000 7ff51ee6b640 1 Processor -- start 2024-09-10T11:33:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51ee6b640 1 -- start start 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51ee6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51ee6b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181081f0 con 0x7ff518107820 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51cc07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51cc07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32960/0 (socket says 172.21.15.17:32960) 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51cc07640 1 -- 172.21.15.17:0/301835480 learned_addr learned my addr 172.21.15.17:0/301835480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.567+0000 7ff51cc07640 1 -- 172.21.15.17:0/301835480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff518108a20 con 0x7ff518107820 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.568+0000 7ff51cc07640 1 --2- 172.21.15.17:0/301835480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff508009820 tx=0x7ff50802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9727225cb7e7ec79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.568+0000 7ff5177fe640 1 -- 172.21.15.17:0/301835480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff508037070 con 0x7ff518107820 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.568+0000 7ff5177fe640 1 -- 172.21.15.17:0/301835480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff508032920 con 0x7ff518107820 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.568+0000 7ff5177fe640 1 -- 172.21.15.17:0/301835480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff508030810 con 0x7ff518107820 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- 172.21.15.17:0/301835480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 msgr2=0x7ff518107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:49.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/301835480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff508009820 tx=0x7ff50802a270 comp rx=0 tx=0).stop 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- 172.21.15.17:0/301835480 shutdown_connections 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/301835480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff518107c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- 172.21.15.17:0/301835480 >> 172.21.15.17:0/301835480 conn(0x7ff518102fd0 msgr2=0x7ff5181053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- 172.21.15.17:0/301835480 shutdown_connections 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- 172.21.15.17:0/301835480 wait complete. 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 Processor -- start 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.569+0000 7ff51ee6b640 1 -- start start 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51ee6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51ee6b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff51810bdd0 con 0x7ff518107820 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51cc07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51cc07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32964/0 (socket says 172.21.15.17:32964) 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51cc07640 1 -- 172.21.15.17:0/3396590230 learned_addr learned my addr 172.21.15.17:0/3396590230 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51cc07640 1 -- 172.21.15.17:0/3396590230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51819bd60 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51cc07640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff508030560 tx=0x7ff508032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff508037040 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51819bff0 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff508040070 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.570+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50803a740 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.571+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51819ece0 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff50803bb90 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff515ffb640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 0x7ff50403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff50806c590 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff518107ca0 con 0x7ff518107820 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff517fff640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 0x7ff50403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.572+0000 7ff517fff640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 0x7ff50403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff50000ad30 tx=0x7ff5000093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:49.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.577+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff50804a200 con 0x7ff518107820 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:47.810+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff51819f2d0 con 0x7ff518107820 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.175+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff508031e80 con 0x7ff518107820 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.176+0000 7ff515ffb640 1 -- 172.21.15.17:0/3396590230 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff50803a9b0 con 0x7ff518107820 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 msgr2=0x7ff50403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 0x7ff50403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff50000ad30 tx=0x7ff5000093f0 comp rx=0 tx=0).stop 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 msgr2=0x7ff51819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff508030560 tx=0x7ff508032670 comp rx=0 tx=0).stop 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 shutdown_connections 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7ff504038f70 0x7ff50403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 --2- 172.21.15.17:0/3396590230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff518107820 0x7ff51819b820 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 >> 172.21.15.17:0/3396590230 conn(0x7ff518102fd0 msgr2=0x7ff518103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 shutdown_connections 2024-09-10T11:33:49.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:48.178+0000 7ff51ee6b640 1 -- 172.21.15.17:0/3396590230 wait complete. 2024-09-10T11:33:49.428 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:49 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3396590230' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T11:33:49.428 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:49 smithi017 ceph-mon[30817]: mgrmap e9: x(active, since 18s) 2024-09-10T11:33:49.428 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:49.256+0000 7f60ce966040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:33:49.428 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:49.322+0000 7f60ce966040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:33:49.719 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:49.520+0000 7f60ce966040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:33:50.477 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:50 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2456773444' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T11:33:50.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:50.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T11:33:50.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T11:33:50.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T11:33:50.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T11:33:50.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:50.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.716+0000 7f04665ad640 1 Processor -- start 2024-09-10T11:33:50.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f04665ad640 1 -- start start 2024-09-10T11:33:50.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f04665ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:50.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f04665ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f04601070d0 con 0x7f0460106700 2024-09-10T11:33:50.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f045ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:50.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f045ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32988/0 (socket says 172.21.15.17:32988) 2024-09-10T11:33:50.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f045ffff640 1 -- 172.21.15.17:0/4070670453 learned_addr learned my addr 172.21.15.17:0/4070670453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:50.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.717+0000 7f045ffff640 1 -- 172.21.15.17:0/4070670453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460107900 con 0x7f0460106700 2024-09-10T11:33:50.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.718+0000 7f045ffff640 1 --2- 172.21.15.17:0/4070670453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f045000bac0 tx=0x7f045002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc5887943f315a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:50.528 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.718+0000 7f045effd640 1 -- 172.21.15.17:0/4070670453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04500326d0 con 0x7f0460106700 2024-09-10T11:33:50.528 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.718+0000 7f045effd640 1 -- 172.21.15.17:0/4070670453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0450038070 con 0x7f0460106700 2024-09-10T11:33:50.528 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.718+0000 7f045effd640 1 -- 172.21.15.17:0/4070670453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0450033d00 con 0x7f0460106700 2024-09-10T11:33:50.528 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 -- 172.21.15.17:0/4070670453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 msgr2=0x7f0460106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:50.528 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 --2- 172.21.15.17:0/4070670453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f045000bac0 tx=0x7f045002c920 comp rx=0 tx=0).stop 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 -- 172.21.15.17:0/4070670453 shutdown_connections 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 --2- 172.21.15.17:0/4070670453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460106b00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 -- 172.21.15.17:0/4070670453 >> 172.21.15.17:0/4070670453 conn(0x7f0460101e70 msgr2=0x7f04601042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 -- 172.21.15.17:0/4070670453 shutdown_connections 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.719+0000 7f04665ad640 1 -- 172.21.15.17:0/4070670453 wait complete. 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.720+0000 7f04665ad640 1 Processor -- start 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.720+0000 7f04665ad640 1 -- start start 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f04665ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f04665ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f046007af50 con 0x7f0460106700 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32992/0 (socket says 172.21.15.17:32992) 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045ffff640 1 -- 172.21.15.17:0/2456773444 learned_addr learned my addr 172.21.15.17:0/2456773444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:50.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045ffff640 1 -- 172.21.15.17:0/2456773444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460199b80 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045ffff640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f045000b2c0 tx=0x7f04500327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0450042070 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0450032cd0 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0460199e10 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.721+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f045003c6a0 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.722+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046019cb00 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460106b80 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0450046a70 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f045d7fa640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 0x7f044803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f045f7fe640 1 -- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 msgr2=0x7f044803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0450030050 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.723+0000 7f045f7fe640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 0x7f044803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.728+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f045006ea80 con 0x7f0460106700 2024-09-10T11:33:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.924+0000 7f045f7fe640 1 -- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 msgr2=0x7f044803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.924+0000 7f045f7fe640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 0x7f044803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.951+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f046019ccd0 con 0x7f0460106700 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.951+0000 7f045d7fa640 1 -- 172.21.15.17:0/2456773444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f046019ccd0 con 0x7f0460106700 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 msgr2=0x7f044803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 0x7f044803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 msgr2=0x7f0460199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f045000b2c0 tx=0x7f04500327d0 comp rx=0 tx=0).stop 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 shutdown_connections 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f0448038fc0 0x7f044803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 --2- 172.21.15.17:0/2456773444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0460106700 0x7f0460199640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 >> 172.21.15.17:0/2456773444 conn(0x7f0460101e70 msgr2=0x7f046018fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 shutdown_connections 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:49.953+0000 7f04665ad640 1 -- 172.21.15.17:0/2456773444 wait complete. 2024-09-10T11:33:50.531 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-10T11:33:50.532 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-09-10T11:33:50.746 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:50.475+0000 7f60ce966040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:33:50.746 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:50.550+0000 7f60ce966040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:33:51.610 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.330+0000 7f60ce966040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:33:51.610 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.455+0000 7f60ce966040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:33:51.907 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.608+0000 7f60ce966040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:33:51.907 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.673+0000 7f60ce966040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:33:51.907 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.832+0000 7f60ce966040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:33:51.907 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.905+0000 7f60ce966040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:33:52.209 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:51.969+0000 7f60ce966040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:33:52.210 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.137+0000 7f60ce966040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:33:52.210 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.206+0000 7f60ce966040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:33:52.492 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.276+0000 7f60ce966040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:33:52.492 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.364+0000 7f60ce966040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:33:52.492 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.427+0000 7f60ce966040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:33:52.492 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:52.489+0000 7f60ce966040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:33:53.577 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:53.324+0000 7f60ce966040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: Active manager daemon x restarted 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: Activating manager daemon x 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: mgrmap e10: x(active, starting, since 0.0034068s) 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: Manager daemon x is now available 2024-09-10T11:33:53.578 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:33:53.579 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T11:33:53.579 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T11:33:55.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.942+0000 7f33df0c1640 1 Processor -- start 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.942+0000 7f33df0c1640 1 -- start start 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33df0c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33df0c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33d8107100 con 0x7f33d8106730 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33dce5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33dce5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33004/0 (socket says 172.21.15.17:33004) 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33dce5d640 1 -- 172.21.15.17:0/3689133171 learned_addr learned my addr 172.21.15.17:0/3689133171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.943+0000 7f33dce5d640 1 -- 172.21.15.17:0/3689133171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d8107930 con 0x7f33d8106730 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.944+0000 7f33dce5d640 1 --2- 172.21.15.17:0/3689133171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bac0 tx=0x7f33cc02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4571ceb54fdf6d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.944+0000 7f33d77fe640 1 -- 172.21.15.17:0/3689133171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0326d0 con 0x7f33d8106730 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.944+0000 7f33d77fe640 1 -- 172.21.15.17:0/3689133171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33cc038070 con 0x7f33d8106730 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.944+0000 7f33d77fe640 1 -- 172.21.15.17:0/3689133171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc033d00 con 0x7f33d8106730 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 -- 172.21.15.17:0/3689133171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 msgr2=0x7f33d8106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 --2- 172.21.15.17:0/3689133171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bac0 tx=0x7f33cc02c920 comp rx=0 tx=0).stop 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 -- 172.21.15.17:0/3689133171 shutdown_connections 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 --2- 172.21.15.17:0/3689133171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d8106b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 -- 172.21.15.17:0/3689133171 >> 172.21.15.17:0/3689133171 conn(0x7f33d8101e80 msgr2=0x7f33d8104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 -- 172.21.15.17:0/3689133171 shutdown_connections 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.945+0000 7f33df0c1640 1 -- 172.21.15.17:0/3689133171 wait complete. 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.946+0000 7f33df0c1640 1 Processor -- start 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.946+0000 7f33df0c1640 1 -- start start 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.946+0000 7f33df0c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.946+0000 7f33df0c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33d807af50 con 0x7f33d8106730 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33dce5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33dce5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33020/0 (socket says 172.21.15.17:33020) 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33dce5d640 1 -- 172.21.15.17:0/4256701432 learned_addr learned my addr 172.21.15.17:0/4256701432 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33dce5d640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d8199bf0 con 0x7f33d8106730 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33dce5d640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bbe0 tx=0x7f33cc0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc042070 con 0x7f33d8106730 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33cc032cd0 con 0x7f33d8106730 2024-09-10T11:33:55.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc045660 con 0x7f33d8106730 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.947+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d8199e80 con 0x7f33d8106730 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.948+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d819cb70 con 0x7f33d8106730 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f33cc04d060 con 0x7f33d8106730 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33d5ffb640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f33d8106bb0 con 0x7f33c8039020 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f33cc030050 con 0x7f33d8106730 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33d7fff640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 msgr2=0x7f33c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:50.949+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:51.150+0000 7f33d7fff640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 msgr2=0x7f33c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:51.150+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:51.551+0000 7f33d7fff640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 msgr2=0x7f33c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:51.551+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T11:33:55.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:52.352+0000 7f33d7fff640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 msgr2=0x7f33c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2456904864 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:52.352+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:53.328+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f33cc06d330 con 0x7f33d8106730 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:53.328+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 msgr2=0x7f33c803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:53.328+0000 7f33d5ffb640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.330+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f33cc03b720 con 0x7f33d8106730 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.330+0000 7f33d5ffb640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 0x7f33c803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.330+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f33d8106bb0 con 0x7f33c803c8f0 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.331+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 0x7f33c803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.331+0000 7f33d7fff640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 0x7f33c803ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f33c4003980 tx=0x7f33c40092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.332+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f33d8106bb0 con 0x7f33c803c8f0 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.339+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f33d8191410 con 0x7f33c803c8f0 2024-09-10T11:33:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.339+0000 7f33d5ffb640 1 -- 172.21.15.17:0/4256701432 <== mgr.14150 v2:172.21.15.17:6800/3008774641 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f33d8191410 con 0x7f33c803c8f0 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 msgr2=0x7f33c803ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 0x7f33c803ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f33c4003980 tx=0x7f33c40092b0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 msgr2=0x7f33d81996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00bbe0 tx=0x7f33cc0327d0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 shutdown_connections 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f33c803c8f0 0x7f33c803ece0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:6800/2456904864,v1:172.21.15.17:6801/2456904864] conn(0x7f33c8039020 0x7f33c803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 --2- 172.21.15.17:0/4256701432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d8106730 0x7f33d81996b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 >> 172.21.15.17:0/4256701432 conn(0x7f33d8101e80 msgr2=0x7f33d818fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 shutdown_connections 2024-09-10T11:33:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:54.340+0000 7f33df0c1640 1 -- 172.21.15.17:0/4256701432 wait complete. 2024-09-10T11:33:55.268 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-09-10T11:33:55.268 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-mon[30817]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-mon[30817]: mgrmap e11: x(active, since 1.00595s) 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-mon[30817]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:55.454+0000 7f6039c7a640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:11:33:55] ENGINE Error in HTTPServer.serve 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: Traceback (most recent call last): 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._connections.run(self.expiration_interval) 2024-09-10T11:33:55.522 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._run(expiration_interval) 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: s = self.context.wrap_socket( 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: return self.sslsocket_class._create( 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self.do_handshake() 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: self._sslobj.do_handshake() 2024-09-10T11:33:55.523 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:33:55.524 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:33:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:33:56.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T11:33:56.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84cf1f4640 1 Processor -- start 2024-09-10T11:33:56.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84cf1f4640 1 -- start start 2024-09-10T11:33:56.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84cf1f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84cf1f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84c81081f0 con 0x7f84c8107820 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84ccf90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84ccf90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39672/0 (socket says 172.21.15.17:39672) 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84ccf90640 1 -- 172.21.15.17:0/2454260705 learned_addr learned my addr 172.21.15.17:0/2454260705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.677+0000 7f84ccf90640 1 -- 172.21.15.17:0/2454260705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8108a20 con 0x7f84c8107820 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.678+0000 7f84ccf90640 1 --2- 172.21.15.17:0/2454260705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009820 tx=0x7f84b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93997646b1e4e878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.678+0000 7f84c77fe640 1 -- 172.21.15.17:0/2454260705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8037070 con 0x7f84c8107820 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.678+0000 7f84c77fe640 1 -- 172.21.15.17:0/2454260705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8032920 con 0x7f84c8107820 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.678+0000 7f84c77fe640 1 -- 172.21.15.17:0/2454260705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8030810 con 0x7f84c8107820 2024-09-10T11:33:56.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 -- 172.21.15.17:0/2454260705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 msgr2=0x7f84c8107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/2454260705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009820 tx=0x7f84b802a270 comp rx=0 tx=0).stop 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 -- 172.21.15.17:0/2454260705 shutdown_connections 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/2454260705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c8107c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 -- 172.21.15.17:0/2454260705 >> 172.21.15.17:0/2454260705 conn(0x7f84c8102fd0 msgr2=0x7f84c81053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 -- 172.21.15.17:0/2454260705 shutdown_connections 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 -- 172.21.15.17:0/2454260705 wait complete. 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.679+0000 7f84cf1f4640 1 Processor -- start 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84cf1f4640 1 -- start start 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84cf1f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84cf1f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84c810bdd0 con 0x7f84c8107820 2024-09-10T11:33:56.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84ccf90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84ccf90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39688/0 (socket says 172.21.15.17:39688) 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84ccf90640 1 -- 172.21.15.17:0/3714530614 learned_addr learned my addr 172.21.15.17:0/3714530614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84ccf90640 1 -- 172.21.15.17:0/3714530614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c807e8c0 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84ccf90640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097f0 tx=0x7f84b80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b8037040 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8030cc0 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c807cab0 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.680+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b803a640 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.681+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c807cff0 con 0x7f84c8107820 2024-09-10T11:33:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.681+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f84b803b3f0 con 0x7f84c8107820 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.682+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c8107ca0 con 0x7f84c8107820 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.682+0000 7f84c5ffb640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 0x7f84b003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.682+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f84b806c4a0 con 0x7f84c8107820 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.682+0000 7f84c7fff640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 0x7f84b003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.682+0000 7f84c7fff640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 0x7f84b003b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0098c0 tx=0x7f84bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.687+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84b8042dc0 con 0x7f84c8107820 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.695+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f84b8049ca0 con 0x7f84c8107820 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:55.875+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f84c807d940 con 0x7f84b0038f00 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.029+0000 7f84c5ffb640 1 -- 172.21.15.17:0/3714530614 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f84c807d940 con 0x7f84b0038f00 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 msgr2=0x7f84b003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:56.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 0x7f84b003b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0098c0 tx=0x7f84bc006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 msgr2=0x7f84c807e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097f0 tx=0x7f84b80327b0 comp rx=0 tx=0).stop 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 shutdown_connections 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84b0038f00 0x7f84b003b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 --2- 172.21.15.17:0/3714530614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8107820 0x7f84c807e380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 >> 172.21.15.17:0/3714530614 conn(0x7f84c8102fd0 msgr2=0x7f84c8103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 shutdown_connections 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:56.031+0000 7f84cf1f4640 1 -- 172.21.15.17:0/3714530614 wait complete. 2024-09-10T11:33:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-09-10T11:33:56.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:55] ENGINE Bus STARTING 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:55] ENGINE Serving on https://172.21.15.17:7150 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:55] ENGINE Error in HTTPServer.serve 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T11:33:56.937 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T11:33:56.938 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:55] ENGINE Serving on http://172.21.15.17:8765 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: [10/Sep/2024:11:33:55] ENGINE Bus STARTED 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: mgrmap e12: x(active, since 2s) 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:33:56.939 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:33:57.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:57 smithi017 ceph-mon[30817]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:33:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$I5.xovqTOaCwO9mOQVdu6.gFAZ0FMLlEMZ2P6S3fJ3G9z525kbNoC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725968037, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.025+0000 7f0348c74640 1 Processor -- start 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.025+0000 7f0348c74640 1 -- start start 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f0348c74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f0348c74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03441081f0 con 0x7f0344107820 2024-09-10T11:33:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f034259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f034259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39700/0 (socket says 172.21.15.17:39700) 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f034259c640 1 -- 172.21.15.17:0/2176415232 learned_addr learned my addr 172.21.15.17:0/2176415232 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.026+0000 7f034259c640 1 -- 172.21.15.17:0/2176415232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0344108a20 con 0x7f0344107820 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.027+0000 7f034259c640 1 --2- 172.21.15.17:0/2176415232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0334009820 tx=0x7f033402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf9eba56dd7321c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.027+0000 7f034159a640 1 -- 172.21.15.17:0/2176415232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0334037070 con 0x7f0344107820 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.027+0000 7f034159a640 1 -- 172.21.15.17:0/2176415232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0334032920 con 0x7f0344107820 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.027+0000 7f034159a640 1 -- 172.21.15.17:0/2176415232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0334030810 con 0x7f0344107820 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 -- 172.21.15.17:0/2176415232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 msgr2=0x7f0344107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 --2- 172.21.15.17:0/2176415232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0334009820 tx=0x7f033402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 -- 172.21.15.17:0/2176415232 shutdown_connections 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 --2- 172.21.15.17:0/2176415232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f0344107c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 -- 172.21.15.17:0/2176415232 >> 172.21.15.17:0/2176415232 conn(0x7f0344102fd0 msgr2=0x7f03441053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 -- 172.21.15.17:0/2176415232 shutdown_connections 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.028+0000 7f0348c74640 1 -- 172.21.15.17:0/2176415232 wait complete. 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f0348c74640 1 Processor -- start 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f0348c74640 1 -- start start 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f0348c74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f0348c74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f034410bdd0 con 0x7f0344107820 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f034259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f034259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39716/0 (socket says 172.21.15.17:39716) 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.029+0000 7f034259c640 1 -- 172.21.15.17:0/727400009 learned_addr learned my addr 172.21.15.17:0/727400009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f034259c640 1 -- 172.21.15.17:0/727400009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034419def0 con 0x7f0344107820 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f034259c640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0334030560 tx=0x7f0334032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0334037040 con 0x7f0344107820 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0334040070 con 0x7f0344107820 2024-09-10T11:33:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034419e180 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033403a740 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.030+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03441a0e70 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.031+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f033403a9b0 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.031+0000 7f03337fe640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 0x7f032c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.031+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0344107ca0 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.031+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f033406c810 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.032+0000 7f0341d9b640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 0x7f032c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.032+0000 7f0341d9b640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 0x7f032c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03380098c0 tx=0x7f0338006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.036+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0334042e30 con 0x7f0344107820 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.226+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f034419e660 con 0x7f032c038fc0 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.476+0000 7f03337fe640 1 -- 172.21.15.17:0/727400009 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f034419e660 con 0x7f032c038fc0 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 msgr2=0x7f032c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 0x7f032c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03380098c0 tx=0x7f0338006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 msgr2=0x7f034419d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0334030560 tx=0x7f0334032670 comp rx=0 tx=0).stop 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 shutdown_connections 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f032c038fc0 0x7f032c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 --2- 172.21.15.17:0/727400009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344107820 0x7f034419d9b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 >> 172.21.15.17:0/727400009 conn(0x7f0344102fd0 msgr2=0x7f0344103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 shutdown_connections 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:57.478+0000 7f0348c74640 1 -- 172.21.15.17:0/727400009 wait complete. 2024-09-10T11:33:58.138 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-09-10T11:33:59.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:33:59 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/283594477' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T11:33:59.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.886+0000 7f573a8f1640 1 Processor -- start 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.886+0000 7f573a8f1640 1 -- start start 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.886+0000 7f573a8f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.886+0000 7f573a8f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f573407d0c0 con 0x7f573407e690 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.887+0000 7f5733fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.887+0000 7f5733fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39722/0 (socket says 172.21.15.17:39722) 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.887+0000 7f5733fff640 1 -- 172.21.15.17:0/3726095796 learned_addr learned my addr 172.21.15.17:0/3726095796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.887+0000 7f5733fff640 1 -- 172.21.15.17:0/3726095796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573407d240 con 0x7f573407e690 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f5733fff640 1 --2- 172.21.15.17:0/3726095796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5724009820 tx=0x7f572402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877f30a6c0ab9a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f5732ffd640 1 -- 172.21.15.17:0/3726095796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5724037070 con 0x7f573407e690 2024-09-10T11:33:59.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f5732ffd640 1 -- 172.21.15.17:0/3726095796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5724032920 con 0x7f573407e690 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f5732ffd640 1 -- 172.21.15.17:0/3726095796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5724030810 con 0x7f573407e690 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 -- 172.21.15.17:0/3726095796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 msgr2=0x7f573407caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 --2- 172.21.15.17:0/3726095796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5724009820 tx=0x7f572402a270 comp rx=0 tx=0).stop 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 -- 172.21.15.17:0/3726095796 shutdown_connections 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 --2- 172.21.15.17:0/3726095796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573407caf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 -- 172.21.15.17:0/3726095796 >> 172.21.15.17:0/3726095796 conn(0x7f5734102fd0 msgr2=0x7f57341053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.888+0000 7f573a8f1640 1 -- 172.21.15.17:0/3726095796 shutdown_connections 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.889+0000 7f573a8f1640 1 -- 172.21.15.17:0/3726095796 wait complete. 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.889+0000 7f573a8f1640 1 Processor -- start 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.889+0000 7f573a8f1640 1 -- start start 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.889+0000 7f573a8f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.889+0000 7f573a8f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f573410de40 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f5733fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f5733fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39736/0 (socket says 172.21.15.17:39736) 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f5733fff640 1 -- 172.21.15.17:0/283594477 learned_addr learned my addr 172.21.15.17:0/283594477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f5733fff640 1 -- 172.21.15.17:0/283594477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573419dee0 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f5733fff640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5724030380 tx=0x7f5724032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5724037040 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5724040070 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573419e170 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f572403a7b0 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.890+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57341a0e60 con 0x7f573407e690 2024-09-10T11:33:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.891+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f572403aa30 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.891+0000 7f57317fa640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 0x7f571c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.891+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573407cb70 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.891+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f572406c750 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.892+0000 7f57337fe640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 0x7f571c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.892+0000 7f57337fe640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 0x7f571c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57280098c0 tx=0x7f5728006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:58.896+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5724044c70 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.072+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f57341a1030 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.072+0000 7f57317fa640 1 -- 172.21.15.17:0/283594477 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f5724041270 con 0x7f573407e690 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 msgr2=0x7f571c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 0x7f571c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57280098c0 tx=0x7f5728006db0 comp rx=0 tx=0).stop 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 msgr2=0x7f573419d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5724030380 tx=0x7f5724032670 comp rx=0 tx=0).stop 2024-09-10T11:33:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 shutdown_connections 2024-09-10T11:33:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f571c038fc0 0x7f571c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 --2- 172.21.15.17:0/283594477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f573407e690 0x7f573419d9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:33:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 >> 172.21.15.17:0/283594477 conn(0x7f5734102fd0 msgr2=0x7f5734103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:33:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 shutdown_connections 2024-09-10T11:33:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:33:59.074+0000 7f573a8f1640 1 -- 172.21.15.17:0/283594477 wait complete. 2024-09-10T11:33:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T11:33:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-10T11:33:59.634 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T11:33:59.634 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-10T11:33:59.634 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-10T11:33:59.634 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T11:33:59.635 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout: Password: 7umnjku170 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:33:59.636 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config directory 2024-09-10T11:34:00.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe5de4d640 1 Processor -- start 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe5de4d640 1 -- start start 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe5de4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe5de4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe58107100 con 0x7efe58106730 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39746/0 (socket says 172.21.15.17:39746) 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.027+0000 7efe577fe640 1 -- 172.21.15.17:0/1163719008 learned_addr learned my addr 172.21.15.17:0/1163719008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.028+0000 7efe577fe640 1 -- 172.21.15.17:0/1163719008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe58107930 con 0x7efe58106730 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.028+0000 7efe577fe640 1 --2- 172.21.15.17:0/1163719008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe48009820 tx=0x7efe4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96b2ed1b1f46e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:00.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.028+0000 7efe56ffd640 1 -- 172.21.15.17:0/1163719008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48037070 con 0x7efe58106730 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe56ffd640 1 -- 172.21.15.17:0/1163719008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe48032920 con 0x7efe58106730 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe56ffd640 1 -- 172.21.15.17:0/1163719008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48030810 con 0x7efe58106730 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 -- 172.21.15.17:0/1163719008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 msgr2=0x7efe58106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 --2- 172.21.15.17:0/1163719008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe48009820 tx=0x7efe4802a270 comp rx=0 tx=0).stop 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 -- 172.21.15.17:0/1163719008 shutdown_connections 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 --2- 172.21.15.17:0/1163719008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe58106b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 -- 172.21.15.17:0/1163719008 >> 172.21.15.17:0/1163719008 conn(0x7efe58101ee0 msgr2=0x7efe58104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 -- 172.21.15.17:0/1163719008 shutdown_connections 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.029+0000 7efe5de4d640 1 -- 172.21.15.17:0/1163719008 wait complete. 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe5de4d640 1 Processor -- start 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe5de4d640 1 -- start start 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe5de4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:00.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe5de4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe5810ace0 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe577fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39754/0 (socket says 172.21.15.17:39754) 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.030+0000 7efe577fe640 1 -- 172.21.15.17:0/394871893 learned_addr learned my addr 172.21.15.17:0/394871893 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe577fe640 1 -- 172.21.15.17:0/394871893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5819e580 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe577fe640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe48030560 tx=0x7efe48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe48037040 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5819e750 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe48040070 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4803a740 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.031+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5819eaf0 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.032+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7efe4803a8e0 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.032+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe58106bb0 con 0x7efe58106730 2024-09-10T11:34:00.851 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.032+0000 7efe557fa640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 0x7efe4403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.032+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efe4806c940 con 0x7efe58106730 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.032+0000 7efe4effd640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 0x7efe4403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.033+0000 7efe4effd640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 0x7efe4403b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe400098c0 tx=0x7efe40006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.037+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe48044c70 con 0x7efe58106730 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.125+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efe4803acd0 con 0x7efe58106730 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.304+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7efe5819f380 con 0x7efe58106730 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.306+0000 7efe557fa640 1 -- 172.21.15.17:0/394871893 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7efe48041270 con 0x7efe58106730 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 msgr2=0x7efe4403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 0x7efe4403b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe400098c0 tx=0x7efe40006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 msgr2=0x7efe5807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:00.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe48030560 tx=0x7efe48032670 comp rx=0 tx=0).stop 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 shutdown_connections 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efe44039020 0x7efe4403b4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.308+0000 7efe5de4d640 1 --2- 172.21.15.17:0/394871893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe58106730 0x7efe5807c260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.309+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 >> 172.21.15.17:0/394871893 conn(0x7efe58101ee0 msgr2=0x7efe58102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.309+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 shutdown_connections 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-09-10T11:34:00.309+0000 7efe5de4d640 1 -- 172.21.15.17:0/394871893 wait complete. 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T11:34:00.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:00.854 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-09-10T11:34:00.887 INFO:tasks.cephadm:Fetching config... 2024-09-10T11:34:00.888 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:00.888 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T11:34:00.904 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T11:34:00.905 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:00.905 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T11:34:00.961 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T11:34:00.961 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:00.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T11:34:01.028 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T11:34:01.028 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:01.028 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T11:34:01.085 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T11:34:01.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T11:34:01.160 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:01.174 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T11:34:01.214 INFO:teuthology.orchestra.run.smithi026.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:01.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T11:34:01.268 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi7+OwwsuBK2vPpMhPi9NTZ7oI538ZDV1g1X2llIOtYhg0+lHNV3uJcvviUZD3YG2cmRnYr4c4Ah09Nauo/CxTU2VKXW0y1r7cdNHCrY/H4EWER/9yQMnita1RxnFn1oSjQmng12QmCgbzdc8LhykJoEoV95HCPTr/wqK1VA2gkMvffXjymuO8e2Us11k//itpA1Q3muHm9ztIBQat3WkN4eLzxwnwXhZMRF/ZVE8B17f/C3IeYk1oyjxEcZEtOX8KILipMj4hd1r3sDTNFrWxprJ1cs3mG0FYrTRBn0jDwPf9oO5gTKblBKxkclbqDW8+QGZqrhFw9sl/7KNmmCC5F3IS+QgdY9kuUqb3kUYAIYrmFzo2CGqSND9KD1H9tnU8W4QTv9p7rhDEggbmoUk3BqmsF5j0iOt3IRTCTecwniJ1j8HTMV35DmRJzids9nSzlguEQ8kVAcMu36s73CK5oW5zFh9houeTid8fzo8ooEwG1YImdLdCdJYL1jix1F8= ceph-44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:01.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T11:34:01.386 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:01 smithi017 ceph-mon[30817]: mgrmap e13: x(active, since 6s) 2024-09-10T11:34:01.386 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:01 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/394871893' entity='client.admin' 2024-09-10T11:34:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- 172.21.15.17:0/801526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 msgr2=0x7f3bdc101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 --2- 172.21.15.17:0/801526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009880 tx=0x7f3bd802a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- 172.21.15.17:0/801526602 shutdown_connections 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 --2- 172.21.15.17:0/801526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- 172.21.15.17:0/801526602 >> 172.21.15.17:0/801526602 conn(0x7f3bdc0fcdb0 msgr2=0x7f3bdc0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- 172.21.15.17:0/801526602 shutdown_connections 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- 172.21.15.17:0/801526602 wait complete. 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 Processor -- start 2024-09-10T11:34:02.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.023+0000 7f3be3889640 1 -- start start 2024-09-10T11:34:02.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be3889640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:02.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be3889640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc107710 con 0x7f3bdc101600 2024-09-10T11:34:02.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be1625640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:02.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be1625640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54020/0 (socket says 172.21.15.17:54020) 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be1625640 1 -- 172.21.15.17:0/134997073 learned_addr learned my addr 172.21.15.17:0/134997073 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be1625640 1 -- 172.21.15.17:0/134997073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0763f0 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be1625640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8004f60 tx=0x7f3bd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd803f070 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd8004d40 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd8035030 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc0745e0 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.024+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc074b20 con 0x7f3bdc101600 2024-09-10T11:34:02.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.025+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3bd8042070 con 0x7f3bdc101600 2024-09-10T11:34:02.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.026+0000 7f3bd27fc640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 0x7f3bc803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:02.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.026+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3bd806cca0 con 0x7f3bdc101600 2024-09-10T11:34:02.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.026+0000 7f3be0e24640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 0x7f3bc803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:02.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.026+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc107e90 con 0x7f3bdc101600 2024-09-10T11:34:02.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.026+0000 7f3be0e24640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 0x7f3bc803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098c0 tx=0x7f3bcc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:02.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.031+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3bd804a260 con 0x7f3bdc101600 2024-09-10T11:34:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.229+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f3bdc190040 con 0x7f3bdc101600 2024-09-10T11:34:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.233+0000 7f3bd27fc640 1 -- 172.21.15.17:0/134997073 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f3bd80035f0 con 0x7f3bdc101600 2024-09-10T11:34:02.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 msgr2=0x7f3bc803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:02.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 0x7f3bc803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098c0 tx=0x7f3bcc006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 msgr2=0x7f3bdc075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:02.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8004f60 tx=0x7f3bd80048f0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 shutdown_connections 2024-09-10T11:34:02.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3bc80390c0 0x7f3bc803b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 --2- 172.21.15.17:0/134997073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bdc101600 0x7f3bdc075eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:02.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 >> 172.21.15.17:0/134997073 conn(0x7f3bdc0fcdb0 msgr2=0x7f3bdc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:02.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 shutdown_connections 2024-09-10T11:34:02.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:02.235+0000 7f3be3889640 1 -- 172.21.15.17:0/134997073 wait complete. 2024-09-10T11:34:02.806 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T11:34:02.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T11:34:03.254 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:03.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:03 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/134997073' entity='client.admin' 2024-09-10T11:34:03.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:03.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:03.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:34:03.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 -- 172.21.15.17:0/3977479606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 msgr2=0x7fcbd0101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 --2- 172.21.15.17:0/3977479606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0101a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009880 tx=0x7fcbc002a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 -- 172.21.15.17:0/3977479606 shutdown_connections 2024-09-10T11:34:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 --2- 172.21.15.17:0/3977479606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0101a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 -- 172.21.15.17:0/3977479606 >> 172.21.15.17:0/3977479606 conn(0x7fcbd00fcdb0 msgr2=0x7fcbd00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 -- 172.21.15.17:0/3977479606 shutdown_connections 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.005+0000 7fcbd851b640 1 -- 172.21.15.17:0/3977479606 wait complete. 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd851b640 1 Processor -- start 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd851b640 1 -- start start 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd851b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd851b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0107710 con 0x7fcbd0101600 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd62b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd62b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54042/0 (socket says 172.21.15.17:54042) 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd62b7640 1 -- 172.21.15.17:0/809680851 learned_addr learned my addr 172.21.15.17:0/809680851 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.006+0000 7fcbd62b7640 1 -- 172.21.15.17:0/809680851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00763f0 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbd62b7640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0004f60 tx=0x7fcbc00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc003f070 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbc0004cc0 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd00745e0 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc0035030 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.007+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd0074b20 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.008+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcbc0042070 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.008+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd0107e90 con 0x7fcbd0101600 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.008+0000 7fcbcf7fe640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 0x7fcbb803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.008+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcbc006cd40 con 0x7fcbd0101600 2024-09-10T11:34:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.008+0000 7fcbd5ab6640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 0x7fcbb803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.009+0000 7fcbd5ab6640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 0x7fcbb803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098c0 tx=0x7fcbc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:04.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.013+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbc003a3c0 con 0x7fcbd0101600 2024-09-10T11:34:04.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.196+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fcbd01901d0 con 0x7fcbb80390c0 2024-09-10T11:34:04.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.199+0000 7fcbcf7fe640 1 -- 172.21.15.17:0/809680851 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcbd01901d0 con 0x7fcbb80390c0 2024-09-10T11:34:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 msgr2=0x7fcbb803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 0x7fcbb803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098c0 tx=0x7fcbc4006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 msgr2=0x7fcbd0075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0004f60 tx=0x7fcbc00048f0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 shutdown_connections 2024-09-10T11:34:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcbb80390c0 0x7fcbb803b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 --2- 172.21.15.17:0/809680851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd0101600 0x7fcbd0075eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 >> 172.21.15.17:0/809680851 conn(0x7fcbd00fcdb0 msgr2=0x7fcbd00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 shutdown_connections 2024-09-10T11:34:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:04.202+0000 7fcbd851b640 1 -- 172.21.15.17:0/809680851 wait complete. 2024-09-10T11:34:04.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:04.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:04.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:04.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:04.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:04.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:04.935 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi026 2024-09-10T11:34:04.936 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:34:04.936 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/etc/ceph/ceph.conf 2024-09-10T11:34:04.955 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:34:04.955 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:05.014 INFO:tasks.cephadm:Adding host smithi026 to orchestrator... 2024-09-10T11:34:05.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch host add smithi026 2024-09-10T11:34:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:05 smithi017 ceph-mon[30817]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:05 smithi017 ceph-mon[30817]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-10T11:34:05.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:05.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:05.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:05.618 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 -- 172.21.15.17:0/4129970333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 msgr2=0x7f8b5c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/4129970333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c102b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009c10 tx=0x7f8b4c02aa10 comp rx=0 tx=0).stop 2024-09-10T11:34:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 -- 172.21.15.17:0/4129970333 shutdown_connections 2024-09-10T11:34:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/4129970333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c102b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 -- 172.21.15.17:0/4129970333 >> 172.21.15.17:0/4129970333 conn(0x7f8b5c077310 msgr2=0x7f8b5c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 -- 172.21.15.17:0/4129970333 shutdown_connections 2024-09-10T11:34:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 -- 172.21.15.17:0/4129970333 wait complete. 2024-09-10T11:34:06.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.059+0000 7f8b61bcb640 1 Processor -- start 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b61bcb640 1 -- start start 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b61bcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b61bcb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c10bc80 con 0x7f8b5c102730 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54060/0 (socket says 172.21.15.17:54060) 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b5b7fe640 1 -- 172.21.15.17:0/214689061 learned_addr learned my addr 172.21.15.17:0/214689061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b5b7fe640 1 -- 172.21.15.17:0/214689061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c1976f0 con 0x7f8b5c102730 2024-09-10T11:34:06.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.060+0000 7f8b5b7fe640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005dd0 tx=0x7f8b4c030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.061+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b4c034070 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.061+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b4c02f8c0 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.061+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c197980 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.061+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b4c004520 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.061+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c197d20 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8b4c037020 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c069f90 con 0x7f8b5c102730 2024-09-10T11:34:06.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b58ff9640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 0x7f8b4803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b4c06d3d0 con 0x7f8b5c102730 2024-09-10T11:34:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b5affd640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 0x7f8b4803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.062+0000 7f8b5affd640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 0x7f8b4803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098c0 tx=0x7f8b44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:06.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.067+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b4c03f070 con 0x7f8b5c102730 2024-09-10T11:34:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:06.245+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi026", "target": ["mon-mgr", ""]}) -- 0x7f8b5c198510 con 0x7f8b48039060 2024-09-10T11:34:06.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:06 smithi017 ceph-mon[30817]: Updating smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:06.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:06 smithi017 ceph-mon[30817]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:06.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:06 smithi017 ceph-mon[30817]: Updating smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:34:07.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:07 smithi017 ceph-mon[30817]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi026", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:08.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:08 smithi017 ceph-mon[30817]: Deploying cephadm binary to smithi026 2024-09-10T11:34:10.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.143+0000 7f8b58ff9640 1 -- 172.21.15.17:0/214689061 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8b5c198510 con 0x7f8b48039060 2024-09-10T11:34:10.145 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi026' with addr '172.21.15.26' 2024-09-10T11:34:10.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 msgr2=0x7f8b4803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 0x7f8b4803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098c0 tx=0x7f8b44006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 msgr2=0x7f8b5c1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005dd0 tx=0x7f8b4c030c30 comp rx=0 tx=0).stop 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 shutdown_connections 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8b48039060 0x7f8b4803b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 --2- 172.21.15.17:0/214689061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b5c102730 0x7f8b5c1971b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 >> 172.21.15.17:0/214689061 conn(0x7f8b5c077310 msgr2=0x7f8b5c1054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 shutdown_connections 2024-09-10T11:34:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:10.146+0000 7f8b61bcb640 1 -- 172.21.15.17:0/214689061 wait complete. 2024-09-10T11:34:10.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T11:34:11.022 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:11.399 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:11.399 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:11 smithi017 ceph-mon[30817]: Added host smithi026 2024-09-10T11:34:11.399 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:11.399 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:11.399 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 -- 172.21.15.17:0/245981861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 msgr2=0x7fde34102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 --2- 172.21.15.17:0/245981861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde34102b40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde30009880 tx=0x7fde3002a670 comp rx=0 tx=0).stop 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 -- 172.21.15.17:0/245981861 shutdown_connections 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 --2- 172.21.15.17:0/245981861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde34102b40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 -- 172.21.15.17:0/245981861 >> 172.21.15.17:0/245981861 conn(0x7fde340fc1a0 msgr2=0x7fde340fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 -- 172.21.15.17:0/245981861 shutdown_connections 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 -- 172.21.15.17:0/245981861 wait complete. 2024-09-10T11:34:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.589+0000 7fde3b980640 1 Processor -- start 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3b980640 1 -- start start 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3b980640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3b980640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde3410bcd0 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3971c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3971c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43798/0 (socket says 172.21.15.17:43798) 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3971c640 1 -- 172.21.15.17:0/3247359695 learned_addr learned my addr 172.21.15.17:0/3247359695 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3971c640 1 -- 172.21.15.17:0/3247359695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde34197720 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.590+0000 7fde3971c640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde30009230 tx=0x7fde30003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3003f070 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde341979b0 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde3003bc80 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30035030 con 0x7fde34102760 2024-09-10T11:34:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde34197e10 con 0x7fde34102760 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.591+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fde30042070 con 0x7fde34102760 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.592+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3406a7b0 con 0x7fde34102760 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.592+0000 7fde2a7fc640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 0x7fde2003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.592+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fde3006cd40 con 0x7fde34102760 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.592+0000 7fde38f1b640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 0x7fde2003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.592+0000 7fde38f1b640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 0x7fde2003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde240098c0 tx=0x7fde24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.596+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde300372d0 con 0x7fde34102760 2024-09-10T11:34:11.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.776+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde34198540 con 0x7fde20039060 2024-09-10T11:34:11.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.778+0000 7fde2a7fc640 1 -- 172.21.15.17:0/3247359695 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fde34198540 con 0x7fde20039060 2024-09-10T11:34:11.779 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:11.779 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}] 2024-09-10T11:34:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 msgr2=0x7fde2003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 0x7fde2003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde240098c0 tx=0x7fde24006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 msgr2=0x7fde341971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde30009230 tx=0x7fde30003d40 comp rx=0 tx=0).stop 2024-09-10T11:34:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 shutdown_connections 2024-09-10T11:34:11.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde20039060 0x7fde2003b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:11.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 --2- 172.21.15.17:0/3247359695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde34102760 0x7fde341971e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:11.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 >> 172.21.15.17:0/3247359695 conn(0x7fde340fc1a0 msgr2=0x7fde34105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:11.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 shutdown_connections 2024-09-10T11:34:11.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:11.780+0000 7fde3b980640 1 -- 172.21.15.17:0/3247359695 wait complete. 2024-09-10T11:34:12.355 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi081 2024-09-10T11:34:12.356 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:34:12.356 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.conf 2024-09-10T11:34:12.376 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:34:12.376 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:12.434 INFO:tasks.cephadm:Adding host smithi081 to orchestrator... 2024-09-10T11:34:12.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch host add smithi081 2024-09-10T11:34:12.684 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:12.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:12.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:12 smithi017 ceph-mon[30817]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 -- 172.21.15.17:0/1054953867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 msgr2=0x7fad6c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 --2- 172.21.15.17:0/1054953867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009880 tx=0x7fad5c02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 -- 172.21.15.17:0/1054953867 shutdown_connections 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 --2- 172.21.15.17:0/1054953867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 -- 172.21.15.17:0/1054953867 >> 172.21.15.17:0/1054953867 conn(0x7fad6c0fc1b0 msgr2=0x7fad6c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 -- 172.21.15.17:0/1054953867 shutdown_connections 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.094+0000 7fad70eed640 1 -- 172.21.15.17:0/1054953867 wait complete. 2024-09-10T11:34:13.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.095+0000 7fad70eed640 1 Processor -- start 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.095+0000 7fad70eed640 1 -- start start 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad70eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad70eed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10ab90 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad6a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad6a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43826/0 (socket says 172.21.15.17:43826) 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad6a59c640 1 -- 172.21.15.17:0/89763311 learned_addr learned my addr 172.21.15.17:0/89763311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad6a59c640 1 -- 172.21.15.17:0/89763311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c0fe550 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad6a59c640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009230 tx=0x7fad5c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c03f070 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad5c03bc80 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c035030 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c0fcba0 con 0x7fad6c106560 2024-09-10T11:34:13.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.096+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c0fd060 con 0x7fad6c106560 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.097+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fad5c042070 con 0x7fad6c106560 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.097+0000 7fad5b7fe640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 0x7fad5403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.097+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fad5c06cd50 con 0x7fad6c106560 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.098+0000 7fad69d9b640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 0x7fad5403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.098+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c101bd0 con 0x7fad6c106560 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.098+0000 7fad69d9b640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 0x7fad5403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad600098c0 tx=0x7fad60006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:13.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.102+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad5c04c350 con 0x7fad6c106560 2024-09-10T11:34:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:13.280+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}) -- 0x7fad6c0fdb90 con 0x7fad54039060 2024-09-10T11:34:14.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:14.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: Updating smithi026:/etc/ceph/ceph.conf 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: Deploying cephadm binary to smithi081 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: Updating smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: Updating smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:16.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:17.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.095+0000 7fad5b7fe640 1 -- 172.21.15.17:0/89763311 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fad6c0fdb90 con 0x7fad54039060 2024-09-10T11:34:17.097 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi081' with addr '172.21.15.81' 2024-09-10T11:34:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 msgr2=0x7fad5403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 0x7fad5403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad600098c0 tx=0x7fad60006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 msgr2=0x7fad6c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009230 tx=0x7fad5c003d40 comp rx=0 tx=0).stop 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 shutdown_connections 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fad54039060 0x7fad5403b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 --2- 172.21.15.17:0/89763311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad6c106560 0x7fad6c0fc660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 >> 172.21.15.17:0/89763311 conn(0x7fad6c0fc1b0 msgr2=0x7fad6c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 shutdown_connections 2024-09-10T11:34:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:17.097+0000 7fad70eed640 1 -- 172.21.15.17:0/89763311 wait complete. 2024-09-10T11:34:17.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:17 smithi017 ceph-mon[30817]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:17.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:17.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:17.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T11:34:17.971 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:18.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:18 smithi017 ceph-mon[30817]: Added host smithi081 2024-09-10T11:34:18.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:18.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:18.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 -- 172.21.15.17:0/871485601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 msgr2=0x7fd09c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/871485601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009880 tx=0x7fd08c02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 -- 172.21.15.17:0/871485601 shutdown_connections 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/871485601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 -- 172.21.15.17:0/871485601 >> 172.21.15.17:0/871485601 conn(0x7fd09c0fc1b0 msgr2=0x7fd09c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 -- 172.21.15.17:0/871485601 shutdown_connections 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.426+0000 7fd0a12e1640 1 -- 172.21.15.17:0/871485601 wait complete. 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd0a12e1640 1 Processor -- start 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd0a12e1640 1 -- start start 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd0a12e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd0a12e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c10ab90 con 0x7fd09c106560 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd09affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd09affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43846/0 (socket says 172.21.15.17:43846) 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.427+0000 7fd09affd640 1 -- 172.21.15.17:0/3909980452 learned_addr learned my addr 172.21.15.17:0/3909980452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd09affd640 1 -- 172.21.15.17:0/3909980452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c196570 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd09affd640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009230 tx=0x7fd08c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c03f070 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c196800 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd08c03bc80 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c035030 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.428+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c19a900 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd08c042070 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c101bd0 con 0x7fd09c106560 2024-09-10T11:34:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd098ff9640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 0x7fd08803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd08c06ccb0 con 0x7fd09c106560 2024-09-10T11:34:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd093fff640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 0x7fd08803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.429+0000 7fd093fff640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 0x7fd08803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0840098c0 tx=0x7fd084006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.434+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd08c04c350 con 0x7fd09c106560 2024-09-10T11:34:18.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.614+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd09c197390 con 0x7fd088039060 2024-09-10T11:34:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.615+0000 7fd098ff9640 1 -- 172.21.15.17:0/3909980452 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fd09c197390 con 0x7fd088039060 2024-09-10T11:34:18.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:18.617 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}] 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 msgr2=0x7fd08803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 0x7fd08803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0840098c0 tx=0x7fd084006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 msgr2=0x7fd09c196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009230 tx=0x7fd08c003d40 comp rx=0 tx=0).stop 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 shutdown_connections 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd088039060 0x7fd08803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 --2- 172.21.15.17:0/3909980452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c106560 0x7fd09c196030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 >> 172.21.15.17:0/3909980452 conn(0x7fd09c0fc1b0 msgr2=0x7fd09c0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 shutdown_connections 2024-09-10T11:34:18.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:18.617+0000 7fd0a12e1640 1 -- 172.21.15.17:0/3909980452 wait complete. 2024-09-10T11:34:19.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:19 smithi017 ceph-mon[30817]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:19.155 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:19.156 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T11:34:19.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T11:34:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.852+0000 7fc79abb2640 1 -- 172.21.15.17:0/673124676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 msgr2=0x7fc794102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.852+0000 7fc79abb2640 1 --2- 172.21.15.17:0/673124676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc784009810 tx=0x7fc78402a540 comp rx=0 tx=0).stop 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- 172.21.15.17:0/673124676 shutdown_connections 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 --2- 172.21.15.17:0/673124676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- 172.21.15.17:0/673124676 >> 172.21.15.17:0/673124676 conn(0x7fc794077310 msgr2=0x7fc7940fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- 172.21.15.17:0/673124676 shutdown_connections 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- 172.21.15.17:0/673124676 wait complete. 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 Processor -- start 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- start start 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.853+0000 7fc79abb2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc79410bc80 con 0x7fc794102730 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79894e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79894e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43872/0 (socket says 172.21.15.17:43872) 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79894e640 1 -- 172.21.15.17:0/4098216435 learned_addr learned my addr 172.21.15.17:0/4098216435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79894e640 1 -- 172.21.15.17:0/4098216435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794199950 con 0x7fc794102730 2024-09-10T11:34:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79894e640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7840045e0 tx=0x7fc784004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc784030e70 con 0x7fc794102730 2024-09-10T11:34:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7840318e0 con 0x7fc794102730 2024-09-10T11:34:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc794199be0 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.854+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7840049c0 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.855+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79419a040 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.855+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc784039040 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.856+0000 7fc791ffb640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 0x7fc77c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.856+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc794069f90 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.856+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc78406e290 con 0x7fc794102730 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.856+0000 7fc793fff640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 0x7fc77c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.856+0000 7fc793fff640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 0x7fc77c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7880098c0 tx=0x7fc788006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:19.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:19.860+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc784040030 con 0x7fc794102730 2024-09-10T11:34:20.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.041+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc79419a770 con 0x7fc794102730 2024-09-10T11:34:20.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.131+0000 7fc791ffb640 1 -- 172.21.15.17:0/4098216435 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fc78404c990 con 0x7fc794102730 2024-09-10T11:34:20.133 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 msgr2=0x7fc77c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 0x7fc77c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7880098c0 tx=0x7fc788006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 msgr2=0x7fc794199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7840045e0 tx=0x7fc784004610 comp rx=0 tx=0).stop 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 shutdown_connections 2024-09-10T11:34:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc77c039060 0x7fc77c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:20.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 --2- 172.21.15.17:0/4098216435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc794102730 0x7fc794199410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:20.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 >> 172.21.15.17:0/4098216435 conn(0x7fc794077310 msgr2=0x7fc7941078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:20.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 shutdown_connections 2024-09-10T11:34:20.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:20.134+0000 7fc79abb2640 1 -- 172.21.15.17:0/4098216435 wait complete. 2024-09-10T11:34:20.459 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:20 smithi017 ceph-mon[30817]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:34:20.460 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:20 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4098216435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T11:34:20.773 INFO:tasks.cephadm:Adding mon.a on smithi017 2024-09-10T11:34:20.773 INFO:tasks.cephadm:Adding mon.b on smithi026 2024-09-10T11:34:20.773 INFO:tasks.cephadm:Adding mon.c on smithi081 2024-09-10T11:34:20.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi026:172.21.15.26=b;smithi081:172.21.15.81=c' 2024-09-10T11:34:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T11:34:21.300 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T11:34:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:21 smithi017 ceph-mon[30817]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:21 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4098216435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T11:34:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:21 smithi017 ceph-mon[30817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- 172.21.15.81:0/3022917024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 msgr2=0x7f4be0101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 --2- 172.21.15.81:0/3022917024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0101a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009880 tx=0x7f4bd002a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- 172.21.15.81:0/3022917024 shutdown_connections 2024-09-10T11:34:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 --2- 172.21.15.81:0/3022917024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0101a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- 172.21.15.81:0/3022917024 >> 172.21.15.81:0/3022917024 conn(0x7f4be00fcdb0 msgr2=0x7f4be00ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- 172.21.15.81:0/3022917024 shutdown_connections 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- 172.21.15.81:0/3022917024 wait complete. 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 Processor -- start 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.829+0000 7f4be58b5640 1 -- start start 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4be58b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4be58b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4be0107730 con 0x7f4be0101620 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4bdeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4bdeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.81:54554/0 (socket says 172.21.15.81:54554) 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4bdeffd640 1 -- 172.21.15.81:0/2812981277 learned_addr learned my addr 172.21.15.81:0/2812981277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.830+0000 7f4bdeffd640 1 -- 172.21.15.81:0/2812981277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be00763f0 con 0x7f4be0101620 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4bdeffd640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0004f60 tx=0x7f4bd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd003f070 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bd0004d40 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be00745e0 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0035030 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.831+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be0074b20 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4bd0042070 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be0107eb0 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4be48b3640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 0x7f4bc803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4bd006cdc0 con 0x7f4be0101620 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4bde7fc640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 0x7f4bc803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.832+0000 7f4bde7fc640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 0x7f4bc803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40098c0 tx=0x7f4bd4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:21.837+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bd0042360 con 0x7f4be0101620 2024-09-10T11:34:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.029+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi026:172.21.15.26=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}) -- 0x7f4be01902a0 con 0x7f4bc8039060 2024-09-10T11:34:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.035+0000 7f4be48b3640 1 -- 172.21.15.81:0/2812981277 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4be01902a0 con 0x7f4bc8039060 2024-09-10T11:34:22.036 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mon update... 2024-09-10T11:34:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 msgr2=0x7f4bc803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 0x7f4bc803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40098c0 tx=0x7f4bd4006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 msgr2=0x7f4be0075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0004f60 tx=0x7f4bd00048f0 comp rx=0 tx=0).stop 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 shutdown_connections 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4bc8039060 0x7f4bc803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 --2- 172.21.15.81:0/2812981277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4be0101620 0x7f4be0075eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 >> 172.21.15.81:0/2812981277 conn(0x7f4be00fcdb0 msgr2=0x7f4be00fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 shutdown_connections 2024-09-10T11:34:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:22.037+0000 7f4be58b5640 1 -- 172.21.15.81:0/2812981277 wait complete. 2024-09-10T11:34:22.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:22.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:22.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:22.629 DEBUG:teuthology.orchestra.run.smithi026:mon.b> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T11:34:22.631 DEBUG:teuthology.orchestra.run.smithi081:mon.c> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T11:34:22.634 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T11:34:22.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T11:34:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: Updating smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: Updating smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi026:172.21.15.26=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi026:172.21.15.26=b;smithi081:172.21.15.81=c;count:3 2024-09-10T11:34:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:23 smithi017 ceph-mon[30817]: Deploying daemon mon.c on smithi081 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 -- 172.21.15.81:0/3832795306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 msgr2=0x7fe7e0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 --2- 172.21.15.81:0/3832795306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009880 tx=0x7fe7dc02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 -- 172.21.15.81:0/3832795306 shutdown_connections 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 --2- 172.21.15.81:0/3832795306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 -- 172.21.15.81:0/3832795306 >> 172.21.15.81:0/3832795306 conn(0x7fe7e00fc1b0 msgr2=0x7fe7e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 -- 172.21.15.81:0/3832795306 shutdown_connections 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.729+0000 7fe7e8263640 1 -- 172.21.15.81:0/3832795306 wait complete. 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e8263640 1 Processor -- start 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e8263640 1 -- start start 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e8263640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e8263640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e010ab90 con 0x7fe7e0106560 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e5fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e5fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.81:54572/0 (socket says 172.21.15.81:54572) 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.730+0000 7fe7e5fff640 1 -- 172.21.15.81:0/1736248519 learned_addr learned my addr 172.21.15.81:0/1736248519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7e5fff640 1 -- 172.21.15.81:0/1736248519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e0198490 con 0x7fe7e0106560 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7e5fff640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009230 tx=0x7fe7dc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc03f070 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e0198720 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e0198b80 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7dc03bc80 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.731+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc049060 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.732+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c4005290 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.732+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe7dc042070 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.732+0000 7fe7d6ffd640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 0x7fe7cc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.732+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe7dc06cd30 con 0x7fe7e0106560 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.732+0000 7fe7e57fe640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 0x7fe7cc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:23.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.733+0000 7fe7e57fe640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 0x7fe7cc03b580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00098c0 tx=0x7fe7d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.738+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7dc03ae10 con 0x7fe7e0106560 2024-09-10T11:34:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.975+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe7c4005580 con 0x7fe7e0106560 2024-09-10T11:34:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.976+0000 7fe7d6ffd640 1 -- 172.21.15.81:0/1736248519 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fe7dc04adc0 con 0x7fe7e0106560 2024-09-10T11:34:23.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:34:23.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","modified":"2024-09-10T11:32:55.302750Z","created":"2024-09-10T11:32:55.302750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T11:34:23.978 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 1 2024-09-10T11:34:23.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 msgr2=0x7fe7cc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 0x7fe7cc03b580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00098c0 tx=0x7fe7d0006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 msgr2=0x7fe7e0197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009230 tx=0x7fe7dc003d40 comp rx=0 tx=0).stop 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 shutdown_connections 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe7cc0390c0 0x7fe7cc03b580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 --2- 172.21.15.81:0/1736248519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7e0106560 0x7fe7e0197f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 >> 172.21.15.81:0/1736248519 conn(0x7fe7e00fc1b0 msgr2=0x7fe7e00fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 shutdown_connections 2024-09-10T11:34:23.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:23.978+0000 7fe7e8263640 1 -- 172.21.15.81:0/1736248519 wait complete. 2024-09-10T11:34:24.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:24 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/1736248519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:25 smithi017 ceph-mon[30817]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:25.725 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T11:34:25.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T11:34:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:34:26.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 -- 172.21.15.81:0/987688149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 msgr2=0x7f55301012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 --2- 172.21.15.81:0/987688149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f55301012c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5520009880 tx=0x7f552002a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 -- 172.21.15.81:0/987688149 shutdown_connections 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 --2- 172.21.15.81:0/987688149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f55301012c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 -- 172.21.15.81:0/987688149 >> 172.21.15.81:0/987688149 conn(0x7f55300fb9a0 msgr2=0x7f55300fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 -- 172.21.15.81:0/987688149 shutdown_connections 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.541+0000 7f553689f640 1 -- 172.21.15.81:0/987688149 wait complete. 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.542+0000 7f553689f640 1 Processor -- start 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.542+0000 7f553689f640 1 -- start start 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.542+0000 7f553689f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:26.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.542+0000 7f553689f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f553010ac10 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.81:54588/0 (socket says 172.21.15.81:54588) 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552ffff640 1 -- 172.21.15.81:0/2786909072 learned_addr learned my addr 172.21.15.81:0/2786909072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552ffff640 1 -- 172.21.15.81:0/2786909072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5530198640 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552ffff640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5520009230 tx=0x7f5520003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552003f070 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5530198930 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f552003bc80 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5520035030 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.543+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5530198df0 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.544+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5520042070 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.544+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5530101ea0 con 0x7f5530100ee0 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.545+0000 7f552d7fa640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 0x7f551c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:26.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.545+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f552006cd10 con 0x7f5530100ee0 2024-09-10T11:34:26.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.545+0000 7f552f7fe640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 0x7f551c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:26.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.545+0000 7f552f7fe640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 0x7f551c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55180098c0 tx=0x7f5518006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:26.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.550+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5520072020 con 0x7f5530100ee0 2024-09-10T11:34:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.797+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5530101340 con 0x7f5530100ee0 2024-09-10T11:34:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.799+0000 7f552d7fa640 1 -- 172.21.15.81:0/2786909072 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f552004c350 con 0x7f5530100ee0 2024-09-10T11:34:26.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:34:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","modified":"2024-09-10T11:32:55.302750Z","created":"2024-09-10T11:32:55.302750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T11:34:26.801 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 1 2024-09-10T11:34:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 msgr2=0x7f551c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 0x7f551c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55180098c0 tx=0x7f5518006db0 comp rx=0 tx=0).stop 2024-09-10T11:34:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 msgr2=0x7f5530198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5520009230 tx=0x7f5520003d40 comp rx=0 tx=0).stop 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 shutdown_connections 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f551c039060 0x7f551c03b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 --2- 172.21.15.81:0/2786909072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5530100ee0 0x7f5530198100 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 >> 172.21.15.81:0/2786909072 conn(0x7f55300fb9a0 msgr2=0x7f55301082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 shutdown_connections 2024-09-10T11:34:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:26.801+0000 7f553689f640 1 -- 172.21.15.81:0/2786909072 wait complete. 2024-09-10T11:34:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:27 smithi017 ceph-mon[30817]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:27 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/2786909072' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:27.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:27 smithi081 systemd[1]: Started Ceph mon.c for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:34:28.317 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T11:34:28.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T11:34:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: mon.a calling monitor election 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: mon.c calling monitor election 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: monmap epoch 2 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: last_changed 2024-09-10T11:34:27.679688+0000 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: min_mon_release 19 (squid) 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: election_strategy: 1 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:33.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: fsmap 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: mgrmap e13: x(active, since 39s) 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: overall HEALTH_OK 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:33.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: mon.a calling monitor election 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: mon.c calling monitor election 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.058 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: monmap epoch 2 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: last_changed 2024-09-10T11:34:27.679688+0000 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: min_mon_release 19 (squid) 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: election_strategy: 1 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: fsmap 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: mgrmap e13: x(active, since 39s) 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: overall HEALTH_OK 2024-09-10T11:34:33.059 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.060 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.060 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:33.060 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:33.060 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 -- 172.21.15.81:0/1309983182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 msgr2=0x7f2d280059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 --2- 172.21.15.81:0/1309983182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d280059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d401016c0 tx=0x7f2d3002c490 comp rx=0 tx=0).stop 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 -- 172.21.15.81:0/1309983182 shutdown_connections 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 --2- 172.21.15.81:0/1309983182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d280059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 -- 172.21.15.81:0/1309983182 >> 172.21.15.81:0/1309983182 conn(0x7f2d400fc280 msgr2=0x7f2d400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 -- 172.21.15.81:0/1309983182 shutdown_connections 2024-09-10T11:34:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.387+0000 7f2d463fc640 1 -- 172.21.15.81:0/1309983182 wait complete. 2024-09-10T11:34:33.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 Processor -- start 2024-09-10T11:34:33.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 -- start start 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2d40108690 con 0x7f2d28003530 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.388+0000 7f2d463fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d40108510 con 0x7f2d40197870 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.81:51526/0 (socket says 172.21.15.81:51526) 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 -- 172.21.15.81:0/4281065157 learned_addr learned my addr 172.21.15.81:0/4281065157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3f7fe640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3f7fe640 1 -- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 msgr2=0x7f2d4019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3f7fe640 1 -- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 msgr2=0x7f2d4019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3f7fe640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3f7fe640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 -- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 msgr2=0x7f2d4019bbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 -- 172.21.15.81:0/4281065157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d40197e90 con 0x7f2d28003530 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3ffff640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d30005f30 tx=0x7f2d30033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2d30038040 con 0x7f2d28003530 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d30032e00 con 0x7f2d28003530 2024-09-10T11:34:33.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.389+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4019c0f0 con 0x7f2d28003530 2024-09-10T11:34:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.390+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2d300049e0 con 0x7f2d28003530 2024-09-10T11:34:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.390+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4019c6b0 con 0x7f2d28003530 2024-09-10T11:34:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.390+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2d30043020 con 0x7f2d28003530 2024-09-10T11:34:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.391+0000 7f2d3d7fa640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 0x7f2d2c03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.391+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2d3006e600 con 0x7f2d28003530 2024-09-10T11:34:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.391+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40101cc0 con 0x7f2d28003530 2024-09-10T11:34:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.391+0000 7f2d3f7fe640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 0x7f2d2c03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.392+0000 7f2d3f7fe640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 0x7f2d2c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d34006fd0 tx=0x7f2d34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:33.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.397+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d3004a020 con 0x7f2d28003530 2024-09-10T11:34:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.629+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2d40198640 con 0x7f2d28003530 2024-09-10T11:34:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.630+0000 7f2d3d7fa640 1 -- 172.21.15.81:0/4281065157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f2d3004cbc0 con 0x7f2d28003530 2024-09-10T11:34:33.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:34:33.631 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","modified":"2024-09-10T11:34:27.679688Z","created":"2024-09-10T11:32:55.302750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T11:34:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 2 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 msgr2=0x7f2d2c03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 0x7f2d2c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d34006fd0 tx=0x7f2d34008040 comp rx=0 tx=0).stop 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 msgr2=0x7f2d40197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d30005f30 tx=0x7f2d30033680 comp rx=0 tx=0).stop 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 shutdown_connections 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2d2c038e50 0x7f2d2c03b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d40197870 0x7f2d4019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 --2- 172.21.15.81:0/4281065157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d28003530 0x7f2d40197330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 >> 172.21.15.81:0/4281065157 conn(0x7f2d400fc280 msgr2=0x7f2d4006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 shutdown_connections 2024-09-10T11:34:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:33.632+0000 7f2d463fc640 1 -- 172.21.15.81:0/4281065157 wait complete. 2024-09-10T11:34:33.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:33 smithi081 ceph-mon[35059]: Deploying daemon mon.b on smithi026 2024-09-10T11:34:33.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:33 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/4281065157' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:33.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:33 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:34.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:33 smithi017 ceph-mon[30817]: Deploying daemon mon.b on smithi026 2024-09-10T11:34:34.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:33 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/4281065157' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:34.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:33 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:35.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:34 smithi017 ceph-mon[30817]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:35.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:34 smithi081 ceph-mon[35059]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:35.336 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T11:34:35.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T11:34:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 -- 172.21.15.81:0/4169679489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 msgr2=0x7f85a4102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 --2- 172.21.15.81:0/4169679489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4102ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8594009c20 tx=0x7f859402ab20 comp rx=0 tx=0).stop 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 -- 172.21.15.81:0/4169679489 shutdown_connections 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 --2- 172.21.15.81:0/4169679489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4102ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 -- 172.21.15.81:0/4169679489 >> 172.21.15.81:0/4169679489 conn(0x7f85a40fc280 msgr2=0x7f85a40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:36.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 -- 172.21.15.81:0/4169679489 shutdown_connections 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.004+0000 7f85a8f02640 1 -- 172.21.15.81:0/4169679489 wait complete. 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 Processor -- start 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 -- start start 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85a410bda0 con 0x7f85a4102900 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a8f02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85a410bc20 con 0x7f85a4197960 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36188/0 (socket says 172.21.15.81:36188) 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 -- 172.21.15.81:0/1387663884 learned_addr learned my addr 172.21.15.81:0/1387663884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 -- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 msgr2=0x7f85a419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T11:34:36.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 -- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 msgr2=0x7f85a419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.005+0000 7f85a1d9b640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a1d9b640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a259c640 1 -- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 msgr2=0x7f85a419bcf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a259c640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a259c640 1 -- 172.21.15.81:0/1387663884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a4197f80 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a259c640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4197420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8594006010 tx=0x7f859402ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f859402ce80 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a419c230 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f859402eb40 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8594036d10 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.006+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a419c6b0 con 0x7f85a4102900 2024-09-10T11:34:36.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.007+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f859402c040 con 0x7f85a4102900 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.007+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a406a430 con 0x7f85a4102900 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.008+0000 7f85937fe640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 0x7f858c03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.008+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f859406cd20 con 0x7f85a4102900 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.008+0000 7f85a1d9b640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 0x7f858c03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.009+0000 7f85a1d9b640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 0x7f858c03b270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8598009100 tx=0x7f8598008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.013+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8594032030 con 0x7f85a4102900 2024-09-10T11:34:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.240+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f85a419c9a0 con 0x7f85a4102900 2024-09-10T11:34:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.240+0000 7f85937fe640 1 -- 172.21.15.81:0/1387663884 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f859402d3d0 con 0x7f85a4102900 2024-09-10T11:34:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:34:36.242 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","modified":"2024-09-10T11:34:27.679688Z","created":"2024-09-10T11:32:55.302750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T11:34:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 2 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 msgr2=0x7f858c03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 0x7f858c03b270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8598009100 tx=0x7f8598008040 comp rx=0 tx=0).stop 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 msgr2=0x7f85a4197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4197420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8594006010 tx=0x7f859402ca80 comp rx=0 tx=0).stop 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 shutdown_connections 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f858c038db0 0x7f858c03b270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:36.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a4197960 0x7f85a419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 --2- 172.21.15.81:0/1387663884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a4102900 0x7f85a4197420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 >> 172.21.15.81:0/1387663884 conn(0x7f85a40fc280 msgr2=0x7f85a4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.242+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 shutdown_connections 2024-09-10T11:34:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:36.243+0000 7f85a8f02640 1 -- 172.21.15.81:0/1387663884 wait complete. 2024-09-10T11:34:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:36 smithi026 systemd[1]: Started Ceph mon.b for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:34:37.805 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T11:34:37.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T11:34:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 -- 172.21.15.81:0/2355805779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d440059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/2355805779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44003530 0x7f8d440059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d54102af0 tx=0x7f8d4802c150 comp rx=0 tx=0).stop 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 -- 172.21.15.81:0/2355805779 shutdown_connections 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/2355805779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44003530 0x7f8d440059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 -- 172.21.15.81:0/2355805779 >> 172.21.15.81:0/2355805779 conn(0x7f8d540fd320 msgr2=0x7f8d540ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 -- 172.21.15.81:0/2355805779 shutdown_connections 2024-09-10T11:34:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.677+0000 7f8d5aca8640 1 -- 172.21.15.81:0/2355805779 wait complete. 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 Processor -- start 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 -- start start 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 0x7f8d5419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d54109720 con 0x7f8d54197830 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d541095a0 con 0x7f8d44003530 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.678+0000 7f8d5aca8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d541098a0 con 0x7f8d5419c100 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56222/0 (socket says 172.21.15.81:56222) 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.81:58970/0 (socket says 172.21.15.81:58970) 2024-09-10T11:34:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 -- 172.21.15.81:0/197013869 learned_addr learned my addr 172.21.15.81:0/197013869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 0x7f8d5419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 msgr2=0x7f8d5419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 msgr2=0x7f8d5419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d541972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d541972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d59245640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d58a44640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 msgr2=0x7f8d5419c5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 msgr2=0x7f8d541972f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 -- 172.21.15.81:0/197013869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d541a3e70 con 0x7f8d54197830 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d53fff640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 0x7f8d5419bbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000b450 tx=0x7f8d4000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.679+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40004230 con 0x7f8d54197830 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.680+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d400043d0 con 0x7f8d54197830 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.680+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d541a40a0 con 0x7f8d54197830 2024-09-10T11:34:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.680+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40003cb0 con 0x7f8d54197830 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.680+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d541a4600 con 0x7f8d54197830 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.681+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8d4000f050 con 0x7f8d54197830 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.681+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5410a850 con 0x7f8d54197830 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.681+0000 7f8d51ffb640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 0x7f8d3803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.681+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8d4004bdb0 con 0x7f8d54197830 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.681+0000 7f8d58a44640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 0x7f8d3803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.682+0000 7f8d58a44640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 0x7f8d3803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005c80 tx=0x7f8d48005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.686+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d40051020 con 0x7f8d54197830 2024-09-10T11:34:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.931+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8d541a49f0 con 0x7f8d54197830 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: mon.c calling monitor election 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: mon.a calling monitor election 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:41.934 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: monmap epoch 3 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:41.935 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: min_mon_release 19 (squid) 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: election_strategy: 1 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: fsmap 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: mgrmap e13: x(active, since 48s) 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: overall HEALTH_OK 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:41.936 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.932+0000 7f8d51ffb640 1 -- 172.21.15.81:0/197013869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f8d4000d040 con 0x7f8d54197830 2024-09-10T11:34:41.937 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:34:41.937 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","modified":"2024-09-10T11:34:36.515197Z","created":"2024-09-10T11:32:55.302750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 3 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 msgr2=0x7f8d3803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 0x7f8d3803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005c80 tx=0x7f8d48005d10 comp rx=0 tx=0).stop 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 msgr2=0x7f8d5419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 0x7f8d5419bbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000b450 tx=0x7f8d4000b910 comp rx=0 tx=0).stop 2024-09-10T11:34:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 shutdown_connections 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.934+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d380394f0 0x7f8d3803b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5419c100 0x7f8d5419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54197830 0x7f8d5419bbc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 --2- 172.21.15.81:0/197013869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d44003530 0x7f8d541972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 >> 172.21.15.81:0/197013869 conn(0x7f8d540fd320 msgr2=0x7f8d540ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 shutdown_connections 2024-09-10T11:34:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:41.935+0000 7f8d5aca8640 1 -- 172.21.15.81:0/197013869 wait complete. 2024-09-10T11:34:42.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:34:42.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: mon.c calling monitor election 2024-09-10T11:34:42.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: mon.a calling monitor election 2024-09-10T11:34:42.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: monmap epoch 3 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:42.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: min_mon_release 19 (squid) 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: election_strategy: 1 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: fsmap 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: mgrmap e13: x(active, since 48s) 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: overall HEALTH_OK 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:42.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:42.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:42.470 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T11:34:42.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T11:34:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:42.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:42 smithi017 ceph-mon[30817]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:42.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:42.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:42 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/197013869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:42.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:42.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:42 smithi081 ceph-mon[35059]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:42.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:42.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:42 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/197013869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:42.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 -- 172.21.15.17:0/1812043347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1027b0 msgr2=0x7efc2c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 --2- 172.21.15.17:0/1812043347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1027b0 0x7efc2c102b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc24009880 tx=0x7efc2402a670 comp rx=0 tx=0).stop 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 -- 172.21.15.17:0/1812043347 shutdown_connections 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 --2- 172.21.15.17:0/1812043347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c1027b0 0x7efc2c102b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 -- 172.21.15.17:0/1812043347 >> 172.21.15.17:0/1812043347 conn(0x7efc2c0fc190 msgr2=0x7efc2c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.148+0000 7efc347ec640 1 -- 172.21.15.17:0/1812043347 shutdown_connections 2024-09-10T11:34:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.149+0000 7efc347ec640 1 -- 172.21.15.17:0/1812043347 wait complete. 2024-09-10T11:34:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.149+0000 7efc347ec640 1 Processor -- start 2024-09-10T11:34:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.149+0000 7efc347ec640 1 -- start start 2024-09-10T11:34:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c1027b0 0x7efc2c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc2c197970 0x7efc2c19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c10bcb0 con 0x7efc2c19c240 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c10bb30 con 0x7efc2c1027b0 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc347ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c10be30 con 0x7efc2c197970 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54434/0 (socket says 172.21.15.17:54434) 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 -- 172.21.15.17:0/993913181 learned_addr learned my addr 172.21.15.17:0/993913181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc31d87640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc2c197970 0x7efc2c19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32588640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c1027b0 0x7efc2c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 -- 172.21.15.17:0/993913181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc2c197970 msgr2=0x7efc2c19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:43.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc2c197970 0x7efc2c19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 -- 172.21.15.17:0/993913181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c1027b0 msgr2=0x7efc2c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c1027b0 0x7efc2c197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 -- 172.21.15.17:0/993913181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c1a3fb0 con 0x7efc2c19c240 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.150+0000 7efc32d89640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00ba50 tx=0x7efc1c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.151+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c019070 con 0x7efc2c19c240 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.151+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc1c00cbe0 con 0x7efc2c19c240 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.151+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c1a41e0 con 0x7efc2c19c240 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.151+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0076a0 con 0x7efc2c19c240 2024-09-10T11:34:43.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.151+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c1a4740 con 0x7efc2c19c240 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.152+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efc1c01c070 con 0x7efc2c19c240 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.152+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c102c10 con 0x7efc2c19c240 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.152+0000 7efc2b7fe640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 0x7efc1403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.152+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efc1c04bbc0 con 0x7efc2c19c240 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.152+0000 7efc32588640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 0x7efc1403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.153+0000 7efc32588640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 0x7efc1403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc240096c0 tx=0x7efc24000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:43.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.157+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc1c0112a0 con 0x7efc2c19c240 2024-09-10T11:34:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.365+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7efc2c1a4ae0 con 0x7efc2c19c240 2024-09-10T11:34:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.366+0000 7efc2b7fe640 1 -- 172.21.15.17:0/993913181 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7efc1c00cd90 con 0x7efc2c19c240 2024-09-10T11:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T11:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 msgr2=0x7efc1403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 0x7efc1403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc240096c0 tx=0x7efc24000bc0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 msgr2=0x7efc2c19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00ba50 tx=0x7efc1c00bf10 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 shutdown_connections 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7efc140394f0 0x7efc1403b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc2c197970 0x7efc2c19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc2c19c240 0x7efc2c19c6f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 --2- 172.21.15.17:0/993913181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc2c1027b0 0x7efc2c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.369+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 >> 172.21.15.17:0/993913181 conn(0x7efc2c0fc190 msgr2=0x7efc2c105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.370+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 shutdown_connections 2024-09-10T11:34:43.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:43.370+0000 7efc347ec640 1 -- 172.21.15.17:0/993913181 wait complete. 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: mon.c calling monitor election 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: mon.a calling monitor election 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: monmap epoch 3 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: min_mon_release 19 (squid) 2024-09-10T11:34:44.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: election_strategy: 1 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: fsmap 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: mgrmap e13: x(active, since 48s) 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: overall HEALTH_OK 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.008 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.008 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:44.008 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/197013869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T11:34:44.008 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:44.151 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T11:34:44.152 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:44.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T11:34:44.184 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:44.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:44.251 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:34:44.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T11:34:44.281 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:34:44.281 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:44.348 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:34:44.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T11:34:44.377 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:34:44.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T11:34:44.443 INFO:tasks.cephadm:Adding mgr.x on smithi017 2024-09-10T11:34:44.444 INFO:tasks.cephadm:Adding mgr.y on smithi026 2024-09-10T11:34:44.444 INFO:tasks.cephadm:Adding mgr.z on smithi081 2024-09-10T11:34:44.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi017=x;smithi026=y;smithi081=z' 2024-09-10T11:34:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mon.b calling monitor election 2024-09-10T11:34:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: Updating smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: Updating smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: Updating smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mon.b calling monitor election 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mon.c calling monitor election 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mon.a calling monitor election 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: monmap epoch 3 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: min_mon_release 19 (squid) 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: election_strategy: 1 2024-09-10T11:34:44.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: fsmap 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: mgrmap e13: x(active, since 50s) 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: overall HEALTH_OK 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:44.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:44 smithi081 ceph-mon[35059]: Reconfiguring daemon mon.a on smithi017 2024-09-10T11:34:44.722 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:34:44.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mon.b calling monitor election 2024-09-10T11:34:44.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: Updating smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: Updating smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: Updating smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mon.b calling monitor election 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mon.c calling monitor election 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mon.a calling monitor election 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: monmap epoch 3 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: min_mon_release 19 (squid) 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: election_strategy: 1 2024-09-10T11:34:44.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: fsmap 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: mgrmap e13: x(active, since 50s) 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: overall HEALTH_OK 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.757 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:44.758 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:44 smithi026 ceph-mon[34817]: Reconfiguring daemon mon.a on smithi017 2024-09-10T11:34:44.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mon.b calling monitor election 2024-09-10T11:34:44.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:44.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: Updating smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: Updating smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: Updating smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mon.b calling monitor election 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mon.c calling monitor election 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mon.a calling monitor election 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: monmap epoch 3 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: last_changed 2024-09-10T11:34:36.515197+0000 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: created 2024-09-10T11:32:55.302750+0000 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: min_mon_release 19 (squid) 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: election_strategy: 1 2024-09-10T11:34:44.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: 2: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: fsmap 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: mgrmap e13: x(active, since 50s) 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: overall HEALTH_OK 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:44.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:44 smithi017 ceph-mon[30817]: Reconfiguring daemon mon.a on smithi017 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 -- 172.21.15.81:0/2362800291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01021e0 msgr2=0x7ff3a01045d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 --2- 172.21.15.81:0/2362800291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01021e0 0x7ff3a01045d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009880 tx=0x7ff39c02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 -- 172.21.15.81:0/2362800291 shutdown_connections 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 --2- 172.21.15.81:0/2362800291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01021e0 0x7ff3a01045d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 -- 172.21.15.81:0/2362800291 >> 172.21.15.81:0/2362800291 conn(0x7ff3a00fbda0 msgr2=0x7ff3a00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 -- 172.21.15.81:0/2362800291 shutdown_connections 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.131+0000 7ff3a767e640 1 -- 172.21.15.81:0/2362800291 wait complete. 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.132+0000 7ff3a767e640 1 Processor -- start 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.132+0000 7ff3a767e640 1 -- start start 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.132+0000 7ff3a767e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a01021e0 0x7ff3a0196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.132+0000 7ff3a767e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01974a0 0x7ff3a019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.132+0000 7ff3a767e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a767e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a01077a0 con 0x7ff3a01974a0 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a767e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0107620 con 0x7ff3a01021e0 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a767e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0107920 con 0x7ff3a0197920 2024-09-10T11:34:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a541a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a01021e0 0x7ff3a0196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a4c19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01974a0 0x7ff3a019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a5c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a5c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56230/0 (socket says 172.21.15.81:56230) 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.133+0000 7ff3a5c1b640 1 -- 172.21.15.81:0/1304639374 learned_addr learned my addr 172.21.15.81:0/1304639374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 -- 172.21.15.81:0/1304639374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a01021e0 msgr2=0x7ff3a0196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a01021e0 0x7ff3a0196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 -- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01974a0 msgr2=0x7ff3a019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01974a0 0x7ff3a019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 -- 172.21.15.81:0/1304639374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a019f360 con 0x7ff3a0197920 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a5c1b640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff39800ba50 tx=0x7ff39800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398019070 con 0x7ff3a0197920 2024-09-10T11:34:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff39800cbe0 con 0x7ff3a0197920 2024-09-10T11:34:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a0100030 con 0x7ff3a0197920 2024-09-10T11:34:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3980076a0 con 0x7ff3a0197920 2024-09-10T11:34:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.134+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a01005a0 con 0x7ff3a0197920 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.135+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff39801c070 con 0x7ff3a0197920 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.135+0000 7ff3967fc640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 0x7ff38c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.135+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff39804bb70 con 0x7ff3a0197920 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.136+0000 7ff3a541a640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 0x7ff38c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.136+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a0190560 con 0x7ff3a0197920 2024-09-10T11:34:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.136+0000 7ff3a541a640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 0x7ff38c03b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff39c000c00 tx=0x7ff39c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.141+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff39800e0a0 con 0x7ff3a0197920 2024-09-10T11:34:45.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.319+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi026=y;smithi081=z", "target": ["mon-mgr", ""]}) -- 0x7ff3a0062630 con 0x7ff38c0394f0 2024-09-10T11:34:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.324+0000 7ff3967fc640 1 -- 172.21.15.81:0/1304639374 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff3a0062630 con 0x7ff38c0394f0 2024-09-10T11:34:45.325 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mgr update... 2024-09-10T11:34:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 msgr2=0x7ff38c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 0x7ff38c03b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff39c000c00 tx=0x7ff39c0315d0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 msgr2=0x7ff3a019eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff39800ba50 tx=0x7ff39800bf10 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 shutdown_connections 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff38c0394f0 0x7ff38c03b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a0197920 0x7ff3a019eaa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3a01974a0 0x7ff3a019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 --2- 172.21.15.81:0/1304639374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a01021e0 0x7ff3a0196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 >> 172.21.15.81:0/1304639374 conn(0x7ff3a00fbda0 msgr2=0x7ff3a00fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 shutdown_connections 2024-09-10T11:34:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:34:45.326+0000 7ff3a767e640 1 -- 172.21.15.81:0/1304639374 wait complete. 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: Reconfiguring mon.b (monmap changed)... 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:45.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: Reconfiguring daemon mon.b on smithi026 2024-09-10T11:34:45.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.605 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:45.605 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.605 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: Reconfiguring mon.b (monmap changed)... 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: Reconfiguring daemon mon.b on smithi026 2024-09-10T11:34:45.606 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: Reconfiguring mon.b (monmap changed)... 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: Reconfiguring daemon mon.b on smithi026 2024-09-10T11:34:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:45.957 DEBUG:teuthology.orchestra.run.smithi026:mgr.y> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T11:34:45.960 DEBUG:teuthology.orchestra.run.smithi081:mgr.z> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T11:34:45.962 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T11:34:45.962 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:34:45.962 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:34:45.983 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:34:45.983 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-10T11:34:46.042 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:34:46.042 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:46.042 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 11:34:04.272699013 +0000 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 11:29:05.017284507 +0000 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 11:29:05.017284507 +0000 2024-09-10T11:34:46.043 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 11:29:05.017284507 +0000 2024-09-10T11:34:46.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:34:46.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T11:34:46.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T11:34:46.114 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000136116 s, 3.8 MB/s 2024-09-10T11:34:46.116 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:34:46.176 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-10T11:34:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:34:46.236 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:46.236 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T11:34:46.236 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:46.236 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:46.237 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 11:34:04.311698606 +0000 2024-09-10T11:34:46.237 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 11:29:05.343281122 +0000 2024-09-10T11:34:46.237 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 11:29:05.343281122 +0000 2024-09-10T11:34:46.237 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 11:29:05.343281122 +0000 2024-09-10T11:34:46.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:34:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T11:34:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T11:34:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000134733 s, 3.8 MB/s 2024-09-10T11:34:46.307 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:34:46.366 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:46.425 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 11:34:04.349698209 +0000 2024-09-10T11:34:46.426 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 11:29:05.685277572 +0000 2024-09-10T11:34:46.426 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 11:29:05.685277572 +0000 2024-09-10T11:34:46.426 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 11:29:05.685277572 +0000 2024-09-10T11:34:46.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:34:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T11:34:46.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T11:34:46.492 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000124186 s, 4.1 MB/s 2024-09-10T11:34:46.493 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:34:46.535 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:46 smithi026 ceph-mon[34817]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi026=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:46.536 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:46 smithi026 ceph-mon[34817]: Saving service mgr spec with placement smithi017=x;smithi026=y;smithi081=z;count:3 2024-09-10T11:34:46.536 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:46 smithi026 ceph-mon[34817]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:46.551 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-10T11:34:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:34:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:46.609 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T11:34:46.609 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:46.609 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:46.610 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 11:34:04.387697812 +0000 2024-09-10T11:34:46.610 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 11:29:06.013274167 +0000 2024-09-10T11:34:46.610 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 11:29:06.013274167 +0000 2024-09-10T11:34:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 11:29:06.013274167 +0000 2024-09-10T11:34:46.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:34:46.674 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:46 smithi017 ceph-mon[30817]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi026=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:46.674 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:46 smithi017 ceph-mon[30817]: Saving service mgr spec with placement smithi017=x;smithi026=y;smithi081=z;count:3 2024-09-10T11:34:46.674 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:46 smithi017 ceph-mon[30817]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T11:34:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T11:34:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00011606 s, 4.4 MB/s 2024-09-10T11:34:46.678 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:34:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:46 smithi081 ceph-mon[35059]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi026=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:46 smithi081 ceph-mon[35059]: Saving service mgr spec with placement smithi017=x;smithi026=y;smithi081=z;count:3 2024-09-10T11:34:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:46 smithi081 ceph-mon[35059]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:46.736 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-10T11:34:46.736 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:34:46.754 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:34:46.755 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:46.812 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-10 11:34:35.968622825 +0000 2024-09-10T11:34:46.813 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-10 11:29:20.985582815 +0000 2024-09-10T11:34:46.813 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-10 11:29:20.985582815 +0000 2024-09-10T11:34:46.813 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-10 11:29:20.985582815 +0000 2024-09-10T11:34:46.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:34:46.881 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-10T11:34:46.881 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-10T11:34:46.881 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000128209 s, 4.0 MB/s 2024-09-10T11:34:46.883 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:34:46.942 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.000 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-10 11:34:35.968622825 +0000 2024-09-10T11:34:47.001 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-10 11:29:21.291578525 +0000 2024-09-10T11:34:47.001 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-10 11:29:21.291578525 +0000 2024-09-10T11:34:47.001 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-10 11:29:21.291578525 +0000 2024-09-10T11:34:47.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:34:47.067 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-10T11:34:47.067 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-10T11:34:47.067 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000125775 s, 4.1 MB/s 2024-09-10T11:34:47.068 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:34:47.126 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-09-10T11:34:47.183 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-10 11:34:35.968622825 +0000 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-10 11:29:21.606574108 +0000 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-10 11:29:21.606574108 +0000 2024-09-10T11:34:47.184 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-10 11:29:21.606574108 +0000 2024-09-10T11:34:47.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:34:47.249 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-10T11:34:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-10T11:34:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.9384e-05 s, 5.2 MB/s 2024-09-10T11:34:47.253 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:34:47.311 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-10 11:34:35.969622811 +0000 2024-09-10T11:34:47.368 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-10 11:29:21.907569889 +0000 2024-09-10T11:34:47.369 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-10 11:29:21.907569889 +0000 2024-09-10T11:34:47.369 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-10 11:29:21.907569889 +0000 2024-09-10T11:34:47.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:34:47.433 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-10T11:34:47.433 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-10T11:34:47.434 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.8811e-05 s, 5.2 MB/s 2024-09-10T11:34:47.435 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:34:47.494 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T11:34:47.494 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:34:47.511 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:34:47.511 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 11:34:26.642214263 +0000 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 11:29:18.570372232 +0000 2024-09-10T11:34:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 11:29:18.570372232 +0000 2024-09-10T11:34:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 11:29:18.570372232 +0000 2024-09-10T11:34:47.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:34:47.632 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T11:34:47.632 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T11:34:47.632 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000212268 s, 2.4 MB/s 2024-09-10T11:34:47.633 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:34:47.690 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-10T11:34:47.745 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:34:47.745 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T11:34:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.746 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 11:34:26.642214263 +0000 2024-09-10T11:34:47.746 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 11:29:18.898365882 +0000 2024-09-10T11:34:47.746 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 11:29:18.898365882 +0000 2024-09-10T11:34:47.746 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 11:29:18.898365882 +0000 2024-09-10T11:34:47.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:34:47.809 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T11:34:47.809 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T11:34:47.809 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000188246 s, 2.7 MB/s 2024-09-10T11:34:47.810 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:34:47.866 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-10T11:34:47.886 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:47.886 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:47.886 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: Reconfiguring mon.c (monmap changed)... 2024-09-10T11:34:47.886 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:47.887 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:47.887 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:47.887 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:47 smithi081 ceph-mon[35059]: Reconfiguring daemon mon.c on smithi081 2024-09-10T11:34:47.904 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 11:34:26.643214244 +0000 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 11:29:19.210359842 +0000 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 11:29:19.210359842 +0000 2024-09-10T11:34:47.905 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 11:29:19.210359842 +0000 2024-09-10T11:34:47.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:34:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T11:34:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T11:34:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000199588 s, 2.6 MB/s 2024-09-10T11:34:47.971 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:34:48.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:48.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:48.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: Reconfiguring mon.c (monmap changed)... 2024-09-10T11:34:48.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:48.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:48.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:48.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:47 smithi026 ceph-mon[34817]: Reconfiguring daemon mon.c on smithi081 2024-09-10T11:34:48.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: Reconfiguring mon.c (monmap changed)... 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:47 smithi017 ceph-mon[30817]: Reconfiguring daemon mon.c on smithi081 2024-09-10T11:34:48.027 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-10T11:34:48.083 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 11:34:26.643214244 +0000 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 11:29:19.530353646 +0000 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 11:29:19.530353646 +0000 2024-09-10T11:34:48.084 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 11:29:19.530353646 +0000 2024-09-10T11:34:48.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:34:48.147 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T11:34:48.147 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T11:34:48.147 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000168765 s, 3.0 MB/s 2024-09-10T11:34:48.149 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:34:48.205 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-09-10T11:34:48.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T11:34:48.468 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:49.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:49.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:48 smithi081 ceph-mon[35059]: Deploying daemon mgr.z on smithi081 2024-09-10T11:34:49.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:49.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.232 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:48 smithi017 ceph-mon[30817]: Deploying daemon mgr.z on smithi081 2024-09-10T11:34:49.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:49.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:48 smithi026 ceph-mon[34817]: Deploying daemon mgr.z on smithi081 2024-09-10T11:34:49.871 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:49 smithi081 systemd[1]: Starting Ceph mgr.z for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:49 smithi081 podman[36862]: 2024-09-10 11:34:49.870025029 +0000 UTC m=+0.105661246 container create a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:49 smithi081 podman[36862]: 2024-09-10 11:34:49.779681909 +0000 UTC m=+0.015318096 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 podman[36862]: 2024-09-10 11:34:50.08895596 +0000 UTC m=+0.324592143 container init a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 podman[36862]: 2024-09-10 11:34:50.091581227 +0000 UTC m=+0.327217409 container start a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-mgr[36881]: -- 172.21.15.81:0/3107794321 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4277850e0 con 0x55f427763000 2024-09-10T11:34:50.173 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 bash[36862]: a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 2024-09-10T11:34:50.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 systemd[1]: Started Ceph mgr.z for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:34:50.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.212+0000 7f1a31600040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:34:50.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.272+0000 7f1a31600040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:34:50.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.419+0000 7f1a31600040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:34:50.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:34:50.777 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.486+0000 7f1a31600040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:34:50.777 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.634+0000 7f1a31600040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:34:50.777 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:50.775+0000 7f1a31600040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:34:50.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-09-10T11:34:51.048 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:51.091+0000 7f1a31600040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:51.151+0000 7f1a31600040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:51.337+0000 7f1a31600040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:51.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:51.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:51.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:51.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:51.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:51.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:51.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 -- 172.21.15.17:0/2997582310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530100b10 msgr2=0x7f3530100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 --2- 172.21.15.17:0/2997582310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530100b10 0x7f3530100f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f352c009900 tx=0x7f352c02a410 comp rx=0 tx=0).stop 2024-09-10T11:34:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 -- 172.21.15.17:0/2997582310 shutdown_connections 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 --2- 172.21.15.17:0/2997582310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3530101d10 0x7f3530102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 --2- 172.21.15.17:0/2997582310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35301026d0 0x7f3530108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 --2- 172.21.15.17:0/2997582310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530100b10 0x7f3530100f10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 -- 172.21.15.17:0/2997582310 >> 172.21.15.17:0/2997582310 conn(0x7f35300fc2a0 msgr2=0x7f35300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 -- 172.21.15.17:0/2997582310 shutdown_connections 2024-09-10T11:34:51.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.553+0000 7f3538690640 1 -- 172.21.15.17:0/2997582310 wait complete. 2024-09-10T11:34:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 Processor -- start 2024-09-10T11:34:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 -- start start 2024-09-10T11:34:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3530100b10 0x7f3530197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35301026d0 0x7f353019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f353010c7c0 con 0x7f3530101d10 2024-09-10T11:34:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f353010c640 con 0x7f3530100b10 2024-09-10T11:34:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3538690640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f353010c940 con 0x7f35301026d0 2024-09-10T11:34:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46236/0 (socket says 172.21.15.17:46236) 2024-09-10T11:34:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 -- 172.21.15.17:0/1379696671 learned_addr learned my addr 172.21.15.17:0/1379696671 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:34:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f353642c640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3530100b10 0x7f3530197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3536c2d640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35301026d0 0x7f353019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 -- 172.21.15.17:0/1379696671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35301026d0 msgr2=0x7f353019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35301026d0 0x7f353019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 -- 172.21.15.17:0/1379696671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3530100b10 msgr2=0x7f3530197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:34:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3530100b10 0x7f3530197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:34:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.554+0000 7f3535c2b640 1 -- 172.21.15.17:0/1379696671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353019fb70 con 0x7f3530101d10 2024-09-10T11:34:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f3535c2b640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f352000d950 tx=0x7f352000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520017070 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3520009c30 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353019fe60 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352000f6b0 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.555+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35301a0310 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.556+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f352000f850 con 0x7f3530101d10 2024-09-10T11:34:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.556+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35301a0540 con 0x7f3530101d10 2024-09-10T11:34:51.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.556+0000 7f35277fe640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 0x7f351c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:34:51.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.556+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f352004c0d0 con 0x7f3530101d10 2024-09-10T11:34:51.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.556+0000 7f353642c640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 0x7f351c03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:34:51.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.557+0000 7f353642c640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 0x7f351c03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f352c02aa00 tx=0x7f352c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:34:51.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.561+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3520010b20 con 0x7f3530101d10 2024-09-10T11:34:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:51.747+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f353006af70 con 0x7f351c0392c0 2024-09-10T11:34:52.246 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 systemd[1]: Starting Ceph mgr.y for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:34:52.453 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:52 smithi017 ceph-mon[30817]: Deploying daemon mgr.y on smithi026 2024-09-10T11:34:52.453 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:34:52.453 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:34:52.453 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-mon[34817]: Deploying daemon mgr.y on smithi026 2024-09-10T11:34:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:34:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:34:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 podman[36162]: 2024-09-10 11:34:52.25970199 +0000 UTC m=+0.099517376 container create cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 podman[36162]: 2024-09-10 11:34:52.176502131 +0000 UTC m=+0.016317526 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 podman[36162]: 2024-09-10 11:34:52.428766776 +0000 UTC m=+0.268582164 container init cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 podman[36162]: 2024-09-10 11:34:52.43165334 +0000 UTC m=+0.271468726 container start cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-mgr[36181]: -- 172.21.15.26:0/1523450831 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55733d3fd0e0 con 0x55733d3db400 2024-09-10T11:34:52.505 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 bash[36162]: cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a 2024-09-10T11:34:52.703 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:52.216+0000 7f1a31600040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:34:52.703 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:52.284+0000 7f1a31600040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:34:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-mon[35059]: Deploying daemon mgr.y on smithi026 2024-09-10T11:34:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:34:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:34:52.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:52.754 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 systemd[1]: Started Ceph mgr.y for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:34:52.754 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:52.563+0000 7f80e74a8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T11:34:52.754 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:52.623+0000 7f80e74a8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T11:34:53.181 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:52.781+0000 7f80e74a8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T11:34:53.181 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:52.851+0000 7f80e74a8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T11:34:53.181 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:53.025+0000 7f80e74a8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:34:53.181 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:53.178+0000 7f80e74a8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T11:34:53.302 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.033+0000 7f1a31600040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.155+0000 7f1a31600040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.301+0000 7f1a31600040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.303 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.304 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.307 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:53.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:34:53.590 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.367+0000 7f1a31600040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:34:53.590 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.520+0000 7f1a31600040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:34:53.590 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.588+0000 7f1a31600040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:34:53.770 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:53.511+0000 7f80e74a8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T11:34:53.770 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:53.575+0000 7f80e74a8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T11:34:53.770 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:53.769+0000 7f80e74a8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T11:34:53.883 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.650+0000 7f1a31600040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:34:53.883 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.816+0000 7f1a31600040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:34:53.883 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.881+0000 7f1a31600040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:34:54.153 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:53.947+0000 7f1a31600040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:34:54.154 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:54.030+0000 7f1a31600040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:34:54.154 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:54.093+0000 7f1a31600040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:34:54.154 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:54.152+0000 7f1a31600040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:34:54.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:54.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]': finished 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:54.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-mon[35059]: Reconfiguring daemon mgr.x on smithi017 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:54.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]: dispatch 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]': finished 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:54 smithi017 ceph-mon[30817]: Reconfiguring daemon mgr.x on smithi017 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.705 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/818072428' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb884aa2-728d-4f58-b002-3bd444435819"}]': finished 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:34:54.706 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-mon[34817]: Reconfiguring daemon mgr.x on smithi017 2024-09-10T11:34:55.004 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:54.703+0000 7f80e74a8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T11:34:55.004 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:54.773+0000 7f80e74a8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T11:34:55.203 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:34:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z[36877]: 2024-09-10T11:34:54.943+0000 7f1a31600040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:34:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:55.381+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f3520023350 con 0x7f3530101d10 2024-09-10T11:34:55.646 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:55.525+0000 7f80e74a8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T11:34:55.646 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:55.645+0000 7f80e74a8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/872578402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: Standby manager daemon z started 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:34:55.647 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/872578402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: Standby manager daemon z started 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:34:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:55 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:55.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/872578402' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:34:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: Standby manager daemon z started 2024-09-10T11:34:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T11:34:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T11:34:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:55 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.81:0/3605724470' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:56.004 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:55.793+0000 7f80e74a8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T11:34:56.004 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:55.857+0000 7f80e74a8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T11:34:56.309 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.011+0000 7f80e74a8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T11:34:56.309 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.082+0000 7f80e74a8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T11:34:56.309 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.144+0000 7f80e74a8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T11:34:56.309 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.308+0000 7f80e74a8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T11:34:56.593 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-mon[34817]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:56.593 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-mon[34817]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-10T11:34:56.593 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:34:56.593 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.375+0000 7f80e74a8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T11:34:56.593 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.444+0000 7f80e74a8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T11:34:56.594 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.530+0000 7f80e74a8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T11:34:56.594 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.592+0000 7f80e74a8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T11:34:56.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:56 smithi081 ceph-mon[35059]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:56.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:56 smithi081 ceph-mon[35059]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-10T11:34:56.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:34:56.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:56 smithi017 ceph-mon[30817]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:56 smithi017 ceph-mon[30817]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-10T11:34:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T11:34:57.004 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:56.653+0000 7f80e74a8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T11:34:57.754 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:34:57 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y[36177]: 2024-09-10T11:34:57.477+0000 7f80e74a8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T11:34:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:34:58.391+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f352000ec30 con 0x7f3530101d10 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: Standby manager daemon y started 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:34:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:58 smithi081 ceph-mon[35059]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: Standby manager daemon y started 2024-09-10T11:34:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:34:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:34:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:58 smithi026 ceph-mon[34817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:34:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: Standby manager daemon y started 2024-09-10T11:34:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T11:34:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T11:34:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T11:34:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:58 smithi017 ceph-mon[30817]: from='mgr.? 172.21.15.26:0/918203039' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T11:34:59.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:59 smithi017 ceph-mon[30817]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-10T11:34:59.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:34:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:34:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:59 smithi081 ceph-mon[35059]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-10T11:34:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:34:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:34:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:59 smithi026 ceph-mon[34817]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-10T11:34:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:34:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T11:35:00.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:00 smithi081 ceph-mon[35059]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:00 smithi026 ceph-mon[34817]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:00.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:00 smithi017 ceph-mon[30817]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:02.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:02.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:02.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:02.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:02.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:02.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:02.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:02.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:02.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:02.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:02.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:03.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:02 smithi017 ceph-mon[30817]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:03.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:02 smithi081 ceph-mon[35059]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:03.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:02 smithi026 ceph-mon[34817]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:04.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:03 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T11:35:04.305 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:03 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:04.306 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:03 smithi026 ceph-mon[34817]: Deploying daemon osd.0 on smithi017 2024-09-10T11:35:04.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T11:35:04.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:04.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:03 smithi017 ceph-mon[30817]: Deploying daemon osd.0 on smithi017 2024-09-10T11:35:04.333 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:03 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T11:35:04.333 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:03 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:04.333 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:03 smithi081 ceph-mon[35059]: Deploying daemon osd.0 on smithi017 2024-09-10T11:35:05.056 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:04 smithi017 ceph-mon[30817]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:05.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:04 smithi026 ceph-mon[34817]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:05.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:04 smithi081 ceph-mon[35059]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:07.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:06 smithi026 ceph-mon[34817]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:07.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:06 smithi017 ceph-mon[30817]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:06 smithi081 ceph-mon[35059]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:09.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:08 smithi017 ceph-mon[30817]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:09.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:08 smithi026 ceph-mon[34817]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:09.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:08 smithi081 ceph-mon[35059]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:09 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:09 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:09 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:10.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:09 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:10.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:09 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:10.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:09 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:10.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:09 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:10.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:09 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:10.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:09 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:11.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:10 smithi017 ceph-mon[30817]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:10 smithi026 ceph-mon[34817]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:10 smithi081 ceph-mon[35059]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:13.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.137+0000 7f35277fe640 1 -- 172.21.15.17:0/1379696671 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f353006af70 con 0x7f351c0392c0 2024-09-10T11:35:13.139 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-09-10T11:35:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 msgr2=0x7f351c03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 0x7f351c03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f352c02aa00 tx=0x7f352c0315b0 comp rx=0 tx=0).stop 2024-09-10T11:35:13.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 msgr2=0x7f3530198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f352000d950 tx=0x7f352000de10 comp rx=0 tx=0).stop 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 shutdown_connections 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f351c0392c0 0x7f351c03b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35301026d0 0x7f353019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3530101d10 0x7f3530198480 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 --2- 172.21.15.17:0/1379696671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3530100b10 0x7f3530197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 >> 172.21.15.17:0/1379696671 conn(0x7f35300fc2a0 msgr2=0x7f353006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 shutdown_connections 2024-09-10T11:35:13.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:35:13.139+0000 7f3538690640 1 -- 172.21.15.17:0/1379696671 wait complete. 2024-09-10T11:35:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:13.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:13.696 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T11:35:13.699 INFO:tasks.cephadm:Deploying osd.1 on smithi026 with /dev/vg_nvme/lv_4... 2024-09-10T11:35:13.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T11:35:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:35:14.004 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:14.004 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:14.004 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:14.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:14.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:14.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:14.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:14.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:14.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:15.273 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:15 smithi026 ceph-mon[34817]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:15.378 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:15 smithi017 ceph-mon[30817]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:15 smithi081 ceph-mon[35059]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:16.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:35:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:35:15.720+0000 7fd6e749f640 -1 osd.0 0 log_to_monitors true 2024-09-10T11:35:16.294 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:16 smithi026 ceph-mon[34817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T11:35:16.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:35:16.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_4 2024-09-10T11:35:16.415 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:16 smithi017 ceph-mon[30817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T11:35:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:16 smithi081 ceph-mon[35059]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T11:35:16.584 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:35:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/2586996518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc81026c0 msgr2=0x7f5fc8104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/2586996518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc81026c0 0x7f5fc8104ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009900 tx=0x7f5fbc02a410 comp rx=0 tx=0).stop 2024-09-10T11:35:17.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/2586996518 shutdown_connections 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/2586996518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 0x7f5fc8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/2586996518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc8104ff0 0x7f5fc81073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/2586996518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc81026c0 0x7f5fc8104ab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/2586996518 >> 172.21.15.26:0/2586996518 conn(0x7f5fc80fc280 msgr2=0x7f5fc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/2586996518 shutdown_connections 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.015+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/2586996518 wait complete. 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 Processor -- start 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 -- start start 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 0x7f5fc819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:17.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 0x7f5fc81a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810d860 con 0x7f5fc81026c0 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810d6e0 con 0x7f5fc8104ff0 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcf0c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810d9e0 con 0x7f5fc8107920 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48332/0 (socket says 172.21.15.26:48332) 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fc7fff640 1 -- 172.21.15.26:0/4176352875 learned_addr learned my addr 172.21.15.26:0/4176352875 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcce62640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 0x7f5fc819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.016+0000 7f5fcd663640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 0x7f5fc81a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 -- 172.21.15.26:0/4176352875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 msgr2=0x7f5fc81a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 0x7f5fc81a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 -- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 msgr2=0x7f5fc819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 0x7f5fc819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:17.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 -- 172.21.15.26:0/4176352875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc81a1da0 con 0x7f5fc8104ff0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fcce62640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 0x7f5fc819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc7fff640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400e9c0 tx=0x7f5fb400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400cd80 con 0x7f5fc8104ff0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc81a2090 con 0x7f5fc8104ff0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb4005500 con 0x7f5fc8104ff0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4010690 con 0x7f5fc8104ff0 2024-09-10T11:35:17.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.017+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc81a25d0 con 0x7f5fc8104ff0 2024-09-10T11:35:17.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.018+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc8109410 con 0x7f5fc8104ff0 2024-09-10T11:35:17.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.019+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f5fb40046c0 con 0x7f5fc8104ff0 2024-09-10T11:35:17.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.020+0000 7f5fc5ffb640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 0x7f5fb80a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:17.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.021+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7f5fb40cd8b0 con 0x7f5fc8104ff0 2024-09-10T11:35:17.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.021+0000 7f5fcce62640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 0x7f5fb80a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:17.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.021+0000 7f5fcce62640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 0x7f5fb80a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc000c00 tx=0x7f5fbc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:35:17.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.025+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fb409c370 con 0x7f5fc8104ff0 2024-09-10T11:35:17.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:17.227+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5fc8062630 con 0x7f5fb80a2b20 2024-09-10T11:35:17.228 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:17.228 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T11:35:17.228 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T11:35:17.228 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:35:17.228 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:17.229 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T11:35:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:17.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:17.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:18.154 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:35:17.852+0000 7fd6e2bff640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T11:35:18.154 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:35:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:35:17.855+0000 7fd6db231640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:35:18.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi017 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:18.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:18 smithi026 ceph-mon[34817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi017 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:18.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:18.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:18.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:18.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:18 smithi081 ceph-mon[35059]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' 2024-09-10T11:35:18.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi017 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:18.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:18.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:18.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:18.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:18.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:18 smithi017 ceph-mon[30817]: from='osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700]' entity='osd.0' 2024-09-10T11:35:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:35:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:35:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:19.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] boot 2024-09-10T11:35:19.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T11:35:19.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] boot 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T11:35:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: osd.0 [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] boot 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T11:35:19.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/1068012884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]': finished 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:20 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/3502312871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/1068012884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]': finished 2024-09-10T11:35:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T11:35:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:20.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:20 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/3502312871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:20.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/1068012884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]: dispatch 2024-09-10T11:35:20.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "097fdd5d-de3c-4a64-83c4-0841e483863b"}]': finished 2024-09-10T11:35:20.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T11:35:20.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:20.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:20 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/3502312871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:21 smithi081 ceph-mon[35059]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:21 smithi081 ceph-mon[35059]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T11:35:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:21 smithi026 ceph-mon[34817]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:21 smithi026 ceph-mon[34817]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T11:35:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:21.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:21 smithi017 ceph-mon[30817]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:21.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:21 smithi017 ceph-mon[30817]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T11:35:21.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:23 smithi081 ceph-mon[35059]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:23 smithi026 ceph-mon[34817]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:23 smithi017 ceph-mon[30817]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:25.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:25 smithi026 ceph-mon[34817]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:25 smithi081 ceph-mon[35059]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:25 smithi017 ceph-mon[30817]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:27 smithi081 ceph-mon[35059]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:27.480 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:27 smithi026 ceph-mon[34817]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:27 smithi017 ceph-mon[30817]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:28.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T11:35:28.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T11:35:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T11:35:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:29.428 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:29 smithi026 ceph-mon[34817]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:29.428 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:29 smithi026 ceph-mon[34817]: Deploying daemon osd.1 on smithi026 2024-09-10T11:35:29.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:29 smithi081 ceph-mon[35059]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:29.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:29 smithi081 ceph-mon[35059]: Deploying daemon osd.1 on smithi026 2024-09-10T11:35:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:29 smithi017 ceph-mon[30817]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:29.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:29 smithi017 ceph-mon[30817]: Deploying daemon osd.1 on smithi026 2024-09-10T11:35:31.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:31 smithi026 ceph-mon[34817]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:31 smithi081 ceph-mon[35059]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:31.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:31 smithi017 ceph-mon[30817]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:33.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:33 smithi026 ceph-mon[34817]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:33 smithi081 ceph-mon[35059]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:33.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:33 smithi017 ceph-mon[30817]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:34.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:34.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:34.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:34.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:34.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:34.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:34.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:34.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:34.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:35 smithi081 ceph-mon[35059]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:35.502 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:35 smithi026 ceph-mon[34817]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:35 smithi017 ceph-mon[30817]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.109+0000 7f5fc5ffb640 1 -- 172.21.15.26:0/4176352875 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5fc8062630 con 0x7f5fb80a2b20 2024-09-10T11:35:38.111 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 1 on host 'smithi026' 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 msgr2=0x7f5fb80a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 0x7f5fb80a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc000c00 tx=0x7f5fbc0095f0 comp rx=0 tx=0).stop 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 msgr2=0x7f5fc819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400e9c0 tx=0x7f5fb400ee80 comp rx=0 tx=0).stop 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 shutdown_connections 2024-09-10T11:35:38.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5fb80a2b20 0x7f5fb80a4fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fc8107920 0x7f5fc81a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc8104ff0 0x7f5fc819a6b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 --2- 172.21.15.26:0/4176352875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc81026c0 0x7f5fc819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 >> 172.21.15.26:0/4176352875 conn(0x7f5fc80fc280 msgr2=0x7f5fc8101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 shutdown_connections 2024-09-10T11:35:38.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:35:38.111+0000 7f5fcf0c6640 1 -- 172.21.15.26:0/4176352875 wait complete. 2024-09-10T11:35:38.448 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:38.448 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.448 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:38.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:38.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:38.717 DEBUG:teuthology.orchestra.run.smithi026:osd.1> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T11:35:38.720 INFO:tasks.cephadm:Deploying osd.2 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-10T11:35:38.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T11:35:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:35:39.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:39 smithi026 ceph-mon[34817]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:39.419 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:39 smithi081 ceph-mon[35059]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:39.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:39 smithi017 ceph-mon[30817]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:40.669 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:35:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:35:40.381+0000 7f0cb68c5640 -1 osd.1 0 log_to_monitors true 2024-09-10T11:35:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:35:41.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-10T11:35:41.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:41 smithi026 ceph-mon[34817]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:41.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:41 smithi026 ceph-mon[34817]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:41 smithi026 ceph-mon[34817]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:35:41.418 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:41 smithi081 ceph-mon[35059]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:41.418 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:41 smithi081 ceph-mon[35059]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.418 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:41 smithi081 ceph-mon[35059]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:41 smithi017 ceph-mon[30817]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:41.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:41 smithi017 ceph-mon[30817]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:41 smithi017 ceph-mon[30817]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T11:35:41.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/781414047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 msgr2=0x7ffb88100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/781414047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb88100ed0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009900 tx=0x7ffb8402a410 comp rx=0 tx=0).stop 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/781414047 shutdown_connections 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/781414047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88102690 0x7ffb88108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/781414047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88101cd0 0x7ffb88102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/781414047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb88100ed0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/781414047 >> 172.21.15.81:0/781414047 conn(0x7ffb880fc280 msgr2=0x7ffb880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/781414047 shutdown_connections 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.858+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/781414047 wait complete. 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 Processor -- start 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 -- start start 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88101cd0 0x7ffb8819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:41.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88102690 0x7ffb8819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810c830 con 0x7ffb88102690 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810c6b0 con 0x7ffb88101cd0 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8f3d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810c9b0 con 0x7ffb88100ad0 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8d173640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8d173640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42450/0 (socket says 172.21.15.81:42450) 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8d173640 1 -- 172.21.15.81:0/370838917 learned_addr learned my addr 172.21.15.81:0/370838917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8c972640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88101cd0 0x7ffb8819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.859+0000 7ffb8d974640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88102690 0x7ffb8819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 -- 172.21.15.81:0/370838917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88101cd0 msgr2=0x7ffb8819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88101cd0 0x7ffb8819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 -- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88102690 msgr2=0x7ffb8819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:35:41.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88102690 0x7ffb8819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 -- 172.21.15.81:0/370838917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8819fcd0 con 0x7ffb88100ad0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8d173640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffb84031610 tx=0x7ffb840043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8403f030 con 0x7ffb88100ad0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb84003ce0 con 0x7ffb88100ad0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84035070 con 0x7ffb88100ad0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8819ff00 con 0x7ffb88100ad0 2024-09-10T11:35:41.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.860+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb881a03d0 con 0x7ffb88100ad0 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.861+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb88107f10 con 0x7ffb88100ad0 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.862+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ffb84042030 con 0x7ffb88100ad0 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.863+0000 7ffb7e7fc640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 0x7ffb740a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.863+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7ffb840ede00 con 0x7ffb88100ad0 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.863+0000 7ffb8c972640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 0x7ffb740a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:35:41.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.864+0000 7ffb8c972640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 0x7ffb740a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb8806b050 tx=0x7ffb78009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:35:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:41.866+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb840bc750 con 0x7ffb88100ad0 2024-09-10T11:35:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:35:42.044+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffb88062630 con 0x7ffb740a2af0 2024-09-10T11:35:42.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:42.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:42.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:42.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:35:42.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:42 smithi081 ceph-mon[35059]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T11:35:42.504 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:35:42.208+0000 7f0cb2025640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T11:35:42.504 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:35:42.213+0000 7f0cae65f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:42.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:42.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:35:42.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:42 smithi026 ceph-mon[34817]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:35:42.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:42.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:35:42.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:35:42.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:42.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:35:42.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:42 smithi017 ceph-mon[30817]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T11:35:43.502 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi026 2024-09-10T11:35:43.503 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi026 to 17092M 2024-09-10T11:35:43.503 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:43.503 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:43.503 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:43.503 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:43 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:43.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi026 2024-09-10T11:35:43.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi026 to 17092M 2024-09-10T11:35:43.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:43.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:43.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:43.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi026 2024-09-10T11:35:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi026 to 17092M 2024-09-10T11:35:43.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:43.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:35:43.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:43.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:43 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:44.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:44 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:35:44.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:44 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:35:44.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:44 smithi081 ceph-mon[35059]: osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] boot 2024-09-10T11:35:44.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:44 smithi081 ceph-mon[35059]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T11:35:44.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:44.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:44 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:35:44.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:44 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:35:44.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:44 smithi026 ceph-mon[34817]: osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] boot 2024-09-10T11:35:44.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:44 smithi026 ceph-mon[34817]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T11:35:44.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:44.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:44 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:35:44.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:44 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:35:44.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:44 smithi017 ceph-mon[30817]: osd.1 [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] boot 2024-09-10T11:35:44.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:44 smithi017 ceph-mon[30817]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T11:35:44.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T11:35:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/964308082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]': finished 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:35:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:45 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/1210404973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T11:35:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/964308082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]': finished 2024-09-10T11:35:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T11:35:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:35:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:45 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/1210404973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T11:35:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T11:35:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/964308082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]: dispatch 2024-09-10T11:35:45.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b13f41eb-280d-4533-bea8-6b7793493dec"}]': finished 2024-09-10T11:35:45.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T11:35:45.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:35:45.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:45 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/1210404973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:35:47.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:47 smithi026 ceph-mon[34817]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:47 smithi017 ceph-mon[30817]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:47 smithi081 ceph-mon[35059]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:49.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:49 smithi026 ceph-mon[34817]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:49.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:49 smithi017 ceph-mon[30817]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:49 smithi081 ceph-mon[35059]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:51.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:51 smithi081 ceph-mon[35059]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:51.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:51 smithi026 ceph-mon[34817]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:51 smithi017 ceph-mon[30817]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:53.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:53 smithi026 ceph-mon[34817]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:53.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T11:35:53.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:53.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:53 smithi017 ceph-mon[30817]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:53.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T11:35:53.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:53.555 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:53 smithi081 ceph-mon[35059]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:53.556 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T11:35:53.556 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:35:54.367 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:54 smithi081 ceph-mon[35059]: Deploying daemon osd.2 on smithi081 2024-09-10T11:35:54.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:54 smithi026 ceph-mon[34817]: Deploying daemon osd.2 on smithi081 2024-09-10T11:35:54.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:54 smithi017 ceph-mon[30817]: Deploying daemon osd.2 on smithi081 2024-09-10T11:35:55.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:55 smithi026 ceph-mon[34817]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:55.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:55 smithi017 ceph-mon[30817]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:55.653 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:55 smithi081 ceph-mon[35059]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:57.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:57 smithi026 ceph-mon[34817]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:57.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:57 smithi017 ceph-mon[30817]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:57.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:57 smithi081 ceph-mon[35059]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:59.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:59 smithi026 ceph-mon[34817]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:59.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:59.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:59.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:35:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:59.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:59 smithi017 ceph-mon[30817]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:59.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:59.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:59.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:35:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:59.563 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:59 smithi081 ceph-mon[35059]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:35:59.563 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:35:59.563 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:35:59.563 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:35:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:01 smithi081 ceph-mon[35059]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:01 smithi026 ceph-mon[34817]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:01 smithi017 ceph-mon[30817]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.324+0000 7ffb7e7fc640 1 -- 172.21.15.81:0/370838917 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb88062630 con 0x7ffb740a2af0 2024-09-10T11:36:02.325 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 2 on host 'smithi081' 2024-09-10T11:36:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 msgr2=0x7ffb740a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 0x7ffb740a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb8806b050 tx=0x7ffb78009110 comp rx=0 tx=0).stop 2024-09-10T11:36:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 msgr2=0x7ffb8806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffb84031610 tx=0x7ffb840043b0 comp rx=0 tx=0).stop 2024-09-10T11:36:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 shutdown_connections 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffb740a2af0 0x7ffb740a4fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb88102690 0x7ffb8819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb88101cd0 0x7ffb8819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 --2- 172.21.15.81:0/370838917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88100ad0 0x7ffb8806aad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 >> 172.21.15.81:0/370838917 conn(0x7ffb880fc280 msgr2=0x7ffb881050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 shutdown_connections 2024-09-10T11:36:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:02.326+0000 7ffb8f3d7640 1 -- 172.21.15.81:0/370838917 wait complete. 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.621 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:02.622 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.622 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:02.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:02.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:02.941 DEBUG:teuthology.orchestra.run.smithi081:osd.2> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T11:36:02.944 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2024-09-10T11:36:02.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T11:36:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:36:04.610 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:04 smithi081 ceph-mon[35059]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:04.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:04 smithi017 ceph-mon[30817]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:04.841 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:04 smithi026 ceph-mon[34817]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:05.418 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:36:05.230+0000 7ff1201e6640 -1 osd.2 0 log_to_monitors true 2024-09-10T11:36:05.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:05 smithi017 ceph-mon[30817]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:05.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:05 smithi017 ceph-mon[30817]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:05.695 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:36:05.775 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:05 smithi081 ceph-mon[35059]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:05.775 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:05 smithi081 ceph-mon[35059]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:05.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-09-10T11:36:05.826 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:05 smithi026 ceph-mon[34817]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:05.826 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:05 smithi026 ceph-mon[34817]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T11:36:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:36:06.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.568+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2356347346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 msgr2=0x7fb5b0109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.568+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2356347346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b0109d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ca0 tx=0x7fb5a802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2356347346 shutdown_connections 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2356347346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b0109d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2356347346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 0x7fb5b0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2356347346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 0x7fb5b0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2356347346 >> 172.21.15.17:0/2356347346 conn(0x7fb5b00fc2a0 msgr2=0x7fb5b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2356347346 shutdown_connections 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2356347346 wait complete. 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 Processor -- start 2024-09-10T11:36:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.569+0000 7fb5b4ee4640 1 -- start start 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 0x7fb5b0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 0x7fb5b0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b010d8c0 con 0x7fb5b01079a0 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b010d740 con 0x7fb5b0105070 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b010da40 con 0x7fb5b0102740 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48922/0 (socket says 172.21.15.17:48922) 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5ae59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 0x7fb5b0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2242208100 learned_addr learned my addr 172.21.15.17:0/2242208100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5add9b640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 0x7fb5b0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2242208100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 msgr2=0x7fb5b0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 0x7fb5b0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2242208100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 msgr2=0x7fb5b0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 0x7fb5b0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 -- 172.21.15.17:0/2242208100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b019faf0 con 0x7fb5b01079a0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5aed9d640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005e30 tx=0x7fb5a8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8003c30 con 0x7fb5b01079a0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b019fd80 con 0x7fb5b01079a0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5a8003dd0 con 0x7fb5b01079a0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.570+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a802fde0 con 0x7fb5b01079a0 2024-09-10T11:36:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.571+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b01a0240 con 0x7fb5b01079a0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.571+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b00fdd90 con 0x7fb5b01079a0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.573+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fb5a8004050 con 0x7fb5b01079a0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.573+0000 7fb59f7fe640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 0x7fb5980a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.573+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fb5a80eeaf0 con 0x7fb5b01079a0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.573+0000 7fb5ae59c640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 0x7fb5980a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.574+0000 7fb5ae59c640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 0x7fb5980a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005fd0 tx=0x7fb5a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.578+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5a80bd1a0 con 0x7fb5b01079a0 2024-09-10T11:36:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:06.761+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb5b0062630 con 0x7fb5980a2b20 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi081 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:06.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-10T11:36:06.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:06.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:06.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:06 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:06.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T11:36:06.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi081 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:06.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:06.955 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:06 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:07.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi081 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-10T11:36:07.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:07.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:07.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:07.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:06 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:07.703 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:36:07.435+0000 7ff11c97d640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T11:36:07.704 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:36:07.444+0000 7ff113f78640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:36:07.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:36:07.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T11:36:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:07.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:07.706 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:07 smithi081 ceph-mon[35059]: from='osd.2 ' entity='osd.2' 2024-09-10T11:36:07.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:07.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:07 smithi017 ceph-mon[30817]: from='osd.2 ' entity='osd.2' 2024-09-10T11:36:08.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:36:08.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:08.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:07 smithi026 ceph-mon[34817]: from='osd.2 ' entity='osd.2' 2024-09-10T11:36:08.752 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:36:08.752 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:36:08.752 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:08.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:08.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] boot 2024-09-10T11:36:08.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T11:36:08.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] boot 2024-09-10T11:36:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T11:36:08.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:09.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:36:09.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:36:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-10T11:36:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: osd.2 [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] boot 2024-09-10T11:36:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T11:36:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T11:36:10.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:09 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]: dispatch 2024-09-10T11:36:10.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:09 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]': finished 2024-09-10T11:36:10.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:09 smithi017 ceph-mon[30817]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T11:36:10.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:09 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:10.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:09 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]: dispatch 2024-09-10T11:36:10.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:09 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]': finished 2024-09-10T11:36:10.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:09 smithi081 ceph-mon[35059]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T11:36:10.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:09 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:10.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:09 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]: dispatch 2024-09-10T11:36:10.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:09 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2087024915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dcd823-ec3a-4980-a67c-12cf81196b58"}]': finished 2024-09-10T11:36:10.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:09 smithi026 ceph-mon[34817]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T11:36:10.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:09 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/116809996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:11.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T11:36:11.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:11.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/116809996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T11:36:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:11.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/116809996' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:36:12.021 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:11 smithi017 sudo[49722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:12.021 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:11 smithi017 sudo[49722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:12.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:11 smithi017 sudo[49722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:12.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:11 smithi017 sudo[49722]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:12.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:12.105+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb5a80b9110 con 0x7fb5b01079a0 2024-09-10T11:36:12.379 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:12.379 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:12 smithi026 ceph-mon[34817]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T11:36:12.379 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:12 smithi081 ceph-mon[35059]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T11:36:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:36:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:12 smithi017 ceph-mon[30817]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T11:36:12.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:12.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:12 smithi017 sudo[49733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:12.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:12 smithi017 sudo[49733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:12.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:12 smithi017 sudo[49733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:12.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:36:12 smithi017 sudo[49733]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:12.647 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43455]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:12.647 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:12.647 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:12.647 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43455]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:13.004 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:13.004 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:13.004 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:13.005 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:36:12 smithi026 sudo[43458]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:13.175 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:12 smithi081 sudo[43734]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:13.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:12 smithi081 sudo[43734]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:13.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:12 smithi081 sudo[43734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:13.176 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:12 smithi081 sudo[43734]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:13.176 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:13.176 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T11:36:13.176 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T11:36:13.176 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:13.177 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.177 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:13 smithi081 sudo[43737]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:13.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:13 smithi081 sudo[43737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:13.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:13 smithi081 sudo[43737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:13.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:36:13 smithi081 sudo[43737]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T11:36:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T11:36:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T11:36:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T11:36:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:13.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 sudo[50482]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:13.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 sudo[50482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:13.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 sudo[50482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:13.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:13 smithi017 sudo[50482]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:14.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 sudo[50580]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:14.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 sudo[50580]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:14.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 sudo[50580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:14.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 sudo[50580]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:14.603 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43740]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:14.604 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:14.604 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:14.604 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43740]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:14.893 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43743]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43743]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 sudo[43743]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:14.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.129 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:14 smithi026 sudo[43461]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T11:36:15.129 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:14 smithi026 sudo[43461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:15.129 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:14 smithi026 sudo[43461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:15.130 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:14 smithi026 sudo[43461]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:15.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 sudo[43464]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T11:36:15.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 sudo[43464]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T11:36:15.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 sudo[43464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T11:36:15.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 sudo[43464]: pam_unix(sudo:session): session closed for user root 2024-09-10T11:36:15.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:15.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:15.507 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:15.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:15.885 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.885 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:15 smithi017 ceph-mon[30817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.899 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:15.899 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.899 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.899 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.900 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:15.900 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:15.900 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.900 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:15 smithi026 ceph-mon[34817]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T11:36:15.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T11:36:15.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:15 smithi081 ceph-mon[35059]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T11:36:16.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:16 smithi017 ceph-mon[30817]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:16.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:16 smithi081 ceph-mon[35059]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:17.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:16 smithi026 ceph-mon[34817]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T11:36:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:18.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T11:36:18.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:18.018 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T11:36:18.018 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:18.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:18 smithi017 ceph-mon[30817]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:18.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:18 smithi017 ceph-mon[30817]: Deploying daemon osd.3 on smithi017 2024-09-10T11:36:18.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:18 smithi081 ceph-mon[35059]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:18.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:18 smithi081 ceph-mon[35059]: Deploying daemon osd.3 on smithi017 2024-09-10T11:36:19.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:18 smithi026 ceph-mon[34817]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:19.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:18 smithi026 ceph-mon[34817]: Deploying daemon osd.3 on smithi017 2024-09-10T11:36:20.673 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:20 smithi017 ceph-mon[30817]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-10T11:36:20.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:20 smithi081 ceph-mon[35059]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-10T11:36:21.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:20 smithi026 ceph-mon[34817]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-10T11:36:22.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:22 smithi017 ceph-mon[30817]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-10T11:36:22.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:22 smithi081 ceph-mon[35059]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-10T11:36:23.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:22 smithi026 ceph-mon[34817]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-10T11:36:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:24 smithi081 ceph-mon[35059]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-10T11:36:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:24.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:24 smithi017 ceph-mon[30817]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-10T11:36:24.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:24.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:24.960 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:24 smithi026 ceph-mon[34817]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-10T11:36:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:25.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:27.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T11:36:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:27.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T11:36:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:27.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.621+0000 7fb59f7fe640 1 -- 172.21.15.17:0/2242208100 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb5b0062630 con 0x7fb5980a2b20 2024-09-10T11:36:27.623 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2024-09-10T11:36:27.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 msgr2=0x7fb5980a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 0x7fb5980a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005fd0 tx=0x7fb5a000b390 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 msgr2=0x7fb5b019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005e30 tx=0x7fb5a8031ee0 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 shutdown_connections 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb5980a2b20 0x7fb5980a4fe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b01079a0 0x7fb5b019f480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5b0105070 0x7fb5b0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 --2- 172.21.15.17:0/2242208100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b0102740 0x7fb5b0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 >> 172.21.15.17:0/2242208100 conn(0x7fb5b00fc2a0 msgr2=0x7fb5b01030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.623+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 shutdown_connections 2024-09-10T11:36:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:36:27.624+0000 7fb5b4ee4640 1 -- 172.21.15.17:0/2242208100 wait complete. 2024-09-10T11:36:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:28.231 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.231 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.258 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T11:36:28.260 INFO:tasks.cephadm:Deploying osd.4 on smithi026 with /dev/vg_nvme/lv_3... 2024-09-10T11:36:28.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T11:36:28.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:28.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:28.521 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:36:29.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:29 smithi026 ceph-mon[34817]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:29.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:29 smithi017 ceph-mon[30817]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:29.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:29 smithi081 ceph-mon[35059]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:30.235 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:30 smithi017 ceph-mon[30817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T11:36:30.235 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:36:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:36:29.973+0000 7fa48b234640 -1 osd.3 0 log_to_monitors true 2024-09-10T11:36:30.365 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:30 smithi026 ceph-mon[34817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T11:36:30.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:30 smithi081 ceph-mon[35059]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T11:36:31.015 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:36:31.041 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_3 2024-09-10T11:36:31.293 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:36:31.379 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:31.379 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:31.380 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:31.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:31.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 -- 172.21.15.26:0/3156989952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f8102e00 msgr2=0x7f24f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 --2- 172.21.15.26:0/3156989952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f8102e00 0x7f24f8103280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009900 tx=0x7f24e402a410 comp rx=0 tx=0).stop 2024-09-10T11:36:31.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 -- 172.21.15.26:0/3156989952 shutdown_connections 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 --2- 172.21.15.26:0/3156989952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f81037c0 0x7f24f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 --2- 172.21.15.26:0/3156989952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f8102e00 0x7f24f8103280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 --2- 172.21.15.26:0/3156989952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8101c00 0x7f24f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 -- 172.21.15.26:0/3156989952 >> 172.21.15.26:0/3156989952 conn(0x7f24f80fd390 msgr2=0x7f24f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 -- 172.21.15.26:0/3156989952 shutdown_connections 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.733+0000 7f24feeef640 1 -- 172.21.15.26:0/3156989952 wait complete. 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 Processor -- start 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 -- start start 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f8101c00 0x7f24f8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8102e00 0x7f24f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:31.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24f810d8e0 con 0x7f24f8102e00 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f24f810d760 con 0x7f24f81037c0 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24feeef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24f810da60 con 0x7f24f8101c00 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24fd48c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24fd48c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60410/0 (socket says 172.21.15.26:60410) 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.734+0000 7f24fd48c640 1 -- 172.21.15.26:0/3346220260 learned_addr learned my addr 172.21.15.26:0/3346220260 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24f7fff640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8102e00 0x7f24f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fcc8b640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f8101c00 0x7f24f8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 -- 172.21.15.26:0/3346220260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f8101c00 msgr2=0x7f24f8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f8101c00 0x7f24f8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 -- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8102e00 msgr2=0x7f24f80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:31.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8102e00 0x7f24f80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 -- 172.21.15.26:0/3346220260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f80753e0 con 0x7f24f81037c0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24fd48c640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b970 tx=0x7f24f000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0019070 con 0x7f24f81037c0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f000cb40 con 0x7f24f81037c0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f81a20c0 con 0x7f24f81037c0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0007650 con 0x7f24f81037c0 2024-09-10T11:36:31.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.735+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81a26a0 con 0x7f24f81037c0 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.736+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f8108fa0 con 0x7f24f81037c0 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.737+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f24f001c070 con 0x7f24f81037c0 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.738+0000 7f24f5ffb640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 0x7f24e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.738+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f24f00cd210 con 0x7f24f81037c0 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.738+0000 7f24fcc8b640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 0x7f24e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:31.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.739+0000 7f24fcc8b640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 0x7f24e80a50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24f8102c60 tx=0x7f24ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:31.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.743+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24f009ae60 con 0x7f24f81037c0 2024-09-10T11:36:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:31.926+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f24f8062630 con 0x7f24e80a2c00 2024-09-10T11:36:32.022 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:36:31.849+0000 7fa486994640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T11:36:32.022 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:36:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:36:31.855+0000 7fa47efc6640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:36:32.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi017 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:32.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] boot 2024-09-10T11:36:32.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T11:36:32.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi017 2024-09-10T11:36:32.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-10T11:36:32.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:36:32.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T11:36:32.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] boot 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T11:36:32.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi017 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588]' entity='osd.3' 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: osd.3 [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] boot 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T11:36:32.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T11:36:33.232 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:33 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:36:33.232 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:33 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:36:33.232 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:33 smithi026 ceph-mon[34817]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:33.232 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:33 smithi026 ceph-mon[34817]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:33.232 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:33 smithi026 ceph-mon[34817]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T11:36:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:33 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:36:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:33 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:36:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:33 smithi081 ceph-mon[35059]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:33 smithi081 ceph-mon[35059]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:33.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:33 smithi081 ceph-mon[35059]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T11:36:33.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:33 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:36:33.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:33 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:36:33.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:33 smithi017 ceph-mon[30817]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-10T11:36:33.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:33 smithi017 ceph-mon[30817]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:33.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:33 smithi017 ceph-mon[30817]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/969875531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]': finished 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T11:36:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:35.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:35 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/368844814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:35.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/969875531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]': finished 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:35.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:35 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/368844814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/969875531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]: dispatch 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8257cbe0-747a-4bcd-8aa4-1e78c14c151f"}]': finished 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:35.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:35 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/368844814' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:36:36.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:36 smithi026 ceph-mon[34817]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T11:36:36.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:36 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:36.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:36 smithi017 ceph-mon[30817]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T11:36:36.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:36 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:36 smithi081 ceph-mon[35059]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T11:36:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:36 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:37 smithi026 ceph-mon[34817]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-10T11:36:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:37 smithi026 ceph-mon[34817]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T11:36:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:37 smithi017 ceph-mon[30817]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-10T11:36:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:37 smithi017 ceph-mon[30817]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T11:36:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:37 smithi081 ceph-mon[35059]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-10T11:36:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:37 smithi081 ceph-mon[35059]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T11:36:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:39.381 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:39 smithi026 ceph-mon[34817]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T11:36:39.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:39 smithi017 ceph-mon[30817]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T11:36:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:39 smithi081 ceph-mon[35059]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T11:36:41.454 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:41 smithi026 ceph-mon[34817]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T11:36:41.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:41 smithi017 ceph-mon[30817]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T11:36:41.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:41 smithi081 ceph-mon[35059]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-10T11:36:43.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:43 smithi026 ceph-mon[34817]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:36:43.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T11:36:43.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:43 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:43 smithi017 ceph-mon[30817]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:36:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:43 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T11:36:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:43 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:43 smithi081 ceph-mon[35059]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:36:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:43 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T11:36:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:43 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:44.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:44 smithi081 ceph-mon[35059]: Deploying daemon osd.4 on smithi026 2024-09-10T11:36:44.478 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:44 smithi026 ceph-mon[34817]: Deploying daemon osd.4 on smithi026 2024-09-10T11:36:44.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:44 smithi017 ceph-mon[30817]: Deploying daemon osd.4 on smithi026 2024-09-10T11:36:45.330 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:45 smithi026 ceph-mon[34817]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:45 smithi017 ceph-mon[30817]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:45 smithi081 ceph-mon[35059]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:47.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:47 smithi026 ceph-mon[34817]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:47 smithi017 ceph-mon[30817]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:47 smithi081 ceph-mon[35059]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:49.469 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:49 smithi026 ceph-mon[34817]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:49.470 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:49.470 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:49.470 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:49.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:49 smithi017 ceph-mon[30817]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:49.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:49 smithi081 ceph-mon[35059]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:51.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:51 smithi026 ceph-mon[34817]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:51 smithi017 ceph-mon[30817]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:51 smithi081 ceph-mon[35059]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:52.490 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.490 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.491 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:52.491 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:52.491 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.491 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:52 smithi026 ceph-mon[34817]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:52.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.528+0000 7f24f5ffb640 1 -- 172.21.15.26:0/3346220260 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24f8062630 con 0x7f24e80a2c00 2024-09-10T11:36:52.530 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 4 on host 'smithi026' 2024-09-10T11:36:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 msgr2=0x7f24e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 0x7f24e80a50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24f8102c60 tx=0x7f24ec005f90 comp rx=0 tx=0).stop 2024-09-10T11:36:52.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 msgr2=0x7f24f8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b970 tx=0x7f24f000be30 comp rx=0 tx=0).stop 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 shutdown_connections 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f24e80a2c00 0x7f24e80a50c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24f81037c0 0x7f24f8074b20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8102e00 0x7f24f80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 --2- 172.21.15.26:0/3346220260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f8101c00 0x7f24f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.530+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 >> 172.21.15.26:0/3346220260 conn(0x7f24f80fd390 msgr2=0x7f24f8106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:52.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.531+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 shutdown_connections 2024-09-10T11:36:52.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:36:52.531+0000 7f24feeef640 1 -- 172.21.15.26:0/3346220260 wait complete. 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:52 smithi081 ceph-mon[35059]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:52.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:52 smithi017 ceph-mon[30817]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:53.138 DEBUG:teuthology.orchestra.run.smithi026:osd.4> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T11:36:53.140 INFO:tasks.cephadm:Deploying osd.5 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-10T11:36:53.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T11:36:53.368 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:53.368 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:53.368 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:36:53.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:53.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:53.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:53.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:36:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:54.400 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:54 smithi026 ceph-mon[34817]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:54.423 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:54 smithi081 ceph-mon[35059]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:54.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:54 smithi017 ceph-mon[30817]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:55.328 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:55 smithi081 ceph-mon[35059]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.328 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:55 smithi081 ceph-mon[35059]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.435 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:55 smithi026 ceph-mon[34817]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.435 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:55 smithi026 ceph-mon[34817]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.436 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:36:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:36:55.049+0000 7f0faef39640 -1 osd.4 0 log_to_monitors true 2024-09-10T11:36:55.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:55 smithi017 ceph-mon[30817]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:55 smithi017 ceph-mon[30817]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T11:36:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:36:55.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-10T11:36:56.074 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:36:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi026 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi026 to 8546M 2024-09-10T11:36:56.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:56.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:56.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 -- 172.21.15.81:0/1901473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a81026d0 msgr2=0x7ff0a8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 --2- 172.21.15.81:0/1901473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a81026d0 0x7ff0a8108f60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009ca0 tx=0x7ff0a002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 -- 172.21.15.81:0/1901473646 shutdown_connections 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 --2- 172.21.15.81:0/1901473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a81026d0 0x7ff0a8108f60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 --2- 172.21.15.81:0/1901473646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 --2- 172.21.15.81:0/1901473646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a8100b10 0x7ff0a8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 -- 172.21.15.81:0/1901473646 >> 172.21.15.81:0/1901473646 conn(0x7ff0a80fc2a0 msgr2=0x7ff0a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 -- 172.21.15.81:0/1901473646 shutdown_connections 2024-09-10T11:36:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.557+0000 7ff0acab8640 1 -- 172.21.15.81:0/1901473646 wait complete. 2024-09-10T11:36:56.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.559+0000 7ff0acab8640 1 Processor -- start 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.559+0000 7ff0acab8640 1 -- start start 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.559+0000 7ff0acab8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 0x7ff0a8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.559+0000 7ff0acab8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.559+0000 7ff0acab8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 0x7ff0a819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0acab8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810c790 con 0x7ff0a81026d0 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0acab8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810c610 con 0x7ff0a8101d10 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0acab8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a810c910 con 0x7ff0a8100b10 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0a659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 0x7ff0a8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.81:40876/0 (socket says 172.21.15.81:40876) 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 -- 172.21.15.81:0/280776311 learned_addr learned my addr 172.21.15.81:0/280776311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0a6d9d640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 0x7ff0a819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:56.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 -- 172.21.15.81:0/280776311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 msgr2=0x7ff0a8197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 0x7ff0a8197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 -- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 msgr2=0x7ff0a819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 0x7ff0a819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 -- 172.21.15.81:0/280776311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a819fbd0 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0a659c640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 0x7ff0a8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0a6d9d640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 0x7ff0a819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09dd9b640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff09000e9f0 tx=0x7ff09000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09000cd80 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a819fec0 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff090005500 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.560+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090010690 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.561+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81a0320 con 0x7ff0a8101d10 2024-09-10T11:36:56.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.561+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a81a05b0 con 0x7ff0a8101d10 2024-09-10T11:36:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.563+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff0900046c0 con 0x7ff0a8101d10 2024-09-10T11:36:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.564+0000 7ff09ffff640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 0x7ff0940a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:36:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.564+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3821+0+0 (secure 0 0 0) 0x7ff0900ce4e0 con 0x7ff0a8101d10 2024-09-10T11:36:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.564+0000 7ff0a659c640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 0x7ff0940a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:36:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.565+0000 7ff0a659c640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 0x7ff0940a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8101b70 tx=0x7ff09800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:36:56.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.567+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0900541b0 con 0x7ff0a8101d10 2024-09-10T11:36:56.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:36:56.740+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff0a81a0780 con 0x7ff0940a2bb0 2024-09-10T11:36:56.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T11:36:56.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T11:36:56.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi026 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi026 to 8546M 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:56.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi026 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:36:56.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi026 to 8546M 2024-09-10T11:36:56.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:56.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:56.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:36:56.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:36:57.254 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:36:56.944+0000 7f0faa699640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T11:36:57.254 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:36:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:36:56.949+0000 7f0fa2ccb640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:57.433 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:57 smithi081 ceph-mon[35059]: from='osd.4 ' entity='osd.4' 2024-09-10T11:36:57.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:57.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:57 smithi026 ceph-mon[34817]: from='osd.4 ' entity='osd.4' 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:36:57.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:57 smithi017 ceph-mon[30817]: from='osd.4 ' entity='osd.4' 2024-09-10T11:36:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] boot 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T11:36:58.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:36:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:36:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] boot 2024-09-10T11:36:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T11:36:58.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:36:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:36:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:36:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-10T11:36:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: osd.4 [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] boot 2024-09-10T11:36:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T11:36:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T11:37:00.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/1263034742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]': finished 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:00.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:36:59 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/1389399843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:00.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/1263034742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]': finished 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:00.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:36:59 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/1389399843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/1263034742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]: dispatch 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f15ffb10-de2f-44fc-9a53-676c63a25e4b"}]': finished 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T11:37:00.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:00.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:36:59 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/1389399843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:01 smithi081 ceph-mon[35059]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:01 smithi026 ceph-mon[34817]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:01 smithi017 ceph-mon[30817]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:03.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:03 smithi081 ceph-mon[35059]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:03.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:03 smithi026 ceph-mon[34817]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:03.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:03 smithi017 ceph-mon[30817]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:05.400 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:05 smithi081 ceph-mon[35059]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:05 smithi026 ceph-mon[34817]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:05 smithi017 ceph-mon[30817]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:07.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:07 smithi081 ceph-mon[35059]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:07 smithi026 ceph-mon[34817]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:07 smithi017 ceph-mon[30817]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:08.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T11:37:08.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:08.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T11:37:08.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:08.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T11:37:08.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:09.254 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:09 smithi081 ceph-mon[35059]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:09.255 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:09 smithi081 ceph-mon[35059]: Deploying daemon osd.5 on smithi081 2024-09-10T11:37:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:09 smithi026 ceph-mon[34817]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:09 smithi026 ceph-mon[34817]: Deploying daemon osd.5 on smithi081 2024-09-10T11:37:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:09 smithi017 ceph-mon[30817]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:09 smithi017 ceph-mon[30817]: Deploying daemon osd.5 on smithi081 2024-09-10T11:37:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:11 smithi081 ceph-mon[35059]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:11.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:11 smithi026 ceph-mon[34817]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:11 smithi017 ceph-mon[30817]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:13 smithi081 ceph-mon[35059]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:13 smithi026 ceph-mon[34817]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:13 smithi017 ceph-mon[30817]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:14.200 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:14.200 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:14.200 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:14.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:14 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:14.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:14 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:14.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:14 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:14.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:14.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:14.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:15.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:15 smithi081 ceph-mon[35059]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:15 smithi026 ceph-mon[34817]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:15.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:15 smithi017 ceph-mon[30817]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:17.438 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:17.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:17.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:17.439 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.476+0000 7ff09ffff640 1 -- 172.21.15.81:0/280776311 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff0a81a0780 con 0x7ff0940a2bb0 2024-09-10T11:37:17.479 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 5 on host 'smithi081' 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 msgr2=0x7ff0940a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 0x7ff0940a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8101b70 tx=0x7ff09800a2d0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 msgr2=0x7ff0a81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff09000e9f0 tx=0x7ff09000edf0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 shutdown_connections 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff0940a2bb0 0x7ff0940a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a81026d0 0x7ff0a819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0a8101d10 0x7ff0a81984e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 --2- 172.21.15.81:0/280776311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8100b10 0x7ff0a8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 >> 172.21.15.81:0/280776311 conn(0x7ff0a80fc2a0 msgr2=0x7ff0a806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 shutdown_connections 2024-09-10T11:37:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:37:17.478+0000 7ff0acab8640 1 -- 172.21.15.81:0/280776311 wait complete. 2024-09-10T11:37:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:17.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:17.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.109 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:18.109 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.109 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.136 DEBUG:teuthology.orchestra.run.smithi081:osd.5> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T11:37:18.138 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2024-09-10T11:37:18.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T11:37:18.405 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:37:18.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:18.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:18.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:18.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:19.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:19 smithi017 ceph-mon[30817]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:19.385 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:19 smithi081 ceph-mon[35059]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:19 smithi026 ceph-mon[34817]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:20.078 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:37:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:37:19.826+0000 7f628f6c1640 -1 osd.5 0 log_to_monitors true 2024-09-10T11:37:20.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:20 smithi017 ceph-mon[30817]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:20.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:20 smithi017 ceph-mon[30817]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:20 smithi081 ceph-mon[35059]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:20.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:20 smithi081 ceph-mon[35059]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:20 smithi026 ceph-mon[34817]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:20.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:20 smithi026 ceph-mon[34817]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T11:37:21.031 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:37:21.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-09-10T11:37:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:37:21.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:21.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:21.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 -- 172.21.15.17:0/4280080865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910101cd0 msgr2=0x7f1910102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 --2- 172.21.15.17:0/4280080865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910101cd0 0x7f1910102150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009860 tx=0x7f18fc02a340 comp rx=0 tx=0).stop 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 -- 172.21.15.17:0/4280080865 shutdown_connections 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 --2- 172.21.15.17:0/4280080865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910101cd0 0x7f1910102150 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 --2- 172.21.15.17:0/4280080865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910102690 0x7f1910108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 --2- 172.21.15.17:0/4280080865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910100ad0 0x7f1910100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 -- 172.21.15.17:0/4280080865 >> 172.21.15.17:0/4280080865 conn(0x7f19100fc280 msgr2=0x7f19100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 -- 172.21.15.17:0/4280080865 shutdown_connections 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.759+0000 7f1917171640 1 -- 172.21.15.17:0/4280080865 wait complete. 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 Processor -- start 2024-09-10T11:37:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 -- start start 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910100ad0 0x7f1910197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 0x7f191019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f191010c730 con 0x7f1910101cd0 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f191010c5b0 con 0x7f1910100ad0 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1917171640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f191010c8b0 con 0x7f1910102690 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f190ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f190ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49796/0 (socket says 172.21.15.17:49796) 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f190ffff640 1 -- 172.21.15.17:0/4239731741 learned_addr learned my addr 172.21.15.17:0/4239731741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f191570e640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 0x7f191019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f1914f0d640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910100ad0 0x7f1910197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f191570e640 1 -- 172.21.15.17:0/4239731741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910100ad0 msgr2=0x7f1910197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.760+0000 7f191570e640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910100ad0 0x7f1910197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f191570e640 1 -- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 msgr2=0x7f1910198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f191570e640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f191570e640 1 -- 172.21.15.17:0/4239731741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191019fad0 con 0x7f1910102690 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f190ffff640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f191570e640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 0x7f191019f460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1908009d90 tx=0x7f190800b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908004d20 con 0x7f1910102690 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1908005020 con 0x7f1910102690 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1910103140 con 0x7f1910102690 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190800f680 con 0x7f1910102690 2024-09-10T11:37:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.761+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1910103600 con 0x7f1910102690 2024-09-10T11:37:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.762+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19101038c0 con 0x7f1910102690 2024-09-10T11:37:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.763+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1908005540 con 0x7f1910102690 2024-09-10T11:37:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.764+0000 7f190dffb640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 0x7f19000a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.764+0000 7f1914f0d640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 0x7f19000a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.764+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4253+0+0 (secure 0 0 0) 0x7f19080cdfe0 con 0x7f1910102690 2024-09-10T11:37:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.765+0000 7f1914f0d640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 0x7f19000a5070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1904009530 tx=0x7f1904009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:37:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.769+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f190809bea0 con 0x7f1910102690 2024-09-10T11:37:21.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:21.953+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1910062630 con 0x7f19000a2bb0 2024-09-10T11:37:22.204 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:37:21.869+0000 7f628ae21640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T11:37:22.204 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:37:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:37:21.876+0000 7f6283453640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:37:22.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi081 2024-09-10T11:37:22.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='osd.5 ' entity='osd.5' 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:22.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:22.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi081 2024-09-10T11:37:22.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-10T11:37:22.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:37:22.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='osd.5 ' entity='osd.5' 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:22.373 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:22.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi081 2024-09-10T11:37:22.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='osd.5 ' entity='osd.5' 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:22.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] boot 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T11:37:23.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:37:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:37:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] boot 2024-09-10T11:37:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T11:37:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:37:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: osd.5 [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] boot 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T11:37:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T11:37:24.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:24 smithi017 ceph-mon[30817]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T11:37:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:24 smithi081 ceph-mon[35059]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T11:37:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:24 smithi026 ceph-mon[34817]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T11:37:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T11:37:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]: dispatch 2024-09-10T11:37:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]': finished 2024-09-10T11:37:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T11:37:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:25 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3216547489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]: dispatch 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]': finished 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:25 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3216547489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T11:37:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]: dispatch 2024-09-10T11:37:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2085471403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac8679de-8c70-44cb-b0bf-528b334c3e70"}]': finished 2024-09-10T11:37:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T11:37:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:25 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3216547489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:26 smithi026 ceph-mon[34817]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T11:37:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:26 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:26.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:26 smithi017 ceph-mon[30817]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T11:37:26.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:26 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:26.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:26 smithi081 ceph-mon[35059]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T11:37:26.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:26 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:27 smithi026 ceph-mon[34817]: pgmap v138: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:27 smithi026 ceph-mon[34817]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:37:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:27 smithi026 ceph-mon[34817]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T11:37:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:27.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:27 smithi017 ceph-mon[30817]: pgmap v138: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:27.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:27 smithi017 ceph-mon[30817]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:37:27.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:27 smithi017 ceph-mon[30817]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T11:37:27.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:27 smithi081 ceph-mon[35059]: pgmap v138: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:27 smithi081 ceph-mon[35059]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:37:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:27 smithi081 ceph-mon[35059]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T11:37:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:29.383 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:29 smithi017 ceph-mon[30817]: pgmap v140: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:29 smithi026 ceph-mon[34817]: pgmap v140: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:29 smithi081 ceph-mon[35059]: pgmap v140: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:37:30.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:30 smithi017 ceph-mon[30817]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T11:37:30.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:30 smithi017 ceph-mon[30817]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:37:30.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:30 smithi017 ceph-mon[30817]: Cluster is now healthy 2024-09-10T11:37:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:30 smithi081 ceph-mon[35059]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T11:37:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:30 smithi081 ceph-mon[35059]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:37:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:30 smithi081 ceph-mon[35059]: Cluster is now healthy 2024-09-10T11:37:30.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:30 smithi026 ceph-mon[34817]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T11:37:30.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:30 smithi026 ceph-mon[34817]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:37:30.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:30 smithi026 ceph-mon[34817]: Cluster is now healthy 2024-09-10T11:37:32.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:32 smithi081 ceph-mon[35059]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:37:32.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:32 smithi026 ceph-mon[34817]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:37:32.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:32 smithi017 ceph-mon[30817]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T11:37:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:33 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T11:37:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:33 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:33 smithi081 ceph-mon[35059]: Deploying daemon osd.6 on smithi017 2024-09-10T11:37:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:33 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T11:37:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:33 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:33 smithi026 ceph-mon[34817]: Deploying daemon osd.6 on smithi017 2024-09-10T11:37:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:33 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T11:37:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:33 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:33 smithi017 ceph-mon[30817]: Deploying daemon osd.6 on smithi017 2024-09-10T11:37:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:34 smithi081 ceph-mon[35059]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T11:37:34.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:34 smithi026 ceph-mon[34817]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T11:37:34.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:34 smithi017 ceph-mon[30817]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T11:37:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:36 smithi081 ceph-mon[35059]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:37:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:36 smithi026 ceph-mon[34817]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:37:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:36 smithi017 ceph-mon[30817]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:37:38.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:38 smithi017 ceph-mon[30817]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T11:37:38.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:38.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:38.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:38.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:38 smithi081 ceph-mon[35059]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T11:37:38.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:38.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:38.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:38 smithi026 ceph-mon[34817]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T11:37:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:40.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:40 smithi017 ceph-mon[30817]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:37:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:40 smithi081 ceph-mon[35059]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:37:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:40 smithi026 ceph-mon[34817]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:37:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.005+0000 7f190dffb640 1 -- 172.21.15.17:0/4239731741 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1910062630 con 0x7f19000a2bb0 2024-09-10T11:37:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2024-09-10T11:37:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 msgr2=0x7f19000a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 0x7f19000a5070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1904009530 tx=0x7f1904009260 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 msgr2=0x7f191019f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 0x7f191019f460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1908009d90 tx=0x7f190800b630 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 shutdown_connections 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19000a2bb0 0x7f19000a5070 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910102690 0x7f191019f460 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1910101cd0 0x7f1910198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 --2- 172.21.15.17:0/4239731741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1910100ad0 0x7f1910197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 >> 172.21.15.17:0/4239731741 conn(0x7f19100fc280 msgr2=0x7f19100fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 shutdown_connections 2024-09-10T11:37:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:37:42.007+0000 7f1917171640 1 -- 172.21.15.17:0/4239731741 wait complete. 2024-09-10T11:37:42.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:42 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:42.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:42 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:42 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:42.561 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T11:37:42.564 INFO:tasks.cephadm:Deploying osd.7 on smithi026 with /dev/vg_nvme/lv_2... 2024-09-10T11:37:42.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T11:37:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:37:43.207 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:43 smithi026 ceph-mon[34817]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:43.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:43 smithi081 ceph-mon[35059]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:43.457 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:43 smithi017 ceph-mon[30817]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:45.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:37:44 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:37:44.654+0000 7f0d4eae3640 -1 osd.6 0 log_to_monitors true 2024-09-10T11:37:45.298 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:45 smithi017 ceph-mon[30817]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:45.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:45 smithi017 ceph-mon[30817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T11:37:45.347 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:45 smithi081 ceph-mon[35059]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:45.347 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:45 smithi081 ceph-mon[35059]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T11:37:45.408 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:45 smithi026 ceph-mon[34817]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:45.408 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:45 smithi026 ceph-mon[34817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T11:37:45.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:37:45.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_2 2024-09-10T11:37:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:37:46.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T11:37:46.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T11:37:46.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:37:46.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:46 smithi081 ceph-mon[35059]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:37:46.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3197548494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0102690 msgr2=0x7f24b0069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:46.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3197548494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0102690 0x7f24b0069f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009ca0 tx=0x7f24a802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3197548494 shutdown_connections 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3197548494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0102690 0x7f24b0069f70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3197548494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0101cd0 0x7f24b0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3197548494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 0x7f24b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3197548494 >> 172.21.15.26:0/3197548494 conn(0x7f24b00fc280 msgr2=0x7f24b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3197548494 shutdown_connections 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.245+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3197548494 wait complete. 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 Processor -- start 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 -- start start 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 0x7f24b019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:46.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 0x7f24b01a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24b010faa0 con 0x7f24b0102690 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f24b010f920 con 0x7f24b0101cd0 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.246+0000 7f24b5f2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24b010fc20 con 0x7f24b0100ad0 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:32920/0 (socket says 172.21.15.26:32920) 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3241586489 learned_addr learned my addr 172.21.15.26:0/3241586489 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24af7fe640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 0x7f24b019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24affff640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 0x7f24b01a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3241586489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 msgr2=0x7f24b019a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 0x7f24b019a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 msgr2=0x7f24b01a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 0x7f24b01a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:37:46.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 -- 172.21.15.26:0/3241586489 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01a1d10 con 0x7f24b0101cd0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24affff640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 0x7f24b01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24a6ffd640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249800c890 tx=0x7f249800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498004220 con 0x7f24b0101cd0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24980043c0 con 0x7f24b0101cd0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01a1fa0 con 0x7f24b0101cd0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24980049e0 con 0x7f24b0101cd0 2024-09-10T11:37:46.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.247+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a2500 con 0x7f24b0101cd0 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.249+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0109f20 con 0x7f24b0101cd0 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.250+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f24980079b0 con 0x7f24b0101cd0 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.250+0000 7f24ad7fa640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 0x7f249c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.251+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4685+0+0 (secure 0 0 0) 0x7f24980ce260 con 0x7f24b0101cd0 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.251+0000 7f24af7fe640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 0x7f249c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:37:46.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.251+0000 7f24af7fe640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 0x7f249c0a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005fd0 tx=0x7f24a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:37:46.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.254+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2498014030 con 0x7f24b0101cd0 2024-09-10T11:37:46.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:37:46.441+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f24b0062630 con 0x7f249c0a2c30 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.443 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.444 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:46 smithi026 ceph-mon[34817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:37:46.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:37:46.053+0000 7f0d4a243640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T11:37:46.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:37:46.065+0000 7f0d4687d640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:37:46.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:46 smithi017 ceph-mon[30817]: from='osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi017 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:47.165 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:47.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi017 2024-09-10T11:37:47.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-10T11:37:47.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:47.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T11:37:47.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi017 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:37:47.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:48.391 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:37:48.391 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:37:48.391 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:48.391 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] boot 2024-09-10T11:37:48.391 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T11:37:48.392 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] boot 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T11:37:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: osd.6 [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] boot 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: osdmap e46: 7 total, 7 up, 7 in 2024-09-10T11:37:48.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/1302464153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]': finished 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T11:37:49.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/1302464153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]': finished 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T11:37:49.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/1302464153' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]: dispatch 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57a224a6-f735-4d6a-ac05-574a5b979db9"}]': finished 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T11:37:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:37:50.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:50 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/543757843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:50.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:50 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/543757843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:50.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:50 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/543757843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:37:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:51 smithi081 ceph-mon[35059]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:51.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:51 smithi026 ceph-mon[34817]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:51 smithi017 ceph-mon[30817]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:53.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:53 smithi081 ceph-mon[35059]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:53.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:53 smithi026 ceph-mon[34817]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:53.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:53 smithi017 ceph-mon[30817]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:55.437 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:55 smithi026 ceph-mon[34817]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:55.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:55 smithi081 ceph-mon[35059]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:55.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:55 smithi017 ceph-mon[30817]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:57.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:57 smithi081 ceph-mon[35059]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:57.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:57 smithi026 ceph-mon[34817]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:57.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:57 smithi017 ceph-mon[30817]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:58.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T11:37:58.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:58 smithi026 ceph-mon[34817]: Deploying daemon osd.7 on smithi026 2024-09-10T11:37:58.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T11:37:58.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:58.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:58 smithi081 ceph-mon[35059]: Deploying daemon osd.7 on smithi026 2024-09-10T11:37:58.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T11:37:58.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:37:58.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:58 smithi017 ceph-mon[30817]: Deploying daemon osd.7 on smithi026 2024-09-10T11:37:59.183 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:37:59 smithi026 ceph-mon[34817]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:59.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:37:59 smithi081 ceph-mon[35059]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:37:59.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:37:59 smithi017 ceph-mon[30817]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:01 smithi081 ceph-mon[35059]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:01 smithi026 ceph-mon[34817]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:01 smithi017 ceph-mon[30817]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:03.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:03 smithi026 ceph-mon[34817]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:03.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:03 smithi081 ceph-mon[35059]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:03.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:03 smithi017 ceph-mon[30817]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:04.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:04 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:04.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:04 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:04.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:04 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:04.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:04 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:04.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:04 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:04.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:04 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:04.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:04.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:04.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:04 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:05 smithi026 ceph-mon[34817]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:05 smithi017 ceph-mon[30817]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:05 smithi081 ceph-mon[35059]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.208+0000 7f24ad7fa640 1 -- 172.21.15.26:0/3241586489 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24b0062630 con 0x7f249c0a2c30 2024-09-10T11:38:06.210 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 7 on host 'smithi026' 2024-09-10T11:38:06.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.211+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 msgr2=0x7f249c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:06.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.211+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 0x7f249c0a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005fd0 tx=0x7f24a0005850 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.211+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 msgr2=0x7f24b019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.211+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249800c890 tx=0x7f249800cd50 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 shutdown_connections 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f249c0a2c30 0x7f249c0a50f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b0102690 0x7f24b01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24b0101cd0 0x7f24b019a620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 --2- 172.21.15.26:0/3241586489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b0100ad0 0x7f24b019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 >> 172.21.15.26:0/3241586489 conn(0x7f24b00fc280 msgr2=0x7f24b01070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 shutdown_connections 2024-09-10T11:38:06.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:06.212+0000 7f24b5f2b640 1 -- 172.21.15.26:0/3241586489 wait complete. 2024-09-10T11:38:06.798 DEBUG:teuthology.orchestra.run.smithi026:osd.7> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T11:38:06.801 INFO:tasks.cephadm:Deploying osd.8 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-10T11:38:06.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T11:38:07.055 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:38:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:07 smithi081 ceph-mon[35059]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:07.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:07 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:07 smithi026 ceph-mon[34817]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:07 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:07 smithi017 ceph-mon[30817]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:07.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:07 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:09.493 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:09 smithi081 ceph-mon[35059]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:09.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:38:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:09 smithi026 ceph-mon[34817]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:09 smithi017 ceph-mon[30817]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:09.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-10T11:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:38:09.819 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:38:09 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:38:09.531+0000 7f50274ab640 -1 osd.7 0 log_to_monitors true 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 -- 172.21.15.81:0/1002125953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 msgr2=0x7f5588107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 --2- 172.21.15.81:0/1002125953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588107420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5578009900 tx=0x7f557802a410 comp rx=0 tx=0).stop 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 -- 172.21.15.81:0/1002125953 shutdown_connections 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 --2- 172.21.15.81:0/1002125953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588107420 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 --2- 172.21.15.81:0/1002125953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588107960 0x7f5588109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 --2- 172.21.15.81:0/1002125953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588102700 0x7f5588104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 -- 172.21.15.81:0/1002125953 >> 172.21.15.81:0/1002125953 conn(0x7f55880fc280 msgr2=0x7f55880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:10.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 -- 172.21.15.81:0/1002125953 shutdown_connections 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.213+0000 7f558f2c2640 1 -- 172.21.15.81:0/1002125953 wait complete. 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 Processor -- start 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 -- start start 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588102700 0x7f5588197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 0x7f558819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f558810d830 con 0x7f5588107960 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f558810d6b0 con 0x7f5588102700 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558f2c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f558810d9b0 con 0x7f5588105030 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558c85d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558d05e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588102700 0x7f5588197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558c85d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42988/0 (socket says 172.21.15.81:42988) 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558c85d640 1 -- 172.21.15.81:0/87008528 learned_addr learned my addr 172.21.15.81:0/87008528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.214+0000 7f558d85f640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 0x7f558819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 -- 172.21.15.81:0/87008528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588102700 msgr2=0x7f5588197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588102700 0x7f5588197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 -- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 msgr2=0x7f558819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 0x7f558819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 -- 172.21.15.81:0/87008528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558819fb70 con 0x7f5588105030 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558d85f640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 0x7f558819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558c85d640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5578031610 tx=0x7f5578004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557803f030 con 0x7f5588105030 2024-09-10T11:38:10.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578003ad0 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558819fe00 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578035070 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.215+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55881a0260 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.216+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55880fdd70 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.217+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5578042030 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.218+0000 7f557e7fc640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 0x7f55740a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.218+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5101+0+0 (secure 0 0 0) 0x7f55780eebc0 con 0x7f5588105030 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.218+0000 7f558d05e640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 0x7f55740a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.219+0000 7f558d05e640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 0x7f55740a50f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5584009bd0 tx=0x7f5584005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:10.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.224+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55780bc160 con 0x7f5588105030 2024-09-10T11:38:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:10.407+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5588062630 con 0x7f55740a2c30 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.410 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:10.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:10.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi026 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi026 to 5697M 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:11.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:11.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:11.504 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:38:11.221+0000 7f5022c0b640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T11:38:11.505 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:38:11.232+0000 7f501f245640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:11.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:11.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi026 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi026 to 5697M 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.507 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:11.507 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:11.507 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi026 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi026 to 5697M 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:11.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:38:11.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:11.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:11.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:12.382 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:12 smithi081 ceph-mon[35059]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:12.382 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:12 smithi081 ceph-mon[35059]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:38:12.382 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:12 smithi081 ceph-mon[35059]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T11:38:12.383 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:12.383 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:12.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:12 smithi026 ceph-mon[34817]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:12.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:12 smithi026 ceph-mon[34817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:38:12.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:12 smithi026 ceph-mon[34817]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T11:38:12.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:12.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:12 smithi017 ceph-mon[30817]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:12 smithi017 ceph-mon[30817]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:38:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:12 smithi017 ceph-mon[30817]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T11:38:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:12.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] boot 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/1469100968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]': finished 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T11:38:13.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] boot 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/1469100968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]': finished 2024-09-10T11:38:13.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T11:38:13.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: osd.7 [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] boot 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T11:38:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/1469100968' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]: dispatch 2024-09-10T11:38:13.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ba82601-c53f-4ac8-a80d-b3432adeee27"}]': finished 2024-09-10T11:38:13.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T11:38:13.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:14.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:14 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/3815730668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:14.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:14 smithi026 ceph-mon[34817]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T11:38:14.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:14 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:14.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:14 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/3815730668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:14.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:14 smithi017 ceph-mon[30817]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T11:38:14.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:14 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:14.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:14 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/3815730668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:14.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:14 smithi081 ceph-mon[35059]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T11:38:14.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:14 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:15 smithi026 ceph-mon[34817]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:15.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:15 smithi017 ceph-mon[30817]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:15 smithi081 ceph-mon[35059]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:16.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:16 smithi026 ceph-mon[34817]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T11:38:16.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:16.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:16 smithi017 ceph-mon[30817]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T11:38:16.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:16.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:16 smithi081 ceph-mon[35059]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T11:38:16.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:17 smithi026 ceph-mon[34817]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:17 smithi026 ceph-mon[34817]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T11:38:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:17 smithi017 ceph-mon[30817]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:17 smithi017 ceph-mon[30817]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T11:38:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:17 smithi081 ceph-mon[35059]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:17 smithi081 ceph-mon[35059]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T11:38:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:19.449 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:19 smithi081 ceph-mon[35059]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:19 smithi026 ceph-mon[34817]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:19 smithi017 ceph-mon[30817]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:21 smithi026 ceph-mon[34817]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:21 smithi017 ceph-mon[30817]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:21.686 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:21 smithi081 ceph-mon[35059]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:22.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T11:38:22.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:22 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:22.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:22 smithi081 ceph-mon[35059]: Deploying daemon osd.8 on smithi081 2024-09-10T11:38:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T11:38:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:22 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:22.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:22 smithi017 ceph-mon[30817]: Deploying daemon osd.8 on smithi081 2024-09-10T11:38:22.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T11:38:22.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:22 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:22.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:22 smithi026 ceph-mon[34817]: Deploying daemon osd.8 on smithi081 2024-09-10T11:38:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:23 smithi081 ceph-mon[35059]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:23 smithi017 ceph-mon[30817]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:23.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:23 smithi026 ceph-mon[34817]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:25 smithi017 ceph-mon[30817]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:25.593 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:25 smithi081 ceph-mon[35059]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:25.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:25 smithi026 ceph-mon[34817]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:27.518 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:27 smithi081 ceph-mon[35059]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:27.518 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:27.518 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:27.518 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:27 smithi017 ceph-mon[30817]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:27 smithi026 ceph-mon[34817]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:29.383 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:29 smithi081 ceph-mon[35059]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:29 smithi017 ceph-mon[30817]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:29 smithi026 ceph-mon[34817]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.495+0000 7f557e7fc640 1 -- 172.21.15.81:0/87008528 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5588062630 con 0x7f55740a2c30 2024-09-10T11:38:30.499 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 8 on host 'smithi081' 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 msgr2=0x7f55740a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 0x7f55740a50f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5584009bd0 tx=0x7f5584005f90 comp rx=0 tx=0).stop 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 msgr2=0x7f5588198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5578031610 tx=0x7f5578004270 comp rx=0 tx=0).stop 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 shutdown_connections 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f55740a2c30 0x7f55740a50f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5588105030 0x7f5588198480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5588107960 0x7f558819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 --2- 172.21.15.81:0/87008528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5588102700 0x7f5588197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 >> 172.21.15.81:0/87008528 conn(0x7f55880fc280 msgr2=0x7f5588103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 shutdown_connections 2024-09-10T11:38:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:38:30.497+0000 7f558f2c2640 1 -- 172.21.15.81:0/87008528 wait complete. 2024-09-10T11:38:30.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.797 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:30.798 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:31.100 DEBUG:teuthology.orchestra.run.smithi081:osd.8> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T11:38:31.102 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2024-09-10T11:38:31.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T11:38:31.370 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:38:32.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:32 smithi017 ceph-mon[30817]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:32 smithi081 ceph-mon[35059]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:33.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:32 smithi026 ceph-mon[34817]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:33.519 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:38:33 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:38:33.425+0000 7fe52a25d640 -1 osd.8 0 log_to_monitors true 2024-09-10T11:38:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:33 smithi017 ceph-mon[30817]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:33 smithi017 ceph-mon[30817]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:33.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:33 smithi081 ceph-mon[35059]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:33.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:33 smithi081 ceph-mon[35059]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:33.863 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:38:33.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2024-09-10T11:38:34.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:33 smithi026 ceph-mon[34817]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:34.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:33 smithi026 ceph-mon[34817]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T11:38:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:38:34.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:34.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T11:38:34.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T11:38:34.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi081 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:34.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:34.557 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 -- 172.21.15.17:0/3822762606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 msgr2=0x7faa98101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 --2- 172.21.15.17:0/3822762606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa98101270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa94009900 tx=0x7faa9402a410 comp rx=0 tx=0).stop 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 -- 172.21.15.17:0/3822762606 shutdown_connections 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 --2- 172.21.15.17:0/3822762606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981017b0 0x7faa98101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 --2- 172.21.15.17:0/3822762606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa98101270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 --2- 172.21.15.17:0/3822762606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981004d0 0x7faa981008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 -- 172.21.15.17:0/3822762606 >> 172.21.15.17:0/3822762606 conn(0x7faa980fc280 msgr2=0x7faa980fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 -- 172.21.15.17:0/3822762606 shutdown_connections 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.640+0000 7faa9f90a640 1 -- 172.21.15.17:0/3822762606 wait complete. 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 Processor -- start 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 -- start start 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981004d0 0x7faa9819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981017b0 0x7faa981a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faa9810fa40 con 0x7faa98100e10 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faa9810f8c0 con 0x7faa981004d0 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9f90a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa9810fbc0 con 0x7faa981017b0 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9cea5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9cea5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40944/0 (socket says 172.21.15.17:40944) 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9cea5640 1 -- 172.21.15.17:0/531878071 learned_addr learned my addr 172.21.15.17:0/531878071 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9dea7640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981017b0 0x7faa981a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.641+0000 7faa9d6a6640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981004d0 0x7faa9819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 -- 172.21.15.17:0/531878071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981017b0 msgr2=0x7faa981a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981017b0 0x7faa981a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 -- 172.21.15.17:0/531878071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981004d0 msgr2=0x7faa9819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981004d0 0x7faa9819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 -- 172.21.15.17:0/531878071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa981a1c80 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9cea5640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa94009230 tx=0x7faa94031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9403f030 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94003ad0 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa981a1f10 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94035070 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.642+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981a2360 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.643+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9810b220 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.644+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faa94042030 con 0x7faa98100e10 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.645+0000 7faa8e7fc640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 0x7faa840a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.645+0000 7faa9d6a6640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 0x7faa840a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.645+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5549+0+0 (secure 0 0 0) 0x7faa940eee70 con 0x7faa98100e10 2024-09-10T11:38:34.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.646+0000 7faa9d6a6640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 0x7faa840a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa88009bd0 tx=0x7faa88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:34.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.648+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa940bc1b0 con 0x7faa98100e10 2024-09-10T11:38:34.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:34.833+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faa98062630 con 0x7faa840a2bb0 2024-09-10T11:38:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T11:38:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T11:38:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi081 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:34.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:35.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi081 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-10T11:38:35.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:35.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:35.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:35.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:35.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:38:35.357+0000 7fe5259bd640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T11:38:35.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:38:35.371+0000 7fe51dfef640 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:38:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T11:38:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:35 smithi081 ceph-mon[35059]: from='osd.8 ' entity='osd.8' 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:35 smithi017 ceph-mon[30817]: from='osd.8 ' entity='osd.8' 2024-09-10T11:38:36.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:38:36.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:36.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:35 smithi026 ceph-mon[34817]: from='osd.8 ' entity='osd.8' 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] boot 2024-09-10T11:38:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T11:38:36.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:36 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] boot 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T11:38:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:36 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:38:36.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:38:36.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-09-10T11:38:36.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:36.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: osd.8 [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] boot 2024-09-10T11:38:36.907 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T11:38:36.907 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:36 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T11:38:37.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:37 smithi017 ceph-mon[30817]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T11:38:37.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:37 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]: dispatch 2024-09-10T11:38:37.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:37 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]': finished 2024-09-10T11:38:37.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:37 smithi017 ceph-mon[30817]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T11:38:37.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:37 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:37 smithi081 ceph-mon[35059]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T11:38:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:37 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]: dispatch 2024-09-10T11:38:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:37 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]': finished 2024-09-10T11:38:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:37 smithi081 ceph-mon[35059]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T11:38:37.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:37 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:38.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:37 smithi026 ceph-mon[34817]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T11:38:38.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:37 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]: dispatch 2024-09-10T11:38:38.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:37 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3643850350' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8603dea-46ab-4afe-a9e8-4e443d826420"}]': finished 2024-09-10T11:38:38.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:37 smithi026 ceph-mon[34817]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T11:38:38.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:37 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:38 smithi081 ceph-mon[35059]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:38 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2762497848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:38 smithi081 ceph-mon[35059]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T11:38:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:38 smithi026 ceph-mon[34817]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:38 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2762497848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:38 smithi026 ceph-mon[34817]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T11:38:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:39.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:38 smithi017 ceph-mon[30817]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:39.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:38 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2762497848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:38:39.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:38 smithi017 ceph-mon[30817]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T11:38:39.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:40 smithi081 ceph-mon[35059]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T11:38:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:40 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:40 smithi081 ceph-mon[35059]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:40 smithi026 ceph-mon[34817]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T11:38:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:40 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:40 smithi026 ceph-mon[34817]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:40.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:40 smithi017 ceph-mon[30817]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T11:38:40.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:40 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:40.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:40 smithi017 ceph-mon[30817]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:42.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:42 smithi081 ceph-mon[35059]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:42.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:42 smithi026 ceph-mon[34817]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:42.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:42 smithi017 ceph-mon[30817]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:44.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:44 smithi017 ceph-mon[30817]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T11:38:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:44 smithi081 ceph-mon[35059]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T11:38:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:44 smithi026 ceph-mon[34817]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T11:38:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:46 smithi081 ceph-mon[35059]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:38:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T11:38:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:46 smithi081 ceph-mon[35059]: Deploying daemon osd.9 on smithi017 2024-09-10T11:38:46.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:46 smithi017 ceph-mon[30817]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:38:46.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T11:38:46.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:46.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:46 smithi017 ceph-mon[30817]: Deploying daemon osd.9 on smithi017 2024-09-10T11:38:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:46 smithi026 ceph-mon[34817]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:38:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T11:38:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:46 smithi026 ceph-mon[34817]: Deploying daemon osd.9 on smithi017 2024-09-10T11:38:48.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:48 smithi026 ceph-mon[34817]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T11:38:48.672 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:48 smithi017 ceph-mon[30817]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T11:38:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:48 smithi081 ceph-mon[35059]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-10T11:38:50.571 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:50 smithi017 ceph-mon[30817]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:38:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:50 smithi081 ceph-mon[35059]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:38:50.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:50 smithi026 ceph-mon[34817]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T11:38:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:52 smithi017 ceph-mon[30817]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:52.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:52.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:52 smithi081 ceph-mon[35059]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:52 smithi026 ceph-mon[34817]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:52.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:54.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:54 smithi017 ceph-mon[30817]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:54.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:54 smithi026 ceph-mon[34817]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:54 smithi081 ceph-mon[35059]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:38:55.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.342+0000 7faa8e7fc640 1 -- 172.21.15.17:0/531878071 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa98062630 con 0x7faa840a2bb0 2024-09-10T11:38:55.343 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 msgr2=0x7faa840a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 0x7faa840a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa88009bd0 tx=0x7faa88005f90 comp rx=0 tx=0).stop 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 msgr2=0x7faa9819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa94009230 tx=0x7faa94031b60 comp rx=0 tx=0).stop 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 shutdown_connections 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faa840a2bb0 0x7faa840a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa981017b0 0x7faa981a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa98100e10 0x7faa9819a590 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 --2- 172.21.15.17:0/531878071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa981004d0 0x7faa9819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 >> 172.21.15.17:0/531878071 conn(0x7faa980fc280 msgr2=0x7faa980fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:55.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 shutdown_connections 2024-09-10T11:38:55.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:38:55.345+0000 7faa9f90a640 1 -- 172.21.15.17:0/531878071 wait complete. 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:55 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:55 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:55.992 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T11:38:55.994 INFO:tasks.cephadm:Deploying osd.10 on smithi026 with /dev/vg_nvme/lv_1... 2024-09-10T11:38:55.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:38:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:56.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:55 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:56.259 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:38:56.685 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:56 smithi026 ceph-mon[34817]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:56.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:56 smithi017 ceph-mon[30817]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:56.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:56 smithi081 ceph-mon[35059]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:58.460 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:38:58 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:38:58.136+0000 7fc43ed56640 -1 osd.9 0 log_to_monitors true 2024-09-10T11:38:58.729 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:58 smithi026 ceph-mon[34817]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:58.729 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:58 smithi026 ceph-mon[34817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T11:38:58.731 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-10T11:38:58.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_1 2024-09-10T11:38:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:58 smithi017 ceph-mon[30817]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:58 smithi017 ceph-mon[30817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T11:38:58.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:58 smithi081 ceph-mon[35059]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:38:58.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:58 smithi081 ceph-mon[35059]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T11:38:59.054 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 -- 172.21.15.26:0/3609055815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d41037c0 msgr2=0x7ff8d410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3609055815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d41037c0 0x7ff8d410a050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009ca0 tx=0x7ff8cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 -- 172.21.15.26:0/3609055815 shutdown_connections 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3609055815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d41037c0 0x7ff8d410a050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3609055815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102e00 0x7ff8d4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3609055815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 0x7ff8d4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 -- 172.21.15.26:0/3609055815 >> 172.21.15.26:0/3609055815 conn(0x7ff8d40fd390 msgr2=0x7ff8d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 -- 172.21.15.26:0/3609055815 shutdown_connections 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.441+0000 7ff8d8843640 1 -- 172.21.15.26:0/3609055815 wait complete. 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 Processor -- start 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 -- start start 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 0x7ff8d4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d41037c0 0x7ff8d419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410d8d0 con 0x7ff8d41037c0 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410d750 con 0x7ff8d4102e00 2024-09-10T11:38:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d8843640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410da50 con 0x7ff8d4101c00 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d1d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36254/0 (socket says 172.21.15.26:36254) 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d1d9b640 1 -- 172.21.15.26:0/3649861243 learned_addr learned my addr 172.21.15.26:0/3649861243 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.442+0000 7ff8d259c640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 0x7ff8d4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d2d9d640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d41037c0 0x7ff8d419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 -- 172.21.15.26:0/3649861243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 msgr2=0x7ff8d4197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 0x7ff8d4197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 -- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d41037c0 msgr2=0x7ff8d419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d41037c0 0x7ff8d419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 -- 172.21.15.26:0/3649861243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d419fa40 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d1d9b640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c920 tx=0x7ff8c800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8007c70 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c8007e10 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d419fd30 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8018890 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.443+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a0210 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.444+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4108ed0 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.445+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff8c8018a30 con 0x7ff8d4102e00 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.446+0000 7ff8c37fe640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 0x7ff8bc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.446+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5965+0+0 (secure 0 0 0) 0x7ff8c80ce8d0 con 0x7ff8d4102e00 2024-09-10T11:38:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.446+0000 7ff8d259c640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 0x7ff8bc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.446+0000 7ff8d259c640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 0x7ff8bc0a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4102c60 tx=0x7ff8c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.450+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c8014030 con 0x7ff8d4102e00 2024-09-10T11:38:59.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:38:59.636+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff8d4062630 con 0x7ff8bc0a2bb0 2024-09-10T11:38:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi017 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-10T11:38:59.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:59.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:59.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:38:59 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T11:38:59.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T11:38:59.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:38:59.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi017 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:38:59.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:38:59.955 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:38:59 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:00.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi017 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-10T11:39:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:00.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:00.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:00.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:38:59 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:00.521 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:39:00.261+0000 7fc43a4b6640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T11:39:00.522 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:39:00.274+0000 7fc432ae8640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:39:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:39:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:00.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:00 smithi026 ceph-mon[34817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' 2024-09-10T11:39:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:39:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T11:39:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:00.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:00 smithi081 ceph-mon[35059]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' 2024-09-10T11:39:01.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:01.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-10T11:39:01.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T11:39:01.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:01.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:01.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:01.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:01.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:00 smithi017 ceph-mon[30817]: from='osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580]' entity='osd.9' 2024-09-10T11:39:01.751 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:39:01.752 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:39:01.752 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.752 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] boot 2024-09-10T11:39:01.752 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: osdmap e65: 10 total, 10 up, 10 in 2024-09-10T11:39:01.752 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:01 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:39:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:39:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] boot 2024-09-10T11:39:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: osdmap e65: 10 total, 10 up, 10 in 2024-09-10T11:39:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:01 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:39:01.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:39:01.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:01.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: osd.9 [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] boot 2024-09-10T11:39:01.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: osdmap e65: 10 total, 10 up, 10 in 2024-09-10T11:39:01.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:01 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/2406700499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]': finished 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T11:39:02.666 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/2406700499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]': finished 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T11:39:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:03.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-10T11:39:03.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/2406700499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:03.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]: dispatch 2024-09-10T11:39:03.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec"}]': finished 2024-09-10T11:39:03.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T11:39:03.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:03.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:03 smithi081 ceph-mon[35059]: from='client.? 172.21.15.26:0/194779178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:03.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:03 smithi081 ceph-mon[35059]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T11:39:03.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:03 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:04.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:03 smithi026 ceph-mon[34817]: from='client.? 172.21.15.26:0/194779178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:04.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:03 smithi026 ceph-mon[34817]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T11:39:04.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:03 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:04.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:03 smithi017 ceph-mon[30817]: from='client.? 172.21.15.26:0/194779178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:04.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:03 smithi017 ceph-mon[30817]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T11:39:04.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:03 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:05.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:05 smithi081 ceph-mon[35059]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:05 smithi026 ceph-mon[34817]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:05 smithi017 ceph-mon[30817]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:07.252 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:07 smithi026 ceph-mon[34817]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:07 smithi081 ceph-mon[35059]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:07 smithi017 ceph-mon[30817]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:09.335 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:09 smithi026 ceph-mon[34817]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:09.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:09 smithi081 ceph-mon[35059]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:09 smithi017 ceph-mon[30817]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:11 smithi026 ceph-mon[34817]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T11:39:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:11 smithi081 ceph-mon[35059]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T11:39:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:11 smithi017 ceph-mon[30817]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T11:39:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:12.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:12 smithi026 ceph-mon[34817]: Deploying daemon osd.10 on smithi026 2024-09-10T11:39:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:12 smithi081 ceph-mon[35059]: Deploying daemon osd.10 on smithi026 2024-09-10T11:39:12.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:12 smithi017 ceph-mon[30817]: Deploying daemon osd.10 on smithi026 2024-09-10T11:39:13.270 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:13 smithi026 ceph-mon[34817]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:13.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:13 smithi081 ceph-mon[35059]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:13 smithi017 ceph-mon[30817]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:15.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:15 smithi026 ceph-mon[34817]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:15 smithi081 ceph-mon[35059]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:15.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:15 smithi017 ceph-mon[30817]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:17.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:17 smithi026 ceph-mon[34817]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:17.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:17.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:17.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:17 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:17 smithi081 ceph-mon[35059]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:17 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:17 smithi017 ceph-mon[30817]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:17.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:17 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:19 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:19.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:19 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:19 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:19.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.763+0000 7ff8c37fe640 1 -- 172.21.15.26:0/3649861243 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff8d4062630 con 0x7ff8bc0a2bb0 2024-09-10T11:39:19.765 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 10 on host 'smithi026' 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 msgr2=0x7ff8bc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 0x7ff8bc0a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4102c60 tx=0x7ff8c4005f90 comp rx=0 tx=0).stop 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 msgr2=0x7ff8d4198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c920 tx=0x7ff8c800cde0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 shutdown_connections 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8bc0a2bb0 0x7ff8bc0a5070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d41037c0 0x7ff8d419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8d4102e00 0x7ff8d4198350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 --2- 172.21.15.26:0/3649861243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4101c00 0x7ff8d4197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 >> 172.21.15.26:0/3649861243 conn(0x7ff8d40fd390 msgr2=0x7ff8d41060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:19.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 shutdown_connections 2024-09-10T11:39:19.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-10T11:39:19.766+0000 7ff8d8843640 1 -- 172.21.15.26:0/3649861243 wait complete. 2024-09-10T11:39:20.322 DEBUG:teuthology.orchestra.run.smithi026:osd.10> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T11:39:20.335 INFO:tasks.cephadm:Deploying osd.11 on smithi081 with /dev/vg_nvme/lv_1... 2024-09-10T11:39:20.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T11:39:20.355 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:20 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:20.356 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:20 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.356 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:20 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.376 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:20 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:20.377 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:20 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.377 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:20 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:20 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:20.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:20 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:20 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:39:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:21 smithi081 ceph-mon[35059]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:21 smithi026 ceph-mon[34817]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:21 smithi017 ceph-mon[30817]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:22.692 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:39:22 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:39:22.300+0000 7f8971a18640 -1 osd.10 0 log_to_monitors true 2024-09-10T11:39:23.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T11:39:23.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:23.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:39:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:23.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 -- 172.21.15.81:0/3666891054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 msgr2=0x7f56f8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 --2- 172.21.15.81:0/3666891054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f8109d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009ca0 tx=0x7f56f002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 -- 172.21.15.81:0/3666891054 shutdown_connections 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 --2- 172.21.15.81:0/3666891054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f8109d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 --2- 172.21.15.81:0/3666891054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8104f90 0x7f56f8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 --2- 172.21.15.81:0/3666891054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102660 0x7f56f8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 -- 172.21.15.81:0/3666891054 >> 172.21.15.81:0/3666891054 conn(0x7f56f80fc280 msgr2=0x7f56f80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 -- 172.21.15.81:0/3666891054 shutdown_connections 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.920+0000 7f56fd883640 1 -- 172.21.15.81:0/3666891054 wait complete. 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 Processor -- start 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 -- start start 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102660 0x7f56f8198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 0x7f56f8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56f810d950 con 0x7f56f8102660 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f56f810d7d0 con 0x7f56f8104f90 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.921+0000 7f56fd883640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56f810dad0 con 0x7f56f81078c0 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57622/0 (socket says 172.21.15.81:57622) 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 -- 172.21.15.81:0/2243989462 learned_addr learned my addr 172.21.15.81:0/2243989462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f6ffd640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102660 0x7f56f8198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56ee7fc640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 0x7f56f8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 -- 172.21.15.81:0/2243989462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 msgr2=0x7f56f8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 0x7f56f8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 -- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102660 msgr2=0x7f56f8198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102660 0x7f56f8198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 -- 172.21.15.81:0/2243989462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f819fc70 con 0x7f56f81078c0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56ee7fc640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 0x7f56f8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56f77fe640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098d0 tx=0x7f56f002f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f002fc30 con 0x7f56f81078c0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0003e50 con 0x7f56f81078c0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f819ff00 con 0x7f56f81078c0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0004810 con 0x7f56f81078c0 2024-09-10T11:39:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.922+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81a0430 con 0x7f56f81078c0 2024-09-10T11:39:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.923+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f80fdd70 con 0x7f56f81078c0 2024-09-10T11:39:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.925+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f56f0004b40 con 0x7f56f81078c0 2024-09-10T11:39:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.925+0000 7f56fc881640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 0x7f56e40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.926+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6398+0+0 (secure 0 0 0) 0x7f56f00efdb0 con 0x7f56f81078c0 2024-09-10T11:39:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.926+0000 7f56f6ffd640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 0x7f56e40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.926+0000 7f56f6ffd640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 0x7f56e40a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009990 tx=0x7f56e8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:23.929+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56f00bd490 con 0x7f56f81078c0 2024-09-10T11:39:24.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:24.101+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f56f8062630 con 0x7f56e40a2bb0 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi026 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi026 to 4273M 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:24.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:24.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:24.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:24.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:24 smithi081 ceph-mon[35059]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:39:24.504 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:39:24.132+0000 7f896d178640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T11:39:24.505 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:39:24.150+0000 7f89697b2640 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:39:24.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi026 2024-09-10T11:39:24.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi026 to 4273M 2024-09-10T11:39:24.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T11:39:24.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:24.506 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:24 smithi026 ceph-mon[34817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:39:24.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi026 2024-09-10T11:39:24.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi026 to 4273M 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:24.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:24 smithi017 ceph-mon[30817]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-09-10T11:39:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T11:39:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T11:39:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:25 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:25 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:25.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:25 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:26 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:39:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:26 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:39:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:26 smithi081 ceph-mon[35059]: osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] boot 2024-09-10T11:39:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:26 smithi081 ceph-mon[35059]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T11:39:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:26 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:26 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:39:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:26 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:39:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:26 smithi026 ceph-mon[34817]: osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] boot 2024-09-10T11:39:26.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:26 smithi026 ceph-mon[34817]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T11:39:26.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:26 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:26.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:26 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:39:26.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:26 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:39:26.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:26 smithi017 ceph-mon[30817]: osd.10 [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] boot 2024-09-10T11:39:26.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:26 smithi017 ceph-mon[30817]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T11:39:26.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:26 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T11:39:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T11:39:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/3262892819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]': finished 2024-09-10T11:39:27.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T11:39:27.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:27.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:27 smithi081 ceph-mon[35059]: from='client.? 172.21.15.81:0/4279914006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/3262892819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]': finished 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:27 smithi026 ceph-mon[34817]: from='client.? 172.21.15.81:0/4279914006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 894 GiB / 894 GiB avail 2024-09-10T11:39:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/3262892819' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]: dispatch 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eceb2e-7cf2-4177-94e7-67fe68ea78a1"}]': finished 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:27.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:27 smithi017 ceph-mon[30817]: from='client.? 172.21.15.81:0/4279914006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T11:39:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:28 smithi026 ceph-mon[34817]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:39:28.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:28 smithi026 ceph-mon[34817]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T11:39:28.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:28 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:28.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:28 smithi017 ceph-mon[30817]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:39:28.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:28 smithi017 ceph-mon[30817]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T11:39:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:28 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:28 smithi081 ceph-mon[35059]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T11:39:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:28 smithi081 ceph-mon[35059]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T11:39:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:28 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:29 smithi026 ceph-mon[34817]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:29 smithi026 ceph-mon[34817]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T11:39:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:29 smithi017 ceph-mon[30817]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:29 smithi017 ceph-mon[30817]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T11:39:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:29 smithi081 ceph-mon[35059]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 348 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:29 smithi081 ceph-mon[35059]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T11:39:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:31 smithi026 ceph-mon[34817]: pgmap v233: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:31.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:31 smithi017 ceph-mon[30817]: pgmap v233: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:31.593 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:31 smithi081 ceph-mon[35059]: pgmap v233: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:33.341 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:33 smithi081 ceph-mon[35059]: pgmap v234: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:33.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:33 smithi026 ceph-mon[34817]: pgmap v234: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:33.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:33 smithi017 ceph-mon[30817]: pgmap v234: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T11:39:34.370 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:34 smithi081 ceph-mon[35059]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:39:34.370 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:34 smithi081 ceph-mon[35059]: Cluster is now healthy 2024-09-10T11:39:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:34 smithi017 ceph-mon[30817]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:39:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:34 smithi017 ceph-mon[30817]: Cluster is now healthy 2024-09-10T11:39:34.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:34 smithi026 ceph-mon[34817]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T11:39:34.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:34 smithi026 ceph-mon[34817]: Cluster is now healthy 2024-09-10T11:39:35.328 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:35 smithi081 ceph-mon[35059]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T11:39:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:35 smithi017 ceph-mon[30817]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T11:39:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:35 smithi026 ceph-mon[34817]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T11:39:36.611 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:36 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T11:39:36.612 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:36 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:36.655 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:36 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T11:39:36.655 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:36 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:36 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T11:39:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:36 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:37 smithi081 ceph-mon[35059]: Deploying daemon osd.11 on smithi081 2024-09-10T11:39:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:37 smithi081 ceph-mon[35059]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:39:37.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:37 smithi026 ceph-mon[34817]: Deploying daemon osd.11 on smithi081 2024-09-10T11:39:37.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:37 smithi026 ceph-mon[34817]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:39:37.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:37 smithi017 ceph-mon[30817]: Deploying daemon osd.11 on smithi081 2024-09-10T11:39:37.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:37 smithi017 ceph-mon[30817]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T11:39:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:39 smithi081 ceph-mon[35059]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T11:39:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:39 smithi026 ceph-mon[34817]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T11:39:39.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:39 smithi017 ceph-mon[30817]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T11:39:41.616 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:41 smithi081 ceph-mon[35059]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T11:39:41.616 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:41.616 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:41.616 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:41 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:41 smithi026 ceph-mon[34817]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T11:39:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:41 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:41 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:41.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:41 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:41.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:41 smithi017 ceph-mon[30817]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T11:39:41.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:41.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:41.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:41 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:43.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:43 smithi081 ceph-mon[35059]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:43.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:43 smithi026 ceph-mon[34817]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:43.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:43 smithi017 ceph-mon[30817]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.250+0000 7f56fc881640 1 -- 172.21.15.81:0/2243989462 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f56f8062630 con 0x7f56e40a2bb0 2024-09-10T11:39:44.252 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 11 on host 'smithi081' 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 msgr2=0x7f56e40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 0x7f56e40a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009990 tx=0x7f56e8009110 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 msgr2=0x7f56f819f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098d0 tx=0x7f56f002f840 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 shutdown_connections 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e40a2bb0 0x7f56e40a5070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f81078c0 0x7f56f819f600 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8104f90 0x7f56f8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 --2- 172.21.15.81:0/2243989462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102660 0x7f56f8198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 >> 172.21.15.81:0/2243989462 conn(0x7f56f80fc280 msgr2=0x7f56f8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 shutdown_connections 2024-09-10T11:39:44.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:44.252+0000 7f56fd883640 1 -- 172.21.15.81:0/2243989462 wait complete. 2024-09-10T11:39:44.880 DEBUG:teuthology.orchestra.run.smithi081:osd.11> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T11:39:44.883 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T11:39:44.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T11:39:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:45 smithi026 ceph-mon[34817]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:45 smithi017 ceph-mon[30817]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.544 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:45 smithi081 ceph-mon[35059]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T11:39:45.544 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.544 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.544 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.544 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.734+0000 7f5cce0e1640 1 -- 172.21.15.17:0/1345701463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8101d10 msgr2=0x7f5cc8102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.734+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/1345701463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8101d10 0x7f5cc8102190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009900 tx=0x7f5cb002a410 comp rx=0 tx=0).stop 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 -- 172.21.15.17:0/1345701463 shutdown_connections 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/1345701463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 0x7f5cc8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/1345701463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8101d10 0x7f5cc8102190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/1345701463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8100b10 0x7f5cc8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 -- 172.21.15.17:0/1345701463 >> 172.21.15.17:0/1345701463 conn(0x7f5cc80fc2a0 msgr2=0x7f5cc80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 -- 172.21.15.17:0/1345701463 shutdown_connections 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 -- 172.21.15.17:0/1345701463 wait complete. 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 Processor -- start 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.735+0000 7f5cce0e1640 1 -- start start 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 0x7f5cc81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 0x7f5cc819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc810c810 con 0x7f5cc8100b10 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc810c690 con 0x7f5cc8101d10 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc810c990 con 0x7f5cc81026d0 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50308/0 (socket says 172.21.15.17:50308) 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 -- 172.21.15.17:0/465540185 learned_addr learned my addr 172.21.15.17:0/465540185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc7fff640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 0x7f5cc819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cbeffd640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 0x7f5cc81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 -- 172.21.15.17:0/465540185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 msgr2=0x7f5cc819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 0x7f5cc819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 -- 172.21.15.17:0/465540185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 msgr2=0x7f5cc81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 0x7f5cc81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 -- 172.21.15.17:0/465540185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc819fbe0 con 0x7f5cc8100b10 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cbeffd640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 0x7f5cc81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc77fe640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800b450 tx=0x7f5cb800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8015020 con 0x7f5cc8100b10 2024-09-10T11:39:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cb8011d70 con 0x7f5cc8100b10 2024-09-10T11:39:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.736+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc819fed0 con 0x7f5cc8100b10 2024-09-10T11:39:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.737+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800f340 con 0x7f5cc8100b10 2024-09-10T11:39:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.737+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc81a03a0 con 0x7f5cc8100b10 2024-09-10T11:39:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.738+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc81a05d0 con 0x7f5cc8100b10 2024-09-10T11:39:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.739+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5cb8018020 con 0x7f5cc8100b10 2024-09-10T11:39:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.740+0000 7f5cc57fa640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 0x7f5cb40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.741+0000 7f5cbeffd640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 0x7f5cb40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.741+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6809+0+0 (secure 0 0 0) 0x7f5cb80ce470 con 0x7f5cc8100b10 2024-09-10T11:39:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.741+0000 7f5cbeffd640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 0x7f5cb40a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.746+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cb801f020 con 0x7f5cc8100b10 2024-09-10T11:39:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.921+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5cc81a0840 con 0x7f5cc8100b10 2024-09-10T11:39:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.922+0000 7f5cc57fa640 1 -- 172.21.15.17:0/465540185 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f5cb8095e20 con 0x7f5cc8100b10 2024-09-10T11:39:45.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:39:45.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 msgr2=0x7f5cb40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 0x7f5cb40a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0000c00 tx=0x7f5cb00095f0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 msgr2=0x7f5cc8197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800b450 tx=0x7f5cb800b910 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 shutdown_connections 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5cb40a2bb0 0x7f5cb40a5070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc81026d0 0x7f5cc819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc8101d10 0x7f5cc81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 --2- 172.21.15.17:0/465540185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc8100b10 0x7f5cc8197fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 >> 172.21.15.17:0/465540185 conn(0x7f5cc80fc2a0 msgr2=0x7f5cc806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 shutdown_connections 2024-09-10T11:39:45.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:45.924+0000 7f5cce0e1640 1 -- 172.21.15.17:0/465540185 wait complete. 2024-09-10T11:39:46.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:46 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/465540185' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:46.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:46 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/465540185' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:46.525 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:46 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/465540185' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:46.677 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1725968365,"num_in_osds":12,"osd_in_since":1725968366,"num_remapped_pgs":0} 2024-09-10T11:39:47.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:47 smithi026 ceph-mon[34817]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:47 smithi017 ceph-mon[30817]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:47.555 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:47 smithi081 ceph-mon[35059]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:47.555 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:39:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:39:47.281+0000 7f4e95651640 -1 osd.11 0 log_to_monitors true 2024-09-10T11:39:47.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T11:39:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:48.385 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:48 smithi017 ceph-mon[30817]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:48.385 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:48 smithi017 ceph-mon[30817]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- 172.21.15.17:0/510850255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc101cd0 msgr2=0x7ff3dc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 --2- 172.21.15.17:0/510850255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc102150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009900 tx=0x7ff3cc02a410 comp rx=0 tx=0).stop 2024-09-10T11:39:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- 172.21.15.17:0/510850255 shutdown_connections 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 --2- 172.21.15.17:0/510850255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc102690 0x7ff3dc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 --2- 172.21.15.17:0/510850255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc102150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 --2- 172.21.15.17:0/510850255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- 172.21.15.17:0/510850255 >> 172.21.15.17:0/510850255 conn(0x7ff3dc0fc280 msgr2=0x7ff3dc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- 172.21.15.17:0/510850255 shutdown_connections 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- 172.21.15.17:0/510850255 wait complete. 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 Processor -- start 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.470+0000 7ff3e476d640 1 -- start start 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc1032a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:48.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc10c730 con 0x7ff3dc102690 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc10c5b0 con 0x7ff3dc101cd0 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e476d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc10c8b0 con 0x7ff3dc100ad0 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2d0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2d0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50334/0 (socket says 172.21.15.17:50334) 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:39150/0 (socket says 172.21.15.17:39150) 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2d0a640 1 -- 172.21.15.17:0/2172135136 learned_addr learned my addr 172.21.15.17:0/2172135136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e1d08640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc1032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 -- 172.21.15.17:0/2172135136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc101cd0 msgr2=0x7ff3dc1032a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:48.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc1032a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 -- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 msgr2=0x7ff3dc1037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 -- 172.21.15.17:0/2172135136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc1040a0 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2d0a640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3e2509640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d6a0 tx=0x7ff3d800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.471+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8017070 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.472+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc1a2070 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.472+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3d8009d00 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.472+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8003c60 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.472+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1a25d0 con 0x7ff3dc100ad0 2024-09-10T11:39:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.472+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc1a2800 con 0x7ff3dc100ad0 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.474+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff3d8009820 con 0x7ff3dc100ad0 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.474+0000 7ff3d37fe640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 0x7ff3c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.474+0000 7ff3e1d08640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 0x7ff3c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.474+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6831+0+0 (secure 0 0 0) 0x7ff3d80ce470 con 0x7ff3dc100ad0 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.475+0000 7ff3e1d08640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 0x7ff3c80a5040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.478+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3d809b900 con 0x7ff3dc100ad0 2024-09-10T11:39:48.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:48 smithi026 ceph-mon[34817]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:48.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:48 smithi026 ceph-mon[34817]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.652+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff3dc1a2af0 con 0x7ff3dc100ad0 2024-09-10T11:39:48.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.652+0000 7ff3d37fe640 1 -- 172.21.15.17:0/2172135136 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7ff3d809b200 con 0x7ff3dc100ad0 2024-09-10T11:39:48.654 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:39:48.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 msgr2=0x7ff3c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:48.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 0x7ff3c80a5040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc0315d0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 msgr2=0x7ff3dc104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d6a0 tx=0x7ff3d800db60 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 shutdown_connections 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff3c80a2b80 0x7ff3c80a5040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3dc102690 0x7ff3dc1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3dc101cd0 0x7ff3dc1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 --2- 172.21.15.17:0/2172135136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3dc100ad0 0x7ff3dc104c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 >> 172.21.15.17:0/2172135136 conn(0x7ff3dc0fc280 msgr2=0x7ff3dc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 shutdown_connections 2024-09-10T11:39:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:48.655+0000 7ff3e476d640 1 -- 172.21.15.17:0/2172135136 wait complete. 2024-09-10T11:39:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:48 smithi081 ceph-mon[35059]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:48 smithi081 ceph-mon[35059]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T11:39:49.335 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1725968365,"num_in_osds":12,"osd_in_since":1725968366,"num_remapped_pgs":0} 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: Detected new or changed devices on smithi081 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:49 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2172135136' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:49.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:39:49.263+0000 7f4e90db1640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T11:39:49.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:39:49.278+0000 7f4e8d3eb640 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:39:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T11:39:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: Detected new or changed devices on smithi081 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:49 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2172135136' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:49.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: Detected new or changed devices on smithi081 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:49.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:49 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2172135136' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:50.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T11:39:50.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:50 smithi017 ceph-mon[30817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:39:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:50 smithi017 ceph-mon[30817]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T11:39:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:50 smithi081 ceph-mon[35059]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:39:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:50 smithi081 ceph-mon[35059]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T11:39:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:50.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:50 smithi026 ceph-mon[34817]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-10T11:39:50.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:50 smithi026 ceph-mon[34817]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T11:39:50.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:50.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.022+0000 7fdd192f0640 1 -- 172.21.15.17:0/3797735836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14102700 msgr2=0x7fdd14104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.022+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3797735836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14102700 0x7fdd14104af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009900 tx=0x7fdd0402a410 comp rx=0 tx=0).stop 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 -- 172.21.15.17:0/3797735836 shutdown_connections 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3797735836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 0x7fdd14107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3797735836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14107960 0x7fdd14109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3797735836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14102700 0x7fdd14104af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 -- 172.21.15.17:0/3797735836 >> 172.21.15.17:0/3797735836 conn(0x7fdd140fc2a0 msgr2=0x7fdd140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 -- 172.21.15.17:0/3797735836 shutdown_connections 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 -- 172.21.15.17:0/3797735836 wait complete. 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 Processor -- start 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.023+0000 7fdd192f0640 1 -- start start 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14102700 0x7fdd14102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:51.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 0x7fdd141006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1410d8a0 con 0x7fdd14107960 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1410d720 con 0x7fdd14102700 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd192f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1410da20 con 0x7fdd14105030 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14102700 0x7fdd14102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50342/0 (socket says 172.21.15.17:50342) 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 -- 172.21.15.17:0/3512952549 learned_addr learned my addr 172.21.15.17:0/3512952549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd127fc640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 0x7fdd141006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 -- 172.21.15.17:0/3512952549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 msgr2=0x7fdd141006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 0x7fdd141006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 -- 172.21.15.17:0/3512952549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14102700 msgr2=0x7fdd14102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14102700 0x7fdd14102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 -- 172.21.15.17:0/3512952549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd141014b0 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdd137fe640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00eaa0 tx=0x7fdd0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.024+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00cdb0 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.025+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd0c005020 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.025+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0116b0 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.025+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd141a20b0 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.025+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd141a25c0 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.026+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd140fdd90 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.027+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd0c005560 con 0x7fdd14107960 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.027+0000 7fdcfbfff640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 0x7fdcfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.027+0000 7fdd12ffd640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 0x7fdcfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:51.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.028+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fdd0c0ced10 con 0x7fdd14107960 2024-09-10T11:39:51.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.028+0000 7fdd12ffd640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 0x7fdcfc0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd040314e0 tx=0x7fdd04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:51.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.032+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd0c016030 con 0x7fdd14107960 2024-09-10T11:39:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.206+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdd14062df0 con 0x7fdd14107960 2024-09-10T11:39:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.206+0000 7fdcfbfff640 1 -- 172.21.15.17:0/3512952549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) ==== 74+0+133 (secure 0 0 0) 0x7fdd0c09bac0 con 0x7fdd14107960 2024-09-10T11:39:51.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.208+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 msgr2=0x7fdcfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.208+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 0x7fdcfc0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd040314e0 tx=0x7fdd04000bc0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.208+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 msgr2=0x7fdd14100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.208+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00eaa0 tx=0x7fdd0c00ef60 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 shutdown_connections 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdcfc0a2c00 0x7fdcfc0a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14105030 0x7fdd141006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd14107960 0x7fdd14100bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 --2- 172.21.15.17:0/3512952549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd14102700 0x7fdd14102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 >> 172.21.15.17:0/3512952549 conn(0x7fdd140fc2a0 msgr2=0x7fdd14103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 shutdown_connections 2024-09-10T11:39:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:51.209+0000 7fdd192f0640 1 -- 172.21.15.17:0/3512952549 wait complete. 2024-09-10T11:39:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: purged_snaps scrub starts 2024-09-10T11:39:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: purged_snaps scrub ok 2024-09-10T11:39:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] boot 2024-09-10T11:39:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T11:39:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:51 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3512952549' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: purged_snaps scrub starts 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: purged_snaps scrub ok 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] boot 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:51 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3512952549' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: purged_snaps scrub starts 2024-09-10T11:39:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: purged_snaps scrub ok 2024-09-10T11:39:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 983 GiB / 983 GiB avail 2024-09-10T11:39:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: osd.11 [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] boot 2024-09-10T11:39:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T11:39:51.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T11:39:51.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:51 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3512952549' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T11:39:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1725968390,"num_in_osds":12,"osd_in_since":1725968366,"num_remapped_pgs":0} 2024-09-10T11:39:51.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:39:52.248 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:52.625 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:52 smithi017 ceph-mon[30817]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T11:39:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:52 smithi081 ceph-mon[35059]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T11:39:52.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 -- 172.21.15.17:0/3577220424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 msgr2=0x7fb75810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 --2- 172.21.15.17:0/3577220424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb75810ea90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb750009ca0 tx=0x7fb75002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 -- 172.21.15.17:0/3577220424 shutdown_connections 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 --2- 172.21.15.17:0/3577220424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb75810ea90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 --2- 172.21.15.17:0/3577220424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758102790 0x7fb7581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 --2- 172.21.15.17:0/3577220424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758101de0 0x7fb7581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 -- 172.21.15.17:0/3577220424 >> 172.21.15.17:0/3577220424 conn(0x7fb7580fd8c0 msgr2=0x7fb7580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 -- 172.21.15.17:0/3577220424 shutdown_connections 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.705+0000 7fb76077a640 1 -- 172.21.15.17:0/3577220424 wait complete. 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 Processor -- start 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 -- start start 2024-09-10T11:39:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758101de0 0x7fb7580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758102790 0x7fb758074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb758111f90 con 0x7fb758106f10 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb758111e10 con 0x7fb758101de0 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb76077a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb758112110 con 0x7fb758102790 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb75ed17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb75ed17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42454/0 (socket says 172.21.15.17:42454) 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.706+0000 7fb75ed17640 1 -- 172.21.15.17:0/104000557 learned_addr learned my addr 172.21.15.17:0/104000557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75e516640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758101de0 0x7fb7580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75dd15640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758102790 0x7fb758074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 -- 172.21.15.17:0/104000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758102790 msgr2=0x7fb758074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758102790 0x7fb758074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 -- 172.21.15.17:0/104000557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758101de0 msgr2=0x7fb7580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758101de0 0x7fb7580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 -- 172.21.15.17:0/104000557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7581a6930 con 0x7fb758106f10 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb75ed17640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb750031a20 tx=0x7fb750031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750003b70 con 0x7fb758106f10 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb750003d10 con 0x7fb758106f10 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7581a6bc0 con 0x7fb758106f10 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75002fbd0 con 0x7fb758106f10 2024-09-10T11:39:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.707+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7581a7150 con 0x7fb758106f10 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.708+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7581021c0 con 0x7fb758106f10 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.709+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb75002fd70 con 0x7fb758106f10 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.710+0000 7fb74f7fe640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 0x7fb7440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.710+0000 7fb75e516640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 0x7fb7440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.710+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fb7500efcf0 con 0x7fb758106f10 2024-09-10T11:39:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.711+0000 7fb75e516640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 0x7fb7440a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb754009990 tx=0x7fb754009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.714+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7500bd200 con 0x7fb758106f10 2024-09-10T11:39:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:52 smithi026 ceph-mon[34817]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T11:39:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.890+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb75810a0f0 con 0x7fb758106f10 2024-09-10T11:39:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.891+0000 7fb74f7fe640 1 -- 172.21.15.17:0/104000557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18368 (secure 0 0 0) 0x7fb7500bcb00 con 0x7fb758106f10 2024-09-10T11:39:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:39:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":79,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:39:51.267588+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:39:52.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 msgr2=0x7fb7440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:52.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 0x7fb7440a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb754009990 tx=0x7fb754009110 comp rx=0 tx=0).stop 2024-09-10T11:39:52.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 msgr2=0x7fb758074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb750031a20 tx=0x7fb750031a50 comp rx=0 tx=0).stop 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 shutdown_connections 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c00 0x7fb7440a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb758102790 0x7fb758074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb758106f10 0x7fb758074f70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 --2- 172.21.15.17:0/104000557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb758101de0 0x7fb7580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 >> 172.21.15.17:0/104000557 conn(0x7fb7580fd8c0 msgr2=0x7fb7580fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 shutdown_connections 2024-09-10T11:39:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:52.894+0000 7fb76077a640 1 -- 172.21.15.17:0/104000557 wait complete. 2024-09-10T11:39:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:53 smithi017 ceph-mon[30817]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:53.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:53 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/104000557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:39:53.543 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T11:36:09.827861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T11:39:53.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T11:39:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:53 smithi081 ceph-mon[35059]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:53 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/104000557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:39:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:53 smithi026 ceph-mon[34817]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:53 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/104000557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:39:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:54.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 -- 172.21.15.17:0/1336700703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 msgr2=0x7f0e441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1336700703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441021c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009900 tx=0x7f0e3802a410 comp rx=0 tx=0).stop 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 -- 172.21.15.17:0/1336700703 shutdown_connections 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1336700703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 0x7f0e441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1336700703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 0x7f0e4410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1336700703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441021c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 -- 172.21.15.17:0/1336700703 >> 172.21.15.17:0/1336700703 conn(0x7f0e440fd8c0 msgr2=0x7f0e440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 -- 172.21.15.17:0/1336700703 shutdown_connections 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.182+0000 7f0e4b043640 1 -- 172.21.15.17:0/1336700703 wait complete. 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 Processor -- start 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 -- start start 2024-09-10T11:39:54.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 0x7f0e44198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 0x7f0e4419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0e44111f70 con 0x7f0e44101de0 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0e44111df0 con 0x7f0e44106f10 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e4b043640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e441120f0 con 0x7f0e44102790 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e48ddf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e48ddf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42468/0 (socket says 172.21.15.17:42468) 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e48ddf640 1 -- 172.21.15.17:0/1841320723 learned_addr learned my addr 172.21.15.17:0/1841320723 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.183+0000 7f0e43fff640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 0x7f0e44198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e495e0640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 0x7f0e4419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 -- 172.21.15.17:0/1841320723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 msgr2=0x7f0e44198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 0x7f0e44198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 -- 172.21.15.17:0/1841320723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 msgr2=0x7f0e4419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 0x7f0e4419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 -- 172.21.15.17:0/1841320723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4419d380 con 0x7f0e44101de0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e48ddf640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006010 tx=0x7f0e380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3803f030 con 0x7f0e44101de0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4419d610 con 0x7f0e44101de0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e38003ce0 con 0x7f0e44101de0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38035070 con 0x7f0e44101de0 2024-09-10T11:39:54.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.184+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e441a4f50 con 0x7f0e44101de0 2024-09-10T11:39:54.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.185+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e441021c0 con 0x7f0e44101de0 2024-09-10T11:39:54.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.187+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e38042030 con 0x7f0e44101de0 2024-09-10T11:39:54.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.187+0000 7f0e41ffb640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 0x7f0e340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:54.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.188+0000 7f0e43fff640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 0x7f0e340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:54.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.188+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f0e380ef0b0 con 0x7f0e44101de0 2024-09-10T11:39:54.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.188+0000 7f0e43fff640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 0x7f0e340a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e440fdce0 tx=0x7f0e3000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.192+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e380bc570 con 0x7f0e44101de0 2024-09-10T11:39:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.367+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e4410a0f0 con 0x7f0e44101de0 2024-09-10T11:39:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.368+0000 7f0e41ffb640 1 -- 172.21.15.17:0/1841320723 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f0e380bbe70 con 0x7f0e44101de0 2024-09-10T11:39:54.369 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T11:39:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 msgr2=0x7f0e340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 0x7f0e340a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e440fdce0 tx=0x7f0e3000b390 comp rx=0 tx=0).stop 2024-09-10T11:39:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 msgr2=0x7f0e441983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006010 tx=0x7f0e380042f0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 shutdown_connections 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0e340a2b80 0x7f0e340a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e44102790 0x7f0e44198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e44106f10 0x7f0e4419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 --2- 172.21.15.17:0/1841320723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e44101de0 0x7f0e441983d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 >> 172.21.15.17:0/1841320723 conn(0x7f0e440fd8c0 msgr2=0x7f0e440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 shutdown_connections 2024-09-10T11:39:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:54.370+0000 7f0e4b043640 1 -- 172.21.15.17:0/1841320723 wait complete. 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.a on smithi017 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.d on smithi017 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.g on smithi017 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.j on smithi017 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.b on smithi026 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.e on smithi026 2024-09-10T11:39:54.966 INFO:tasks.cephadm:Adding mds.h on smithi026 2024-09-10T11:39:54.967 INFO:tasks.cephadm:Adding mds.k on smithi026 2024-09-10T11:39:54.967 INFO:tasks.cephadm:Adding mds.c on smithi081 2024-09-10T11:39:54.967 INFO:tasks.cephadm:Adding mds.f on smithi081 2024-09-10T11:39:54.967 INFO:tasks.cephadm:Adding mds.i on smithi081 2024-09-10T11:39:54.967 INFO:tasks.cephadm:Adding mds.l on smithi081 2024-09-10T11:39:54.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l' 2024-09-10T11:39:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:39:55.578 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:55 smithi081 ceph-mon[35059]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:55.578 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:55 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1841320723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:39:55.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.662+0000 7f6d6c609640 1 -- 172.21.15.81:0/3386134308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64100ad0 msgr2=0x7f6d64100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:55.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.662+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3386134308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64100ad0 0x7f6d64100ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009900 tx=0x7f6d6002a410 comp rx=0 tx=0).stop 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 -- 172.21.15.81:0/3386134308 shutdown_connections 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3386134308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64102690 0x7f6d64108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3386134308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64101cd0 0x7f6d64102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3386134308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64100ad0 0x7f6d64100ed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 -- 172.21.15.81:0/3386134308 >> 172.21.15.81:0/3386134308 conn(0x7f6d640fc280 msgr2=0x7f6d640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 -- 172.21.15.81:0/3386134308 shutdown_connections 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 -- 172.21.15.81:0/3386134308 wait complete. 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 Processor -- start 2024-09-10T11:39:55.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.663+0000 7f6d6c609640 1 -- start start 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64100ad0 0x7f6d64196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64101cd0 0x7f6d64197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410c730 con 0x7f6d64101cd0 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410c5b0 con 0x7f6d64100ad0 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6c609640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410c8b0 con 0x7f6d64102690 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:55.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50748/0 (socket says 172.21.15.81:50748) 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 -- 172.21.15.81:0/3130850873 learned_addr learned my addr 172.21.15.81:0/3130850873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6a3a5640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64100ad0 0x7f6d64196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d69ba4640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64101cd0 0x7f6d64197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 -- 172.21.15.81:0/3130850873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64100ad0 msgr2=0x7f6d64196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64100ad0 0x7f6d64196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 -- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64101cd0 msgr2=0x7f6d64197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64101cd0 0x7f6d64197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 -- 172.21.15.81:0/3130850873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6406a070 con 0x7f6d64102690 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d6aba6640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00eaa0 tx=0x7f6d5c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.664+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00cdb0 con 0x7f6d64102690 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.665+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6406a360 con 0x7f6d64102690 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.665+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d5c005020 con 0x7f6d64102690 2024-09-10T11:39:55.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.665+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0116b0 con 0x7f6d64102690 2024-09-10T11:39:55.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.665+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6406a8a0 con 0x7f6d64102690 2024-09-10T11:39:55.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.666+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d64107ed0 con 0x7f6d64102690 2024-09-10T11:39:55.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.667+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6d5c005560 con 0x7f6d64102690 2024-09-10T11:39:55.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.668+0000 7f6d5b7fe640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 0x7f6d500a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:55.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.669+0000 7f6d6a3a5640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 0x7f6d500a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:55.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.669+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f6d5c0cf260 con 0x7f6d64102690 2024-09-10T11:39:55.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.669+0000 7f6d6a3a5640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 0x7f6d500a50f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d60006010 tx=0x7f6d60000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:55.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.671+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d5c016030 con 0x7f6d64102690 2024-09-10T11:39:55.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:55 smithi026 ceph-mon[34817]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:55.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:55 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1841320723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:39:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:55 smithi017 ceph-mon[30817]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:55.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:55 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1841320723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:39:55.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.856+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}) -- 0x7f6d6402d8d0 con 0x7f6d500a2c30 2024-09-10T11:39:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.864+0000 7f6d5b7fe640 1 -- 172.21.15.81:0/3130850873 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6d6402d8d0 con 0x7f6d500a2c30 2024-09-10T11:39:55.866 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mds.all update... 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.866+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 msgr2=0x7f6d500a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.866+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 0x7f6d500a50f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d60006010 tx=0x7f6d60000bc0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.866+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 msgr2=0x7f6d6419e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.866+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00eaa0 tx=0x7f6d5c00ef60 comp rx=0 tx=0).stop 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 shutdown_connections 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d500a2c30 0x7f6d500a50f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64102690 0x7f6d6419e390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d64101cd0 0x7f6d64197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 --2- 172.21.15.81:0/3130850873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d64100ad0 0x7f6d64196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 >> 172.21.15.81:0/3130850873 conn(0x7f6d640fc280 msgr2=0x7f6d641050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 shutdown_connections 2024-09-10T11:39:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T11:39:55.867+0000 7f6d6c609640 1 -- 172.21.15.81:0/3130850873 wait complete. 2024-09-10T11:39:56.584 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T11:39:56.587 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T11:39:56.630 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T11:39:56.679 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T11:39:56.739 DEBUG:teuthology.orchestra.run.smithi026:mds.b> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T11:39:56.749 DEBUG:teuthology.orchestra.run.smithi026:mds.e> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T11:39:56.812 DEBUG:teuthology.orchestra.run.smithi026:mds.h> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T11:39:56.862 DEBUG:teuthology.orchestra.run.smithi026:mds.k> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T11:39:56.912 DEBUG:teuthology.orchestra.run.smithi081:mds.c> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T11:39:56.918 DEBUG:teuthology.orchestra.run.smithi081:mds.f> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T11:39:56.964 DEBUG:teuthology.orchestra.run.smithi081:mds.i> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T11:39:57.010 DEBUG:teuthology.orchestra.run.smithi081:mds.l> sudo journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T11:39:57.028 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.029 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:57.030 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:57.030 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.030 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:56 smithi081 ceph-mon[35059]: Deploying daemon mds.l on smithi081 2024-09-10T11:39:57.030 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T11:39:57.031 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:39:57.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:57.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:56 smithi026 ceph-mon[34817]: Deploying daemon mds.l on smithi081 2024-09-10T11:39:57.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:57.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:56 smithi017 ceph-mon[30817]: Deploying daemon mds.l on smithi081 2024-09-10T11:39:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 -- 172.21.15.17:0/84675659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 msgr2=0x7fac0010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 --2- 172.21.15.17:0/84675659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac0010bb50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009900 tx=0x7fabf402a480 comp rx=0 tx=0).stop 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 -- 172.21.15.17:0/84675659 shutdown_connections 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 --2- 172.21.15.17:0/84675659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 --2- 172.21.15.17:0/84675659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac0010bb50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 --2- 172.21.15.17:0/84675659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 0x7fac00103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 -- 172.21.15.17:0/84675659 >> 172.21.15.17:0/84675659 conn(0x7fac000fc7a0 msgr2=0x7fac000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 -- 172.21.15.17:0/84675659 shutdown_connections 2024-09-10T11:39:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.751+0000 7fac05269640 1 -- 172.21.15.17:0/84675659 wait complete. 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.752+0000 7fac05269640 1 Processor -- start 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.752+0000 7fac05269640 1 -- start start 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 0x7fac00198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac00111f70 con 0x7fac00103660 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fac00111df0 con 0x7fac00102d40 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac001120f0 con 0x7fac0010c170 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42480/0 (socket says 172.21.15.17:42480) 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 -- 172.21.15.17:0/2291665349 learned_addr learned my addr 172.21.15.17:0/2291665349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabff7fe640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfeffd640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 0x7fac00198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 -- 172.21.15.17:0/2291665349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 msgr2=0x7fac0019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 -- 172.21.15.17:0/2291665349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 msgr2=0x7fac00198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 0x7fac00198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 -- 172.21.15.17:0/2291665349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0019d3c0 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabff7fe640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabfe7fc640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006010 tx=0x7fabf4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf403f030 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0019d650 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabf4004440 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.753+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4035070 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.754+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac001a4f90 con 0x7fac00103660 2024-09-10T11:39:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.754+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac00103120 con 0x7fac00103660 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.756+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fabf4042030 con 0x7fac00103660 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.756+0000 7fabe7fff640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 0x7fabe80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.756+0000 7fabfeffd640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 0x7fabe80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.756+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fabf40eeef0 con 0x7fac00103660 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.757+0000 7fabfeffd640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 0x7fabe80a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fabf000bbe0 tx=0x7fabf000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.760+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabf40bbca0 con 0x7fac00103660 2024-09-10T11:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.973+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac001071e0 con 0x7fac00103660 2024-09-10T11:39:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.974+0000 7fabe7fff640 1 -- 172.21.15.17:0/2291665349 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fabf40bffa0 con 0x7fac00103660 2024-09-10T11:39:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:39:57.976 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-10T11:32:58:309970+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T11:39:57.977 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-10T11:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 msgr2=0x7fabe80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 0x7fabe80a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fabf000bbe0 tx=0x7fabf000b390 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 msgr2=0x7fac00198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006010 tx=0x7fabf4004040 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 shutdown_connections 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fabe80a2b80 0x7fabe80a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0010c170 0x7fac0019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac00103660 0x7fac00198950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 --2- 172.21.15.17:0/2291665349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac00102d40 0x7fac00198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.976+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 >> 172.21.15.17:0/2291665349 conn(0x7fac000fc7a0 msgr2=0x7fac000fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.977+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 shutdown_connections 2024-09-10T11:39:57.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:39:57.977+0000 7fac05269640 1 -- 172.21.15.17:0/2291665349 wait complete. 2024-09-10T11:39:58.203 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 systemd[1]: Starting Ceph mds.l for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 podman[64428]: 2024-09-10 11:39:58.316122601 +0000 UTC m=+0.107797680 container create a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 podman[64428]: 2024-09-10 11:39:58.224128974 +0000 UTC m=+0.015804054 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 podman[64428]: 2024-09-10 11:39:58.518504567 +0000 UTC m=+0.310179639 container init a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 podman[64428]: 2024-09-10 11:39:58.521363586 +0000 UTC m=+0.313038659 container start a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mds[64448]: -- 172.21.15.81:0/289691539 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f6b473860 con 0x564f6b451000 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: starting mds.l at 2024-09-10T11:39:58.586 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 bash[64428]: a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 2024-09-10T11:39:58.867 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:39:58 smithi081 systemd[1]: Started Ceph mds.l for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2291665349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6832/230246363,v1:172.21.15.81:6833/230246363] up:boot 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: fsmap 1 up:standby 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.174 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:59.175 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:59.175 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:58 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2291665349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6832/230246363,v1:172.21.15.81:6833/230246363] up:boot 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: fsmap 1 up:standby 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:58 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2291665349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6832/230246363,v1:172.21.15.81:6833/230246363] up:boot 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: fsmap 1 up:standby 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:39:59.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:39:59.273 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:58 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:00.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:39:59 smithi081 ceph-mon[35059]: Deploying daemon mds.k on smithi026 2024-09-10T11:40:00.214 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:39:59 smithi026 ceph-mon[34817]: Deploying daemon mds.k on smithi026 2024-09-10T11:40:00.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:39:59 smithi017 ceph-mon[30817]: Deploying daemon mds.k on smithi026 2024-09-10T11:40:00.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:00.754 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:00 smithi026 systemd[1]: Starting Ceph mds.k for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:00.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:00 smithi017 ceph-mon[30817]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:00.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:00 smithi017 ceph-mon[30817]: overall HEALTH_OK 2024-09-10T11:40:01.136 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:00 smithi026 ceph-mon[34817]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:01.136 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:00 smithi026 ceph-mon[34817]: overall HEALTH_OK 2024-09-10T11:40:01.137 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:00 smithi026 podman[64415]: 2024-09-10 11:40:00.874199783 +0000 UTC m=+0.106679358 container create 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:40:01.137 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:00 smithi026 podman[64415]: 2024-09-10 11:40:00.78355793 +0000 UTC m=+0.016037521 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:01.137 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 podman[64415]: 2024-09-10 11:40:01.110099164 +0000 UTC m=+0.342578742 container init 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T11:40:01.137 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 podman[64415]: 2024-09-10 11:40:01.112890683 +0000 UTC m=+0.345370269 container start 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T11:40:01.137 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 ceph-mds[64435]: -- 172.21.15.26:0/1736971074 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d727a7860 con 0x560d72784800 2024-09-10T11:40:01.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:00 smithi081 ceph-mon[35059]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:01.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:00 smithi081 ceph-mon[35059]: overall HEALTH_OK 2024-09-10T11:40:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 -- 172.21.15.17:0/1514983663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102dd0 msgr2=0x7f6b801031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 --2- 172.21.15.17:0/1514983663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102dd0 0x7f6b801031b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009930 tx=0x7f6b7c02a420 comp rx=0 tx=0).stop 2024-09-10T11:40:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 -- 172.21.15.17:0/1514983663 shutdown_connections 2024-09-10T11:40:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 --2- 172.21.15.17:0/1514983663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80103780 0x7f6b80107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 --2- 172.21.15.17:0/1514983663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80108300 0x7f6b8010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 --2- 172.21.15.17:0/1514983663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102dd0 0x7f6b801031b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 -- 172.21.15.17:0/1514983663 >> 172.21.15.17:0/1514983663 conn(0x7f6b800fc7d0 msgr2=0x7f6b800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 -- 172.21.15.17:0/1514983663 shutdown_connections 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.312+0000 7f6b88438640 1 -- 172.21.15.17:0/1514983663 wait complete. 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 Processor -- start 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 -- start start 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80103780 0x7f6b801a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 0x7f6b8019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80112090 con 0x7f6b80103780 2024-09-10T11:40:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80111f10 con 0x7f6b80102dd0 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b88438640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80112210 con 0x7f6b80108300 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:40494/0 (socket says 172.21.15.17:40494) 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 -- 172.21.15.17:0/2770503015 learned_addr learned my addr 172.21.15.17:0/2770503015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b859d3640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80103780 0x7f6b801a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b869d5640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 0x7f6b8019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 -- 172.21.15.17:0/2770503015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 msgr2=0x7f6b8019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 0x7f6b8019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 -- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80103780 msgr2=0x7f6b801a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80103780 0x7f6b801a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b861d4640 1 -- 172.21.15.17:0/2770503015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8019aef0 con 0x7f6b80102dd0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.313+0000 7f6b869d5640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 0x7f6b8019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b861d4640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009230 tx=0x7f6b7c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c03f030 con 0x7f6b80102dd0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b7c003ad0 con 0x7f6b80102dd0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8019b180 con 0x7f6b80102dd0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c035070 con 0x7f6b80102dd0 2024-09-10T11:40:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.314+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b801a7360 con 0x7f6b80102dd0 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.315+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8006a7b0 con 0x7f6b80102dd0 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.316+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6b7c042030 con 0x7f6b80102dd0 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.317+0000 7f6b777fe640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 0x7f6b6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.317+0000 7f6b859d3640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 0x7f6b6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.317+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f6b7c0eec90 con 0x7f6b80102dd0 2024-09-10T11:40:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.317+0000 7f6b859d3640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 0x7f6b6c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b8019bed0 tx=0x7f6b7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:01.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.321+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b7c0bbff0 con 0x7f6b80102dd0 2024-09-10T11:40:01.504 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: starting mds.k at 2024-09-10T11:40:01.504 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 bash[64415]: 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 2024-09-10T11:40:01.505 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:40:01 smithi026 systemd[1]: Started Ceph mds.k for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.542+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b8019bbb0 con 0x7f6b80102dd0 2024-09-10T11:40:01.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.542+0000 7f6b777fe640 1 -- 172.21.15.17:0/2770503015 <== mon.2 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7f6b7c0bb8f0 con 0x7f6b80102dd0 2024-09-10T11:40:01.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:01.545 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"btime":"2024-09-10T11:39:58:549649+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:40:01.545 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 msgr2=0x7f6b6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 0x7f6b6c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b8019bed0 tx=0x7f6b7000b390 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 msgr2=0x7f6b801a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009230 tx=0x7f6b7c004270 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 shutdown_connections 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6b6c0a2c00 0x7f6b6c0a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b80108300 0x7f6b8019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80103780 0x7f6b801a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 --2- 172.21.15.17:0/2770503015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6b80102dd0 0x7f6b801a05b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 >> 172.21.15.17:0/2770503015 conn(0x7f6b800fc7d0 msgr2=0x7f6b8010cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:01.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 shutdown_connections 2024-09-10T11:40:01.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:01.545+0000 7f6b88438640 1 -- 172.21.15.17:0/2770503015 wait complete. 2024-09-10T11:40:02.484 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.484 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: Deploying daemon mds.j on smithi017 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2770503015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6832/3177397418,v1:172.21.15.26:6833/3177397418] up:boot 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: fsmap 2 up:standby 2024-09-10T11:40:02.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:02 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:40:02.536 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: Deploying daemon mds.j on smithi017 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2770503015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6832/3177397418,v1:172.21.15.26:6833/3177397418] up:boot 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: fsmap 2 up:standby 2024-09-10T11:40:02.537 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:02 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:02.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: Deploying daemon mds.j on smithi017 2024-09-10T11:40:02.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2770503015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:02.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6832/3177397418,v1:172.21.15.26:6833/3177397418] up:boot 2024-09-10T11:40:02.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: fsmap 2 up:standby 2024-09-10T11:40:02.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:02 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:40:03.532 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:03 smithi026 ceph-mon[34817]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:03.605 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:03 smithi081 ceph-mon[35059]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:03.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:03 smithi017 ceph-mon[30817]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:03.990 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:03 smithi017 systemd[1]: Starting Ceph mds.j for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:04.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:03 smithi017 podman[69872]: 2024-09-10 11:40:03.989280696 +0000 UTC m=+0.103040572 container create aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 podman[69872]: 2024-09-10 11:40:03.902256674 +0000 UTC m=+0.016016565 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 podman[69872]: 2024-09-10 11:40:04.183272238 +0000 UTC m=+0.297032117 container init aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 podman[69872]: 2024-09-10 11:40:04.186241344 +0000 UTC m=+0.300001221 container start aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 ceph-mds[69891]: -- 172.21.15.17:0/3948322606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f54215860 con 0x557f541f2800 2024-09-10T11:40:04.272 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j[69887]: starting mds.j at 2024-09-10T11:40:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:04.595 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 bash[69872]: aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d 2024-09-10T11:40:04.595 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:40:04 smithi017 systemd[1]: Started Ceph mds.j for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 -- 172.21.15.17:0/1334731095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068106f10 msgr2=0x7fb06810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/1334731095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068106f10 0x7fb06810ea90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb060009ca0 tx=0x7fb06002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 -- 172.21.15.17:0/1334731095 shutdown_connections 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/1334731095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068106f10 0x7fb06810ea90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/1334731095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068102790 0x7fb0681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/1334731095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb068101de0 0x7fb0681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 -- 172.21.15.17:0/1334731095 >> 172.21.15.17:0/1334731095 conn(0x7fb0680fd8c0 msgr2=0x7fb0680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 -- 172.21.15.17:0/1334731095 shutdown_connections 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.927+0000 7fb06ebe3640 1 -- 172.21.15.17:0/1334731095 wait complete. 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 Processor -- start 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 -- start start 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb068102790 0x7fb06819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068106f10 0x7fb06819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb068111f70 con 0x7fb068101de0 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb068111df0 con 0x7fb068106f10 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06ebe3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0681120f0 con 0x7fb068102790 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33166/0 (socket says 172.21.15.17:33166) 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 -- 172.21.15.17:0/2702254525 learned_addr learned my addr 172.21.15.17:0/2702254525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 -- 172.21.15.17:0/2702254525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb068102790 msgr2=0x7fb06819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb068102790 0x7fb06819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 -- 172.21.15.17:0/2702254525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068106f10 msgr2=0x7fb06819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068106f10 0x7fb06819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.928+0000 7fb06c97f640 1 -- 172.21.15.17:0/2702254525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06819f470 con 0x7fb068101de0 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb06c97f640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c920 tx=0x7fb06400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064007c70 con 0x7fb068101de0 2024-09-10T11:40:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06819f760 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb064007e10 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064018890 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.929+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0681a7040 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.930+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0681021c0 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.931+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb064018a50 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.932+0000 7fb05dffb640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 0x7fb0500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.932+0000 7fb05ffff640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 0x7fb0500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.932+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fb0640cf0e0 con 0x7fb068101de0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.932+0000 7fb05ffff640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 0x7fb0500a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0680fe0c0 tx=0x7fb058005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:04.935+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb064014030 con 0x7fb068101de0 2024-09-10T11:40:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.152+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb06819b820 con 0x7fb068101de0 2024-09-10T11:40:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.153+0000 7fb05dffb640 1 -- 172.21.15.17:0/2702254525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fb06409c4d0 con 0x7fb068101de0 2024-09-10T11:40:05.155 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:05.155 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"btime":"2024-09-10T11:40:04:271632+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:40:05.156 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 msgr2=0x7fb0500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 0x7fb0500a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0680fe0c0 tx=0x7fb058005c00 comp rx=0 tx=0).stop 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 msgr2=0x7fb06819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c920 tx=0x7fb06400cde0 comp rx=0 tx=0).stop 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 shutdown_connections 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb0500a2b80 0x7fb0500a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:05.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb068102790 0x7fb06819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:05.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb068106f10 0x7fb06819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:05.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 --2- 172.21.15.17:0/2702254525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb068101de0 0x7fb06819a4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:05.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 >> 172.21.15.17:0/2702254525 conn(0x7fb0680fd8c0 msgr2=0x7fb0680fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:05.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 shutdown_connections 2024-09-10T11:40:05.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:05.155+0000 7fb06ebe3640 1 -- 172.21.15.17:0/2702254525 wait complete. 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6834/3226558545,v1:172.21.15.17:6835/3226558545] up:boot 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: fsmap 3 up:standby 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:05.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:05.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:05.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:05 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2702254525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6834/3226558545,v1:172.21.15.17:6835/3226558545] up:boot 2024-09-10T11:40:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: fsmap 3 up:standby 2024-09-10T11:40:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:05.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:05 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2702254525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6834/3226558545,v1:172.21.15.17:6835/3226558545] up:boot 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: fsmap 3 up:standby 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:05.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:05 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2702254525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:06.437 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:06 smithi017 ceph-mon[30817]: Deploying daemon mds.d on smithi017 2024-09-10T11:40:06.656 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:06 smithi026 ceph-mon[34817]: Deploying daemon mds.d on smithi017 2024-09-10T11:40:06.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:06 smithi081 ceph-mon[35059]: Deploying daemon mds.d on smithi017 2024-09-10T11:40:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:07 smithi017 ceph-mon[30817]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:07.522 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 systemd[1]: Starting Ceph mds.d for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:07.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:07 smithi081 ceph-mon[35059]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:07.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:07 smithi026 ceph-mon[34817]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:07.820 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 podman[70289]: 2024-09-10 11:40:07.462521587 +0000 UTC m=+0.016501715 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:07.821 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 podman[70289]: 2024-09-10 11:40:07.574196851 +0000 UTC m=+0.128177005 container create ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T11:40:07.821 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 podman[70289]: 2024-09-10 11:40:07.793249227 +0000 UTC m=+0.347229342 container init ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T11:40:07.821 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 podman[70289]: 2024-09-10 11:40:07.796221863 +0000 UTC m=+0.350201983 container start ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T11:40:07.821 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 ceph-mds[70308]: -- 172.21.15.17:0/4260366292 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55821236d860 con 0x55821234b000 2024-09-10T11:40:08.271 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d[70304]: starting mds.d at 2024-09-10T11:40:08.272 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 bash[70289]: ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 2024-09-10T11:40:08.272 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:40:07 smithi017 systemd[1]: Started Ceph mds.d for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:08.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:08.736 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:09.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:09.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: Deploying daemon mds.e on smithi026 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6836/3582550652,v1:172.21.15.17:6837/3582550652] up:boot 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: fsmap 4 up:standby 2024-09-10T11:40:09.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:08 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:40:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: Deploying daemon mds.e on smithi026 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6836/3582550652,v1:172.21.15.17:6837/3582550652] up:boot 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: fsmap 4 up:standby 2024-09-10T11:40:09.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:08 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 -- 172.21.15.17:0/3895525006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 msgr2=0x7faedc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 --2- 172.21.15.17:0/3895525006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc1029b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faecc009900 tx=0x7faecc02a480 comp rx=0 tx=0).stop 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 -- 172.21.15.17:0/3895525006 shutdown_connections 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 --2- 172.21.15.17:0/3895525006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 0x7faedc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 --2- 172.21.15.17:0/3895525006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc1029b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 --2- 172.21.15.17:0/3895525006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 -- 172.21.15.17:0/3895525006 >> 172.21.15.17:0/3895525006 conn(0x7faedc0fc7d0 msgr2=0x7faedc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 -- 172.21.15.17:0/3895525006 shutdown_connections 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.204+0000 7faee426e640 1 -- 172.21.15.17:0/3895525006 wait complete. 2024-09-10T11:40:09.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 Processor -- start 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 -- start start 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 0x7faedc19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faedc110fd0 con 0x7faedc102570 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faedc110e50 con 0x7faedc100e20 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee426e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faedc111150 con 0x7faedc102ef0 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33214/0 (socket says 172.21.15.17:33214) 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 -- 172.21.15.17:0/2170295894 learned_addr learned my addr 172.21.15.17:0/2170295894 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee280b640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 0x7faedc19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:09.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee200a640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 -- 172.21.15.17:0/2170295894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 msgr2=0x7faedc19bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 0x7faedc19bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 -- 172.21.15.17:0/2170295894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 msgr2=0x7faedc1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee1809640 1 -- 172.21.15.17:0/2170295894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc19c380 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.205+0000 7faee200a640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faee1809640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faecc02aa70 tx=0x7faecc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc03f070 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faecc031c30 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc19c610 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc035030 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.206+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc1a3f50 con 0x7faedc102570 2024-09-10T11:40:09.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.207+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faedc1021b0 con 0x7faedc102570 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.208+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faecc042070 con 0x7faedc102570 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.209+0000 7faed37fe640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.209+0000 7faee200a640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.209+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7faecc0ef9f0 con 0x7faedc102570 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.210+0000 7faee200a640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 0x7faec80a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faed8005d00 tx=0x7faed8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.213+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faecc031de0 con 0x7faedc102570 2024-09-10T11:40:09.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:09.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:09.250 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: Deploying daemon mds.e on smithi026 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6836/3582550652,v1:172.21.15.17:6837/3582550652] up:boot 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: fsmap 4 up:standby 2024-09-10T11:40:09.251 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:08 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T11:40:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.422+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faedc1a4120 con 0x7faedc102570 2024-09-10T11:40:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.422+0000 7faed37fe640 1 -- 172.21.15.17:0/2170295894 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7faecc0bcd90 con 0x7faedc102570 2024-09-10T11:40:09.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:09.425 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"btime":"2024-09-10T11:40:08:285076+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:40:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2024-09-10T11:40:09.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 msgr2=0x7faec80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 0x7faec80a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faed8005d00 tx=0x7faed8005c70 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 msgr2=0x7faedc197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faecc02aa70 tx=0x7faecc003c10 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 shutdown_connections 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faec80a2b80 0x7faec80a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc102ef0 0x7faedc19bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faedc102570 0x7faedc197910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 --2- 172.21.15.17:0/2170295894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faedc100e20 0x7faedc1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.425+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 >> 172.21.15.17:0/2170295894 conn(0x7faedc0fc7d0 msgr2=0x7faedc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.426+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 shutdown_connections 2024-09-10T11:40:09.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:09.426+0000 7faee426e640 1 -- 172.21.15.17:0/2170295894 wait complete. 2024-09-10T11:40:09.936 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:09 smithi026 systemd[1]: Starting Ceph mds.e for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:10.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:09 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2170295894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:10.197 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:09 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2170295894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:10.197 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:09 smithi026 podman[64729]: 2024-09-10 11:40:09.838676875 +0000 UTC m=+0.016208769 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:10.197 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:09 smithi026 podman[64729]: 2024-09-10 11:40:09.960130631 +0000 UTC m=+0.137662557 container create 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T11:40:10.197 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 podman[64729]: 2024-09-10 11:40:10.170921528 +0000 UTC m=+0.348453412 container init 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-10T11:40:10.198 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 podman[64729]: 2024-09-10 11:40:10.173617831 +0000 UTC m=+0.351149720 container start 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T11:40:10.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:09 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2170295894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:10.504 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mds[64748]: -- 172.21.15.26:0/1309949272 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5598ad4e3c20 con 0x5598ad4c1000 2024-09-10T11:40:10.504 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: starting mds.e at 2024-09-10T11:40:10.504 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 bash[64729]: 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 2024-09-10T11:40:10.504 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:40:10 smithi026 systemd[1]: Started Ceph mds.e for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:11.030 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:11.031 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:10 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:10 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:11.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:10 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:12.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:12.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:11 smithi026 ceph-mon[34817]: Deploying daemon mds.f on smithi081 2024-09-10T11:40:12.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:11 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6834/3091242502,v1:172.21.15.26:6835/3091242502] up:boot 2024-09-10T11:40:12.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:11 smithi026 ceph-mon[34817]: fsmap 5 up:standby 2024-09-10T11:40:12.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:11 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:40:12.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:11 smithi017 ceph-mon[30817]: Deploying daemon mds.f on smithi081 2024-09-10T11:40:12.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:11 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6834/3091242502,v1:172.21.15.26:6835/3091242502] up:boot 2024-09-10T11:40:12.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:11 smithi017 ceph-mon[30817]: fsmap 5 up:standby 2024-09-10T11:40:12.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:11 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:40:12.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:11 smithi081 ceph-mon[35059]: Deploying daemon mds.f on smithi081 2024-09-10T11:40:12.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:11 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6834/3091242502,v1:172.21.15.26:6835/3091242502] up:boot 2024-09-10T11:40:12.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:11 smithi081 ceph-mon[35059]: fsmap 5 up:standby 2024-09-10T11:40:12.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:11 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:40:12.363 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 systemd[1]: Starting Ceph mds.f for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:12.438 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 podman[64728]: 2024-09-10 11:40:12.361438686 +0000 UTC m=+0.098618536 container create f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 podman[64728]: 2024-09-10 11:40:12.278383034 +0000 UTC m=+0.015562891 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 podman[64728]: 2024-09-10 11:40:12.555452961 +0000 UTC m=+0.292632805 container init f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 podman[64728]: 2024-09-10 11:40:12.558150486 +0000 UTC m=+0.295330331 container start f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mds[64747]: -- 172.21.15.81:0/1985009766 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c014df860 con 0x563c014bd400 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: starting mds.f at 2024-09-10T11:40:12.648 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 bash[64728]: f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd 2024-09-10T11:40:12.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 -- 172.21.15.17:0/1908156787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788100e20 msgr2=0x7fc788101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:12.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/1908156787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788100e20 0x7fc788101200 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc784009900 tx=0x7fc78402a480 comp rx=0 tx=0).stop 2024-09-10T11:40:12.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 -- 172.21.15.17:0/1908156787 shutdown_connections 2024-09-10T11:40:12.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/1908156787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102ef0 0x7fc78810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:12.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/1908156787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788102570 0x7fc7881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/1908156787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788100e20 0x7fc788101200 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 -- 172.21.15.17:0/1908156787 >> 172.21.15.17:0/1908156787 conn(0x7fc7880fc7d0 msgr2=0x7fc7880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 -- 172.21.15.17:0/1908156787 shutdown_connections 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.925+0000 7fc78fd5d640 1 -- 172.21.15.17:0/1908156787 wait complete. 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 Processor -- start 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 -- start start 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 0x7fc7881984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 0x7fc788198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc788110f50 con 0x7fc788102ef0 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc788110dd0 con 0x7fc788100e20 2024-09-10T11:40:12.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78fd5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881110d0 con 0x7fc788102570 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46514/0 (socket says 172.21.15.17:46514) 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 -- 172.21.15.17:0/3377902499 learned_addr learned my addr 172.21.15.17:0/3377902499 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78d2f8640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 0x7fc788198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78daf9640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 0x7fc7881984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 -- 172.21.15.17:0/3377902499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 msgr2=0x7fc788198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 0x7fc788198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 -- 172.21.15.17:0/3377902499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 msgr2=0x7fc7881984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 0x7fc7881984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78e2fa640 1 -- 172.21.15.17:0/3377902499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78819d470 con 0x7fc788102ef0 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78daf9640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 0x7fc7881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:12.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.926+0000 7fc78d2f8640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 0x7fc788198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc78e2fa640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eb10 tx=0x7fc78000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000ce20 con 0x7fc788102ef0 2024-09-10T11:40:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc780005020 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78819d760 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780010690 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.927+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7881a5040 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.928+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc788101200 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.929+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc780005540 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.930+0000 7fc77effd640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 0x7fc7740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.930+0000 7fc78daf9640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 0x7fc7740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.930+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc7800cf170 con 0x7fc788102ef0 2024-09-10T11:40:12.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.930+0000 7fc78daf9640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 0x7fc7740a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc784005ab0 tx=0x7fc784005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:12.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:12.934+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc78009c570 con 0x7fc788102ef0 2024-09-10T11:40:12.953 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:40:12 smithi081 systemd[1]: Started Ceph mds.f for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.147+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc78810a0a0 con 0x7fc788102ef0 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:13.150 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:12 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.148+0000 7fc77effd640 1 -- 172.21.15.17:0/3377902499 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5554 (secure 0 0 0) 0x7fc78009be70 con 0x7fc788102ef0 2024-09-10T11:40:13.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:13.151 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"btime":"2024-09-10T11:40:12:960431+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-10T11:40:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-09-10T11:40:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 msgr2=0x7fc7740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 0x7fc7740a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc784005ab0 tx=0x7fc784005a20 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 msgr2=0x7fc78819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eb10 tx=0x7fc78000ef10 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 shutdown_connections 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc7740a2b80 0x7fc7740a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc788102570 0x7fc788198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc788102ef0 0x7fc78819cd90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 --2- 172.21.15.17:0/3377902499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc788100e20 0x7fc7881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 >> 172.21.15.17:0/3377902499 conn(0x7fc7880fc7d0 msgr2=0x7fc78806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 shutdown_connections 2024-09-10T11:40:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:13.150+0000 7fc78fd5d640 1 -- 172.21.15.17:0/3377902499 wait complete. 2024-09-10T11:40:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:13.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:12 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:13.263 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:13.263 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.263 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.263 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:13.263 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:13.264 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:13.264 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:12 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:14.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:13 smithi026 ceph-mon[34817]: Deploying daemon mds.c on smithi081 2024-09-10T11:40:14.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:13 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:boot 2024-09-10T11:40:14.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:13 smithi026 ceph-mon[34817]: fsmap 6 up:standby 2024-09-10T11:40:14.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:13 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:40:14.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:13 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3377902499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:14.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:13 smithi017 ceph-mon[30817]: Deploying daemon mds.c on smithi081 2024-09-10T11:40:14.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:13 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:boot 2024-09-10T11:40:14.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:13 smithi017 ceph-mon[30817]: fsmap 6 up:standby 2024-09-10T11:40:14.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:13 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:40:14.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:13 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3377902499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:14.379 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:13 smithi081 ceph-mon[35059]: Deploying daemon mds.c on smithi081 2024-09-10T11:40:14.379 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:13 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:boot 2024-09-10T11:40:14.379 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:13 smithi081 ceph-mon[35059]: fsmap 6 up:standby 2024-09-10T11:40:14.380 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:13 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:40:14.380 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:13 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3377902499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:14.703 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:14 smithi081 systemd[1]: Starting Ceph mds.c for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:15.026 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:14 smithi081 ceph-mon[35059]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:15.027 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:14 smithi081 podman[65028]: 2024-09-10 11:40:14.674572751 +0000 UTC m=+0.015886502 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:15.027 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:14 smithi081 podman[65028]: 2024-09-10 11:40:14.79810526 +0000 UTC m=+0.139418997 container create de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:40:15.027 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 podman[65028]: 2024-09-10 11:40:15.000374547 +0000 UTC m=+0.341688292 container init de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:40:15.027 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 podman[65028]: 2024-09-10 11:40:15.003246762 +0000 UTC m=+0.344560500 container start de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T11:40:15.027 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 ceph-mds[65048]: -- 172.21.15.81:0/151703415 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f132551860 con 0x55f13252e800 2024-09-10T11:40:15.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:14 smithi026 ceph-mon[34817]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:15.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:14 smithi017 ceph-mon[30817]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:15.453 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: starting mds.c at 2024-09-10T11:40:15.453 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 bash[65028]: de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a 2024-09-10T11:40:15.453 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:40:15 smithi081 systemd[1]: Started Ceph mds.c for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:15.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:16.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: Deploying daemon mds.h on smithi026 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:boot 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: fsmap 7 up:standby 2024-09-10T11:40:16.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:16 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:40:16.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: Deploying daemon mds.h on smithi026 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:boot 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: fsmap 7 up:standby 2024-09-10T11:40:16.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:16 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:40:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: Deploying daemon mds.h on smithi026 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:boot 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: fsmap 7 up:standby 2024-09-10T11:40:16.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:16 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:40:16.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- 172.21.15.17:0/2378680412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 msgr2=0x7fd1fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:16.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 --2- 172.21.15.17:0/2378680412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc10da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009ca0 tx=0x7fd1f402a950 comp rx=0 tx=0).stop 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- 172.21.15.17:0/2378680412 shutdown_connections 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 --2- 172.21.15.17:0/2378680412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc10da40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 --2- 172.21.15.17:0/2378680412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 0x7fd1fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 --2- 172.21.15.17:0/2378680412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 0x7fd1fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- 172.21.15.17:0/2378680412 >> 172.21.15.17:0/2378680412 conn(0x7fd1fc0fc7d0 msgr2=0x7fd1fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- 172.21.15.17:0/2378680412 shutdown_connections 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- 172.21.15.17:0/2378680412 wait complete. 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 Processor -- start 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.749+0000 7fd20316c640 1 -- start start 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 0x7fd1fc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 0x7fd1fc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc1120a0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc111f20 con 0x7fd1fc102570 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd20316c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc112220 con 0x7fd1fc100e20 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46538/0 (socket says 172.21.15.17:46538) 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 -- 172.21.15.17:0/3381518917 learned_addr learned my addr 172.21.15.17:0/3381518917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd1fbfff640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 0x7fd1fc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd200f08640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 0x7fd1fc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 -- 172.21.15.17:0/3381518917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 msgr2=0x7fd1fc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 0x7fd1fc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 -- 172.21.15.17:0/3381518917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 msgr2=0x7fd1fc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:16.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 0x7fd1fc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 -- 172.21.15.17:0/3381518917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc19d410 con 0x7fd1fc102ef0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.750+0000 7fd201709640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402ae70 tx=0x7fd1f402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.751+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4034040 con 0x7fd1fc102ef0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.751+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f4030920 con 0x7fd1fc102ef0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.751+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1fc19d6a0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.751+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4045480 con 0x7fd1fc102ef0 2024-09-10T11:40:16.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.751+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1fc1a4fe0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.752+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1fc101200 con 0x7fd1fc102ef0 2024-09-10T11:40:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.753+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd1f4037020 con 0x7fd1fc102ef0 2024-09-10T11:40:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.754+0000 7fd1f9ffb640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 0x7fd1e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.754+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fd1f40efae0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.754+0000 7fd200f08640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 0x7fd1e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:16.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.754+0000 7fd200f08640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 0x7fd1e80a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00bbe0 tx=0x7fd1ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:16.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.757+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1f40811b0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.969+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1fc1a51b0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.969+0000 7fd1f9ffb640 1 -- 172.21.15.17:0/3381518917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6379 (secure 0 0 0) 0x7fd1f40bcee0 con 0x7fd1fc102ef0 2024-09-10T11:40:16.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:16.972 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"btime":"2024-09-10T11:40:15:971338+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T11:40:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 msgr2=0x7fd1e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 0x7fd1e80a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00bbe0 tx=0x7fd1ec00b390 comp rx=0 tx=0).stop 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 msgr2=0x7fd1fc19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402ae70 tx=0x7fd1f402f5d0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 shutdown_connections 2024-09-10T11:40:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd1e80a2c00 0x7fd1e80a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1fc102ef0 0x7fd1fc19cd30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd1fc102570 0x7fd1fc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 --2- 172.21.15.17:0/3381518917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1fc100e20 0x7fd1fc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 >> 172.21.15.17:0/3381518917 conn(0x7fd1fc0fc7d0 msgr2=0x7fd1fc106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 shutdown_connections 2024-09-10T11:40:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:16.972+0000 7fd20316c640 1 -- 172.21.15.17:0/3381518917 wait complete. 2024-09-10T11:40:17.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:17 smithi017 ceph-mon[30817]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:17.263 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:17 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3381518917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:17.410 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:17 smithi026 ceph-mon[34817]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:17.411 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:17 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3381518917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:17.411 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 systemd[1]: Starting Ceph mds.h for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:17 smithi081 ceph-mon[35059]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:17 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3381518917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:17.716 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 podman[65032]: 2024-09-10 11:40:17.312386457 +0000 UTC m=+0.015921643 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:17.716 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 podman[65032]: 2024-09-10 11:40:17.413058732 +0000 UTC m=+0.116593907 container create 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:40:17.716 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 podman[65032]: 2024-09-10 11:40:17.631904973 +0000 UTC m=+0.335440150 container init 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T11:40:17.716 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 podman[65032]: 2024-09-10 11:40:17.634834963 +0000 UTC m=+0.338370144 container start 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T11:40:17.716 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 ceph-mds[65051]: -- 172.21.15.26:0/4107139257 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56392ea2f860 con 0x56392ea0d400 2024-09-10T11:40:17.717 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: starting mds.h at 2024-09-10T11:40:17.717 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 bash[65032]: 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 2024-09-10T11:40:18.004 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:40:17 smithi026 systemd[1]: Started Ceph mds.h for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:19.020 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:19.020 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.020 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.020 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.020 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: Deploying daemon mds.i on smithi081 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:boot 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: fsmap 8 up:standby 2024-09-10T11:40:19.021 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:18 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:19.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:19.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: Deploying daemon mds.i on smithi081 2024-09-10T11:40:19.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:boot 2024-09-10T11:40:19.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: fsmap 8 up:standby 2024-09-10T11:40:19.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:18 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:40:19.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:19.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: Deploying daemon mds.i on smithi081 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:boot 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: fsmap 8 up:standby 2024-09-10T11:40:19.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:18 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:40:19.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:19.703 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 systemd[1]: Starting Ceph mds.i for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:19.972 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 podman[65329]: 2024-09-10 11:40:19.610096458 +0000 UTC m=+0.015591171 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:19.972 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 podman[65329]: 2024-09-10 11:40:19.735521761 +0000 UTC m=+0.141016472 container create 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:40:19.972 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 podman[65329]: 2024-09-10 11:40:19.971530607 +0000 UTC m=+0.377025319 container init 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:40:20.453 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 podman[65329]: 2024-09-10 11:40:19.974369484 +0000 UTC m=+0.379864200 container start 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:40:20.453 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 ceph-mds[65348]: -- 172.21.15.81:0/2721863993 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b1d6a5860 con 0x558b1d683000 2024-09-10T11:40:20.453 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: starting mds.i at 2024-09-10T11:40:20.453 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:20 smithi081 bash[65329]: 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 2024-09-10T11:40:20.453 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:20 smithi081 systemd[1]: Started Ceph mds.i for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 -- 172.21.15.17:0/2701366489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37481027a0 msgr2=0x7f37481067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 --2- 172.21.15.17:0/2701366489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37481027a0 0x7f37481067f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f373c009900 tx=0x7f373c02a410 comp rx=0 tx=0).stop 2024-09-10T11:40:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 -- 172.21.15.17:0/2701366489 shutdown_connections 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 --2- 172.21.15.17:0/2701366489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3748106f20 0x7f374810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 --2- 172.21.15.17:0/2701366489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37481027a0 0x7f37481067f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 --2- 172.21.15.17:0/2701366489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748101df0 0x7f37481021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 -- 172.21.15.17:0/2701366489 >> 172.21.15.17:0/2701366489 conn(0x7f37480fd8f0 msgr2=0x7f37480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 -- 172.21.15.17:0/2701366489 shutdown_connections 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.492+0000 7f374ed04640 1 -- 172.21.15.17:0/2701366489 wait complete. 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 Processor -- start 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 -- start start 2024-09-10T11:40:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37481027a0 0x7f3748198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748106f20 0x7f374819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3748111ff0 con 0x7f3748101df0 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3748111e70 con 0x7f3748106f20 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374ed04640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3748112170 con 0x7f37481027a0 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46554/0 (socket says 172.21.15.17:46554) 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 -- 172.21.15.17:0/2572740230 learned_addr learned my addr 172.21.15.17:0/2572740230 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f3747fff640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37481027a0 0x7f3748198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374d2a1640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748106f20 0x7f374819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 -- 172.21.15.17:0/2572740230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37481027a0 msgr2=0x7f3748198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37481027a0 0x7f3748198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 -- 172.21.15.17:0/2572740230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748106f20 msgr2=0x7f374819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748106f20 0x7f374819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.493+0000 7f374caa0640 1 -- 172.21.15.17:0/2572740230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374819d400 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f374caa0640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f373800c920 tx=0x7f373800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738007c70 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3738007e10 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374819d6f0 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738018890 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.494+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37481a4fd0 con 0x7f3748101df0 2024-09-10T11:40:20.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.495+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37481021d0 con 0x7f3748101df0 2024-09-10T11:40:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.496+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3738018a70 con 0x7f3748101df0 2024-09-10T11:40:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.497+0000 7f3745ffb640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 0x7f37300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.497+0000 7f3747fff640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 0x7f37300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.497+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f37380ced00 con 0x7f3748101df0 2024-09-10T11:40:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.497+0000 7f3747fff640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 0x7f37300a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f373c000c00 tx=0x7f373c005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.501+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3738014030 con 0x7f3748101df0 2024-09-10T11:40:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.724+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3748109b70 con 0x7f3748101df0 2024-09-10T11:40:20.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.725+0000 7f3745ffb640 1 -- 172.21.15.17:0/2572740230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7204 (secure 0 0 0) 0x7f373809c060 con 0x7f3748101df0 2024-09-10T11:40:20.726 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:20.726 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T11:40:18:167065+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T11:40:20.726 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T11:40:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 msgr2=0x7f37300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 0x7f37300a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f373c000c00 tx=0x7f373c005df0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 msgr2=0x7f3748198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f373800c920 tx=0x7f373800cde0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 shutdown_connections 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37300a2c00 0x7f37300a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37481027a0 0x7f3748198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3748106f20 0x7f374819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 --2- 172.21.15.17:0/2572740230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101df0 0x7f3748198450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 >> 172.21.15.17:0/2572740230 conn(0x7f37480fd8f0 msgr2=0x7f37480fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 shutdown_connections 2024-09-10T11:40:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:20.727+0000 7f374ed04640 1 -- 172.21.15.17:0/2572740230 wait complete. 2024-09-10T11:40:21.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: Deploying daemon mds.g on smithi017 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2572740230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:boot 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: fsmap 9 up:standby 2024-09-10T11:40:21.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:21 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: Deploying daemon mds.g on smithi017 2024-09-10T11:40:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2572740230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:boot 2024-09-10T11:40:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: fsmap 9 up:standby 2024-09-10T11:40:21.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:21 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:40:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: Deploying daemon mds.g on smithi017 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2572740230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:boot 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: fsmap 9 up:standby 2024-09-10T11:40:21.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:21 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:40:22.271 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 systemd[1]: Starting Ceph mds.g for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:22.619 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 podman[71062]: 2024-09-10 11:40:22.41652799 +0000 UTC m=+0.016377972 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:22.619 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 podman[71062]: 2024-09-10 11:40:22.521108281 +0000 UTC m=+0.120958249 container create f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T11:40:23.021 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 podman[71062]: 2024-09-10 11:40:22.731547437 +0000 UTC m=+0.331397406 container init f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T11:40:23.022 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 podman[71062]: 2024-09-10 11:40:22.734529476 +0000 UTC m=+0.334379443 container start f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:40:23.022 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 ceph-mds[71081]: -- 172.21.15.17:0/2965856723 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d7e01f860 con 0x556d7dffc800 2024-09-10T11:40:23.022 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: starting mds.g at 2024-09-10T11:40:23.022 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 bash[71062]: f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d 2024-09-10T11:40:23.022 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:40:22 smithi017 systemd[1]: Started Ceph mds.g for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:23.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:23.422 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:23 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:23.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:23 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:23 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:24.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:24 smithi017 ceph-mon[30817]: Deploying daemon mds.a on smithi017 2024-09-10T11:40:24.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:24 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6838/2696186701,v1:172.21.15.17:6839/2696186701] up:boot 2024-09-10T11:40:24.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:24 smithi017 ceph-mon[30817]: fsmap 10 up:standby 2024-09-10T11:40:24.264 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:24 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:40:24.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:24 smithi081 ceph-mon[35059]: Deploying daemon mds.a on smithi017 2024-09-10T11:40:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:24 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6838/2696186701,v1:172.21.15.17:6839/2696186701] up:boot 2024-09-10T11:40:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:24 smithi081 ceph-mon[35059]: fsmap 10 up:standby 2024-09-10T11:40:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:24 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:40:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:24 smithi026 ceph-mon[34817]: Deploying daemon mds.a on smithi017 2024-09-10T11:40:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:24 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6838/2696186701,v1:172.21.15.17:6839/2696186701] up:boot 2024-09-10T11:40:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:24 smithi026 ceph-mon[34817]: fsmap 10 up:standby 2024-09-10T11:40:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:24 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:40:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:24.874 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:24 smithi017 systemd[1]: Starting Ceph mds.a for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 -- 172.21.15.17:0/4263809929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170102d40 msgr2=0x7ff170103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 --2- 172.21.15.17:0/4263809929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170102d40 0x7ff170103120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009900 tx=0x7ff16c02a480 comp rx=0 tx=0).stop 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 -- 172.21.15.17:0/4263809929 shutdown_connections 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 --2- 172.21.15.17:0/4263809929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff17010c170 0x7ff17010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 --2- 172.21.15.17:0/4263809929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff170103660 0x7ff17010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 --2- 172.21.15.17:0/4263809929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170102d40 0x7ff170103120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.226+0000 7ff177e65640 1 -- 172.21.15.17:0/4263809929 >> 172.21.15.17:0/4263809929 conn(0x7ff1700fc7a0 msgr2=0x7ff1700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.227+0000 7ff177e65640 1 -- 172.21.15.17:0/4263809929 shutdown_connections 2024-09-10T11:40:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.227+0000 7ff177e65640 1 -- 172.21.15.17:0/4263809929 wait complete. 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.227+0000 7ff177e65640 1 Processor -- start 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.227+0000 7ff177e65640 1 -- start start 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff170102d40 0x7ff170198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff17010c170 0x7ff17019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff170111f70 con 0x7ff170103660 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff170111df0 con 0x7ff17010c170 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1701120f0 con 0x7ff170102d40 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36938/0 (socket says 172.21.15.17:36938) 2024-09-10T11:40:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 -- 172.21.15.17:0/428705575 learned_addr learned my addr 172.21.15.17:0/428705575 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175c01640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff170102d40 0x7ff170198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff176402640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff17010c170 0x7ff17019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 -- 172.21.15.17:0/428705575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff170102d40 msgr2=0x7ff170198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff170102d40 0x7ff170198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 -- 172.21.15.17:0/428705575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff17010c170 msgr2=0x7ff17019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff17010c170 0x7ff17019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 -- 172.21.15.17:0/428705575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17019d3e0 con 0x7ff170103660 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff175400640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff16000d740 tx=0x7ff16000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160017070 con 0x7ff170103660 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff16000de50 con 0x7ff170103660 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17019d6d0 con 0x7ff170103660 2024-09-10T11:40:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16000f620 con 0x7ff170103660 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.228+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701a4fb0 con 0x7ff170103660 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.229+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff170103120 con 0x7ff170103660 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.231+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff160009c30 con 0x7ff170103660 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.231+0000 7ff166ffd640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 0x7ff15c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.231+0000 7ff175c01640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 0x7ff15c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.231+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7ff1600ce870 con 0x7ff170103660 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.232+0000 7ff175c01640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 0x7ff15c0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff16c005ab0 tx=0x7ff16c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:25.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.236+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff16009bbd0 con 0x7ff170103660 2024-09-10T11:40:25.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:25 smithi017 ceph-mon[30817]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:25 smithi081 ceph-mon[35059]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.460+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff170106c80 con 0x7ff170103660 2024-09-10T11:40:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.461+0000 7ff166ffd640 1 -- 172.21.15.17:0/428705575 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8854 (secure 0 0 0) 0x7ff16009b4d0 con 0x7ff170103660 2024-09-10T11:40:25.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:25.462 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"btime":"2024-09-10T11:40:23:113105+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T11:40:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 msgr2=0x7ff15c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 0x7ff15c0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff16c005ab0 tx=0x7ff16c005a20 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 msgr2=0x7ff170198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff16000d740 tx=0x7ff16000dc00 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 shutdown_connections 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff15c0a2c00 0x7ff15c0a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff17010c170 0x7ff17019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff170103660 0x7ff170198970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 --2- 172.21.15.17:0/428705575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff170102d40 0x7ff170198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:25.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 >> 172.21.15.17:0/428705575 conn(0x7ff1700fc7a0 msgr2=0x7ff1700fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 shutdown_connections 2024-09-10T11:40:25.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:25.463+0000 7ff177e65640 1 -- 172.21.15.17:0/428705575 wait complete. 2024-09-10T11:40:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:25 smithi026 ceph-mon[34817]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:25.772 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:25 smithi017 podman[71459]: 2024-09-10 11:40:25.283095333 +0000 UTC m=+0.023345184 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:25.772 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:25 smithi017 podman[71459]: 2024-09-10 11:40:25.393701646 +0000 UTC m=+0.133951497 container create 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-10T11:40:26.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:26 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/428705575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:26.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:26 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/428705575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:26.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:26 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/428705575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:26.521 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 podman[71459]: 2024-09-10 11:40:26.174612948 +0000 UTC m=+0.914862799 container init 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T11:40:26.522 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 podman[71459]: 2024-09-10 11:40:26.178452593 +0000 UTC m=+0.918702444 container start 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T11:40:26.522 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 ceph-mds[71495]: -- 172.21.15.17:0/1429528351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c625ca1860 con 0x55c625c7f400 2024-09-10T11:40:26.522 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: starting mds.a at 2024-09-10T11:40:26.522 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 bash[71459]: 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 2024-09-10T11:40:26.522 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:40:26 smithi017 systemd[1]: Started Ceph mds.a for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6840/1429826923,v1:172.21.15.17:6841/1429826923] up:boot 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: fsmap 11 up:standby 2024-09-10T11:40:27.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:27 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6840/1429826923,v1:172.21.15.17:6841/1429826923] up:boot 2024-09-10T11:40:27.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: fsmap 11 up:standby 2024-09-10T11:40:27.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:27 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:40:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6840/1429826923,v1:172.21.15.17:6841/1429826923] up:boot 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: fsmap 11 up:standby 2024-09-10T11:40:27.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:27 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:40:28.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:28.462 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:28 smithi026 ceph-mon[34817]: Deploying daemon mds.b on smithi026 2024-09-10T11:40:28.462 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 systemd[1]: Starting Ceph mds.b for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:40:28.474 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:28 smithi017 ceph-mon[30817]: Deploying daemon mds.b on smithi026 2024-09-10T11:40:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:28 smithi081 ceph-mon[35059]: Deploying daemon mds.b on smithi026 2024-09-10T11:40:28.755 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 podman[65332]: 2024-09-10 11:40:28.576439828 +0000 UTC m=+0.016242367 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:40:28.755 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 podman[65332]: 2024-09-10 11:40:28.677292117 +0000 UTC m=+0.117094693 container create f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux ) 2024-09-10T11:40:28.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 -- 172.21.15.17:0/615255611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f81082a0 msgr2=0x7f20f810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/615255611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f81082a0 0x7f20f810ec40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009cd0 tx=0x7f20f002a910 comp rx=0 tx=0).stop 2024-09-10T11:40:28.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 -- 172.21.15.17:0/615255611 shutdown_connections 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/615255611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f81082a0 0x7f20f810ec40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/615255611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81036e0 0x7f20f8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/615255611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f8102d30 0x7f20f8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 -- 172.21.15.17:0/615255611 >> 172.21.15.17:0/615255611 conn(0x7f20f80fc7d0 msgr2=0x7f20f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 -- 172.21.15.17:0/615255611 shutdown_connections 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.845+0000 7f20fe1d8640 1 -- 172.21.15.17:0/615255611 wait complete. 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 Processor -- start 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 -- start start 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f81036e0 0x7f20f8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81082a0 0x7f20f8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81120e0 con 0x7f20f8102d30 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8111f60 con 0x7f20f81082a0 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20fe1d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8112260 con 0x7f20f81036e0 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36976/0 (socket says 172.21.15.17:36976) 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 -- 172.21.15.17:0/1392267557 learned_addr learned my addr 172.21.15.17:0/1392267557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f7fff640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81082a0 0x7f20f8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f6ffd640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f81036e0 0x7f20f8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 -- 172.21.15.17:0/1392267557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f81036e0 msgr2=0x7f20f8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f81036e0 0x7f20f8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 -- 172.21.15.17:0/1392267557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81082a0 msgr2=0x7f20f8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.846+0000 7f20f77fe640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81082a0 0x7f20f8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20f77fe640 1 -- 172.21.15.17:0/1392267557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f81a69f0 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20f77fe640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c920 tx=0x7f20e800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8007bb0 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81a6ce0 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e8007d50 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8018780 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.847+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a7210 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.848+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8103110 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.849+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f20e800f450 con 0x7f20f8102d30 2024-09-10T11:40:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.850+0000 7f20f4ff9640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 0x7f20e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.850+0000 7f20f6ffd640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 0x7f20e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.850+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f20e80cec00 con 0x7f20f8102d30 2024-09-10T11:40:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.850+0000 7f20f6ffd640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 0x7f20e00a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20f8102420 tx=0x7f20ec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:28.855+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20e80d5080 con 0x7f20f8102d30 2024-09-10T11:40:29.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.067+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f810a2b0 con 0x7f20f8102d30 2024-09-10T11:40:29.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.068+0000 7f20f4ff9640 1 -- 172.21.15.17:0/1392267557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7f20e80afe20 con 0x7f20f8102d30 2024-09-10T11:40:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:29.070 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"btime":"2024-09-10T11:40:27:132384+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T11:40:29.070 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2024-09-10T11:40:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 msgr2=0x7f20e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 0x7f20e00a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20f8102420 tx=0x7f20ec009110 comp rx=0 tx=0).stop 2024-09-10T11:40:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 msgr2=0x7f20f8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c920 tx=0x7f20e800cd20 comp rx=0 tx=0).stop 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 shutdown_connections 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20e00a2b80 0x7f20e00a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f81036e0 0x7f20f8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20f81082a0 0x7f20f8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 --2- 172.21.15.17:0/1392267557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8102d30 0x7f20f8100990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.070+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 >> 172.21.15.17:0/1392267557 conn(0x7f20f80fc7d0 msgr2=0x7f20f8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.071+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 shutdown_connections 2024-09-10T11:40:29.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:29.071+0000 7f20fe1d8640 1 -- 172.21.15.17:0/1392267557 wait complete. 2024-09-10T11:40:29.254 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 podman[65332]: 2024-09-10 11:40:28.943253476 +0000 UTC m=+0.383056006 container init f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T11:40:29.255 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 podman[65332]: 2024-09-10 11:40:28.946111395 +0000 UTC m=+0.385913926 container start f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:40:29.255 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 ceph-mds[65351]: -- 172.21.15.26:0/2306697818 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d265a27860 con 0x55d265a05400 2024-09-10T11:40:29.255 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:28 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: starting mds.b at 2024-09-10T11:40:29.255 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:29 smithi026 bash[65332]: f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f 2024-09-10T11:40:29.255 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:40:29 smithi026 systemd[1]: Started Ceph mds.b for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1392267557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.392 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:29 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1392267557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:29 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1392267557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:29.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:29 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:30.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:30 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:boot 2024-09-10T11:40:30.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:30 smithi017 ceph-mon[30817]: fsmap 12 up:standby 2024-09-10T11:40:30.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:30 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:40:30.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:30 smithi017 ceph-mon[30817]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:30 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:boot 2024-09-10T11:40:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:30 smithi081 ceph-mon[35059]: fsmap 12 up:standby 2024-09-10T11:40:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:30 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:40:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:30 smithi081 ceph-mon[35059]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:30.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:30 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:boot 2024-09-10T11:40:30.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:30 smithi026 ceph-mon[34817]: fsmap 12 up:standby 2024-09-10T11:40:30.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:30 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:40:30.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:30 smithi026 ceph-mon[34817]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:31.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.879 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:31 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:31.958 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:31.959 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:31 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:32.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:32.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:31 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:40:32.095 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.577+0000 7fc57ce07640 1 -- 172.21.15.17:0/3956587356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781082a0 msgr2=0x7fc57810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.577+0000 7fc57ce07640 1 --2- 172.21.15.17:0/3956587356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781082a0 0x7fc57810ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc570009930 tx=0x7fc57002a420 comp rx=0 tx=0).stop 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 -- 172.21.15.17:0/3956587356 shutdown_connections 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 --2- 172.21.15.17:0/3956587356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781036e0 0x7fc578107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 --2- 172.21.15.17:0/3956587356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781082a0 0x7fc57810ec40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 --2- 172.21.15.17:0/3956587356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 0x7fc578103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 -- 172.21.15.17:0/3956587356 >> 172.21.15.17:0/3956587356 conn(0x7fc5780fc7d0 msgr2=0x7fc5780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 -- 172.21.15.17:0/3956587356 shutdown_connections 2024-09-10T11:40:32.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.578+0000 7fc57ce07640 1 -- 172.21.15.17:0/3956587356 wait complete. 2024-09-10T11:40:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 Processor -- start 2024-09-10T11:40:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 -- start start 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 0x7fc5781a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 0x7fc57819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc5781120a0 con 0x7fc5781036e0 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc578111f20 con 0x7fc578102d30 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57ce07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc578112220 con 0x7fc5781082a0 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51604/0 (socket says 172.21.15.17:51604) 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 -- 172.21.15.17:0/1409519504 learned_addr learned my addr 172.21.15.17:0/1409519504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc57659c640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 0x7fc5781a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc576d9d640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 0x7fc57819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 -- 172.21.15.17:0/1409519504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 msgr2=0x7fc57819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 0x7fc57819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 -- 172.21.15.17:0/1409519504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 msgr2=0x7fc5781a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 0x7fc5781a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc575d9b640 1 -- 172.21.15.17:0/1409519504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57819ace0 con 0x7fc5781036e0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.579+0000 7fc576d9d640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 0x7fc57819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc575d9b640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c970 tx=0x7fc56c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c004220 con 0x7fc5781036e0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56c0043c0 con 0x7fc5781036e0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c004a00 con 0x7fc5781036e0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57819afd0 con 0x7fc5781036e0 2024-09-10T11:40:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.580+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5781a72c0 con 0x7fc5781036e0 2024-09-10T11:40:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.581+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc578103110 con 0x7fc5781036e0 2024-09-10T11:40:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.582+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc56c0079b0 con 0x7fc5781036e0 2024-09-10T11:40:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.583+0000 7fc5677fe640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 0x7fc5600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.583+0000 7fc57659c640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 0x7fc5600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.583+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc56c0ce8d0 con 0x7fc5781036e0 2024-09-10T11:40:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.583+0000 7fc57659c640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 0x7fc5600a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc568005c40 tx=0x7fc56800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.587+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc56c014030 con 0x7fc5781036e0 2024-09-10T11:40:32.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.823+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc57819bae0 con 0x7fc5781036e0 2024-09-10T11:40:32.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.824+0000 7fc5677fe640 1 -- 172.21.15.17:0/1409519504 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7fc57819bae0 con 0x7fc5781036e0 2024-09-10T11:40:32.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:32.825 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"btime":"2024-09-10T11:40:29:302493+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24512,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T11:40:32.825 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-09-10T11:40:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 msgr2=0x7fc5600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 0x7fc5600a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc568005c40 tx=0x7fc56800a590 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 msgr2=0x7fc5781a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c970 tx=0x7fc56c00ce30 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 shutdown_connections 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5600a2b80 0x7fc5600a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5781082a0 0x7fc57819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5781036e0 0x7fc5781a0930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 --2- 172.21.15.17:0/1409519504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc578102d30 0x7fc5781a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 >> 172.21.15.17:0/1409519504 conn(0x7fc5780fc7d0 msgr2=0x7fc5781011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 shutdown_connections 2024-09-10T11:40:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:32.826+0000 7fc57ce07640 1 -- 172.21.15.17:0/1409519504 wait complete. 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.148 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:32 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1409519504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:33.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:33.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:32 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1409519504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:33.361 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:33.361 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:33.362 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:32 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1409519504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:40:33.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T11:40:33.758 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 -- 172.21.15.17:0/1432336234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102570 msgr2=0x7fb77c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 --2- 172.21.15.17:0/1432336234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102570 0x7fb77c1029b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb764009900 tx=0x7fb76402a480 comp rx=0 tx=0).stop 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 -- 172.21.15.17:0/1432336234 shutdown_connections 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 --2- 172.21.15.17:0/1432336234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102ef0 0x7fb77c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 --2- 172.21.15.17:0/1432336234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102570 0x7fb77c1029b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 --2- 172.21.15.17:0/1432336234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 -- 172.21.15.17:0/1432336234 >> 172.21.15.17:0/1432336234 conn(0x7fb77c0fc7d0 msgr2=0x7fb77c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 -- 172.21.15.17:0/1432336234 shutdown_connections 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.189+0000 7fb782476640 1 -- 172.21.15.17:0/1432336234 wait complete. 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 Processor -- start 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 -- start start 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 0x7fb77c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110f80 con 0x7fb77c102ef0 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110e00 con 0x7fb77c100e20 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb782476640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c111100 con 0x7fb77c102570 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb780a13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb780a13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51620/0 (socket says 172.21.15.17:51620) 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb780a13640 1 -- 172.21.15.17:0/154575589 learned_addr learned my addr 172.21.15.17:0/154575589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb773fff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 0x7fb77c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.190+0000 7fb77bfff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 -- 172.21.15.17:0/154575589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 msgr2=0x7fb77c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 0x7fb77c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 -- 172.21.15.17:0/154575589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 msgr2=0x7fb77c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 -- 172.21.15.17:0/154575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c1a69a0 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb77bfff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb773fff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 0x7fb77c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb780a13640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb77400eaa0 tx=0x7fb77400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77400cdb0 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c1a6c90 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb774005020 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740116b0 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.191+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c1a71a0 con 0x7fb77c102ef0 2024-09-10T11:40:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.192+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c1021b0 con 0x7fb77c102ef0 2024-09-10T11:40:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.194+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb774005560 con 0x7fb77c102ef0 2024-09-10T11:40:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.195+0000 7fb779ffb640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 0x7fb7680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.195+0000 7fb77bfff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 0x7fb7680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.195+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fb7740ced80 con 0x7fb77c102ef0 2024-09-10T11:40:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.195+0000 7fb77bfff640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 0x7fb7680a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0058c0 tx=0x7fb76c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.199+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb774016030 con 0x7fb77c102ef0 2024-09-10T11:40:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.378+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb77c02d7c0 con 0x7fb77c102ef0 2024-09-10T11:40:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.378+0000 7fb779ffb640 1 -- 172.21.15.17:0/154575589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7fb77409c180 con 0x7fb77c102ef0 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:40:34.380 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.380+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 msgr2=0x7fb7680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.380+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 0x7fb7680a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0058c0 tx=0x7fb76c005850 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 msgr2=0x7fb77c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb77400eaa0 tx=0x7fb77400ef60 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 shutdown_connections 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7680a2b80 0x7fb7680a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c102570 0x7fb77c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb77c102ef0 0x7fb77c0fd700 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 --2- 172.21.15.17:0/154575589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb77c100e20 0x7fb77c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:34.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 >> 172.21.15.17:0/154575589 conn(0x7fb77c0fc7d0 msgr2=0x7fb77c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:34.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 shutdown_connections 2024-09-10T11:40:34.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:34.381+0000 7fb782476640 1 -- 172.21.15.17:0/154575589 wait complete. 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:34 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/154575589' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T11:40:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:34.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:34.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:34 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/154575589' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T11:40:34.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:40:34.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:40:34.756 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:34 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/154575589' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T11:40:34.987 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T11:40:34.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T11:40:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 -- 172.21.15.17:0/2448556165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 msgr2=0x7fa850103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 --2- 172.21.15.17:0/2448556165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa850103170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009930 tx=0x7fa84c02a420 comp rx=0 tx=0).stop 2024-09-10T11:40:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 -- 172.21.15.17:0/2448556165 shutdown_connections 2024-09-10T11:40:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 --2- 172.21.15.17:0/2448556165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 0x7fa85010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 --2- 172.21.15.17:0/2448556165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 0x7fa850107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 --2- 172.21.15.17:0/2448556165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa850103170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 -- 172.21.15.17:0/2448556165 >> 172.21.15.17:0/2448556165 conn(0x7fa8500fc7d0 msgr2=0x7fa8500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 -- 172.21.15.17:0/2448556165 shutdown_connections 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.684+0000 7fa858775640 1 -- 172.21.15.17:0/2448556165 wait complete. 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 Processor -- start 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 -- start start 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 0x7fa850198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 0x7fa85019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa850112090 con 0x7fa850102d90 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa850111f10 con 0x7fa850103740 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa858775640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa850112210 con 0x7fa850108290 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa856511640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa856511640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51640/0 (socket says 172.21.15.17:51640) 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa856511640 1 -- 172.21.15.17:0/3555806433 learned_addr learned my addr 172.21.15.17:0/3555806433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa855d10640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 0x7fa850198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.685+0000 7fa856d12640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 0x7fa85019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 -- 172.21.15.17:0/3555806433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 msgr2=0x7fa85019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 0x7fa85019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 -- 172.21.15.17:0/3555806433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 msgr2=0x7fa850198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 0x7fa850198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 -- 172.21.15.17:0/3555806433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85019d550 con 0x7fa850102d90 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa856511640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009230 tx=0x7fa84c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c03f030 con 0x7fa850102d90 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa84c003ad0 con 0x7fa850102d90 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85019d7e0 con 0x7fa850102d90 2024-09-10T11:40:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.686+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c035070 con 0x7fa850102d90 2024-09-10T11:40:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.687+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8501a5120 con 0x7fa850102d90 2024-09-10T11:40:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.688+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85006a7f0 con 0x7fa850102d90 2024-09-10T11:40:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.688+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa84c042030 con 0x7fa850102d90 2024-09-10T11:40:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.689+0000 7fa8477fe640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 0x7fa83c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.689+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fa84c0eeae0 con 0x7fa850102d90 2024-09-10T11:40:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.689+0000 7fa855d10640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 0x7fa83c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.690+0000 7fa855d10640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 0x7fa83c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8500feec0 tx=0x7fa84000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.693+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa84c0bb890 con 0x7fa850102d90 2024-09-10T11:40:35.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:35.870+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa850199900 con 0x7fa850102d90 2024-09-10T11:40:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.464+0000 7fa8477fe640 1 -- 172.21.15.17:0/3555806433 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fa84c0a4e20 con 0x7fa850102d90 2024-09-10T11:40:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T11:40:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 msgr2=0x7fa83c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 0x7fa83c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8500feec0 tx=0x7fa84000b390 comp rx=0 tx=0).stop 2024-09-10T11:40:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 msgr2=0x7fa8501985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009230 tx=0x7fa84c004270 comp rx=0 tx=0).stop 2024-09-10T11:40:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 shutdown_connections 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa83c0a2b80 0x7fa83c0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa850108290 0x7fa85019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa850103740 0x7fa850198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 --2- 172.21.15.17:0/3555806433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa850102d90 0x7fa8501985a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 >> 172.21.15.17:0/3555806433 conn(0x7fa8500fc7d0 msgr2=0x7fa850105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 shutdown_connections 2024-09-10T11:40:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:36.467+0000 7fa858775640 1 -- 172.21.15.17:0/3555806433 wait complete. 2024-09-10T11:40:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:36 smithi026 ceph-mon[34817]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:36 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T11:40:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:36 smithi017 ceph-mon[30817]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:36 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T11:40:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:36 smithi081 ceph-mon[35059]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:36 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T11:40:37.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T11:40:37.368 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:37.748 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:37 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T11:40:37.748 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:37 smithi017 ceph-mon[30817]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T11:40:37.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:37 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T11:40:37.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:37 smithi026 ceph-mon[34817]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T11:40:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 -- 172.21.15.17:0/2966624955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4106a80 msgr2=0x7f2df4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/2966624955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4106a80 0x7f2df4106e60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009930 tx=0x7f2de802a420 comp rx=0 tx=0).stop 2024-09-10T11:40:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 -- 172.21.15.17:0/2966624955 shutdown_connections 2024-09-10T11:40:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/2966624955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/2966624955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4101420 0x7f2df410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/2966624955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4106a80 0x7f2df4106e60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.838+0000 7f2dfabf7640 1 -- 172.21.15.17:0/2966624955 >> 172.21.15.17:0/2966624955 conn(0x7f2df40fc7a0 msgr2=0x7f2df40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.839+0000 7f2dfabf7640 1 -- 172.21.15.17:0/2966624955 shutdown_connections 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.839+0000 7f2dfabf7640 1 -- 172.21.15.17:0/2966624955 wait complete. 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 Processor -- start 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 -- start start 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:37.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 0x7f2df41a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4110e80 con 0x7f2df4101420 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4110d00 con 0x7f2df4106a80 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2dfabf7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4111000 con 0x7f2df4100a80 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df8993640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51662/0 (socket says 172.21.15.17:51662) 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df8993640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51214/0 (socket says 172.21.15.17:51214) 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 -- 172.21.15.17:0/4053025536 learned_addr learned my addr 172.21.15.17:0/4053025536 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df9194640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 0x7f2df41a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 -- 172.21.15.17:0/4053025536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 msgr2=0x7f2df41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 -- 172.21.15.17:0/4053025536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 msgr2=0x7f2df41a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:37.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 0x7f2df41a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df3fff640 1 -- 172.21.15.17:0/4053025536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df41a48b0 con 0x7f2df4101420 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.840+0000 7f2df9194640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 0x7f2df41a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2df3fff640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d950 tx=0x7f2de000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0017070 con 0x7f2df4101420 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2de0009c30 con 0x7f2df4101420 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df41a4a80 con 0x7f2df4101420 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de000f6b0 con 0x7f2df4101420 2024-09-10T11:40:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.841+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df41a4fc0 con 0x7f2df4101420 2024-09-10T11:40:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.842+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df4100ee0 con 0x7f2df4101420 2024-09-10T11:40:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.843+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2de00109d0 con 0x7f2df4101420 2024-09-10T11:40:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.844+0000 7f2df1ffb640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 0x7f2de40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.844+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7497+0+0 (secure 0 0 0) 0x7f2de00ce850 con 0x7f2df4101420 2024-09-10T11:40:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.844+0000 7f2df8993640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 0x7f2de40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.845+0000 7f2df8993640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 0x7f2de40a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009900 tx=0x7f2de80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:37.849+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2de0009de0 con 0x7f2df4101420 2024-09-10T11:40:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:37 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3555806433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T11:40:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:37 smithi081 ceph-mon[35059]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T11:40:38.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.025+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2df4108ff0 con 0x7f2df4101420 2024-09-10T11:40:38.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.475+0000 7f2df1ffb640 1 -- 172.21.15.17:0/4053025536 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) ==== 170+0+0 (secure 0 0 0) 0x7f2de009b490 con 0x7f2df4101420 2024-09-10T11:40:38.476 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T11:40:38.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 msgr2=0x7f2de40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 0x7f2de40a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009900 tx=0x7f2de80058d0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 msgr2=0x7f2df4199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d950 tx=0x7f2de000de10 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 shutdown_connections 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2de40a2c00 0x7f2de40a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2df4106a80 0x7f2df41a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2df4101420 0x7f2df4199830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 --2- 172.21.15.17:0/4053025536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2df4100a80 0x7f2df41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 >> 172.21.15.17:0/4053025536 conn(0x7f2df40fc7a0 msgr2=0x7f2df40fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 shutdown_connections 2024-09-10T11:40:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:38.478+0000 7f2dfabf7640 1 -- 172.21.15.17:0/4053025536 wait complete. 2024-09-10T11:40:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:38 smithi026 ceph-mon[34817]: pgmap v272: 33 pgs: 14 creating+peering, 1 active+clean, 18 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:38 smithi026 ceph-mon[34817]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T11:40:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:38 smithi026 ceph-mon[34817]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T11:40:38.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:38 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T11:40:38.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:38 smithi017 ceph-mon[30817]: pgmap v272: 33 pgs: 14 creating+peering, 1 active+clean, 18 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:38.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:38 smithi017 ceph-mon[30817]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T11:40:38.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:38 smithi017 ceph-mon[30817]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T11:40:38.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:38 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T11:40:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:38 smithi081 ceph-mon[35059]: pgmap v272: 33 pgs: 14 creating+peering, 1 active+clean, 18 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:38 smithi081 ceph-mon[35059]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T11:40:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:38 smithi081 ceph-mon[35059]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T11:40:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:38 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T11:40:39.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T11:40:39.382 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:39 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T11:40:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:39 smithi026 ceph-mon[34817]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T11:40:39.755 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:39 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T11:40:39.755 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:39 smithi017 ceph-mon[30817]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 -- 172.21.15.17:0/2227729107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 msgr2=0x7fc55c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 --2- 172.21.15.17:0/2227729107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1067e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc550009900 tx=0x7fc55002a410 comp rx=0 tx=0).stop 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 -- 172.21.15.17:0/2227729107 shutdown_connections 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 --2- 172.21.15.17:0/2227729107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c106f10 0x7fc55c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 --2- 172.21.15.17:0/2227729107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1067e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 --2- 172.21.15.17:0/2227729107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c101de0 0x7fc55c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 -- 172.21.15.17:0/2227729107 >> 172.21.15.17:0/2227729107 conn(0x7fc55c0fd8c0 msgr2=0x7fc55c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 -- 172.21.15.17:0/2227729107 shutdown_connections 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.840+0000 7fc561b9e640 1 -- 172.21.15.17:0/2227729107 wait complete. 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 Processor -- start 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 -- start start 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 0x7fc55c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c106f10 0x7fc55c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c111f30 con 0x7fc55c102790 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c111db0 con 0x7fc55c101de0 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc561b9e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c1120b0 con 0x7fc55c106f10 2024-09-10T11:40:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51684/0 (socket says 172.21.15.17:51684) 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 -- 172.21.15.17:0/170755322 learned_addr learned my addr 172.21.15.17:0/170755322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55b7fe640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 0x7fc55c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55bfff640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c106f10 0x7fc55c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 -- 172.21.15.17:0/170755322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c106f10 msgr2=0x7fc55c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c106f10 0x7fc55c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 -- 172.21.15.17:0/170755322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 msgr2=0x7fc55c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.841+0000 7fc55affd640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 0x7fc55c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc55affd640 1 -- 172.21.15.17:0/170755322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c19d330 con 0x7fc55c102790 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc55b7fe640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 0x7fc55c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc55affd640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc550006010 tx=0x7fc5500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55003f030 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc550003ce0 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c19d5c0 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550035070 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.842+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c1a4f00 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.843+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c1032c0 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.844+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc550042030 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.845+0000 7fc558ff9640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 0x7fc5440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.845+0000 7fc55b7fe640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 0x7fc5440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.845+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7fc5500ef4d0 con 0x7fc55c102790 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.845+0000 7fc55b7fe640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 0x7fc5440a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c007e70 tx=0x7fc54c007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:39.849+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5500bc6a0 con 0x7fc55c102790 2024-09-10T11:40:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:39 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4053025536' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T11:40:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:39 smithi081 ceph-mon[35059]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T11:40:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.060+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc55c1996e0 con 0x7fc55c102790 2024-09-10T11:40:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.486+0000 7fc558ff9640 1 -- 172.21.15.17:0/170755322 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc5500bbfa0 con 0x7fc55c102790 2024-09-10T11:40:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.489+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 msgr2=0x7fc5440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.489+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 0x7fc5440a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c007e70 tx=0x7fc54c007850 comp rx=0 tx=0).stop 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.489+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 msgr2=0x7fc55c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.489+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc550006010 tx=0x7fc5500042f0 comp rx=0 tx=0).stop 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 shutdown_connections 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5440a2c00 0x7fc5440a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c106f10 0x7fc55c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc55c102790 0x7fc55c1988c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 --2- 172.21.15.17:0/170755322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc55c101de0 0x7fc55c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 >> 172.21.15.17:0/170755322 conn(0x7fc55c0fd8c0 msgr2=0x7fc55c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 shutdown_connections 2024-09-10T11:40:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:40.490+0000 7fc561b9e640 1 -- 172.21.15.17:0/170755322 wait complete. 2024-09-10T11:40:40.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:40 smithi026 ceph-mon[34817]: pgmap v275: 97 pgs: 32 creating+peering, 16 active+clean, 49 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:40.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:40 smithi026 ceph-mon[34817]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T11:40:40.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:40 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T11:40:40.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:40 smithi026 ceph-mon[34817]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T11:40:40.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:40 smithi017 ceph-mon[30817]: pgmap v275: 97 pgs: 32 creating+peering, 16 active+clean, 49 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:40.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:40 smithi017 ceph-mon[30817]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T11:40:40.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:40 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T11:40:40.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:40 smithi017 ceph-mon[30817]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T11:40:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:40 smithi081 ceph-mon[35059]: pgmap v275: 97 pgs: 32 creating+peering, 16 active+clean, 49 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:40:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:40 smithi081 ceph-mon[35059]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T11:40:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:40 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T11:40:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:40 smithi081 ceph-mon[35059]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T11:40:41.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:40:41.368 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:41 smithi026 ceph-mon[34817]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:40:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:41 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T11:40:41.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:41 smithi026 ceph-mon[34817]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T11:40:41.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:41 smithi026 ceph-mon[34817]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T11:40:41.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:41 smithi017 ceph-mon[30817]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:40:41.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:41 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T11:40:41.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:41 smithi017 ceph-mon[30817]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T11:40:41.763 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:41 smithi017 ceph-mon[30817]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T11:40:41.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 -- 172.21.15.17:0/1799889254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 msgr2=0x7fc0b01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/1799889254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b01031c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009900 tx=0x7fc0a402a480 comp rx=0 tx=0).stop 2024-09-10T11:40:41.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 -- 172.21.15.17:0/1799889254 shutdown_connections 2024-09-10T11:40:41.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/1799889254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b010c180 0x7fc0b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/1799889254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b0103700 0x7fc0b010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/1799889254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b01031c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 -- 172.21.15.17:0/1799889254 >> 172.21.15.17:0/1799889254 conn(0x7fc0b00fc7a0 msgr2=0x7fc0b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 -- 172.21.15.17:0/1799889254 shutdown_connections 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.843+0000 7fc0b7d32640 1 -- 172.21.15.17:0/1799889254 wait complete. 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 Processor -- start 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 -- start start 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b0103700 0x7fc0b0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 0x7fc0b019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0111fb0 con 0x7fc0b0102de0 2024-09-10T11:40:41.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0111e30 con 0x7fc0b010c180 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b7d32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0112130 con 0x7fc0b0103700 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b5ace640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b5ace640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38690/0 (socket says 172.21.15.17:38690) 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b5ace640 1 -- 172.21.15.17:0/89923504 learned_addr learned my addr 172.21.15.17:0/89923504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.844+0000 7fc0b62cf640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 0x7fc0b019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 -- 172.21.15.17:0/89923504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b0103700 msgr2=0x7fc0b0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b0103700 0x7fc0b0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 -- 172.21.15.17:0/89923504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 msgr2=0x7fc0b019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 0x7fc0b019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 -- 172.21.15.17:0/89923504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b019d3c0 con 0x7fc0b0102de0 2024-09-10T11:40:41.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b62cf640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 0x7fc0b019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.845+0000 7fc0b5ace640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4005ab0 tx=0x7fc0a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.846+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a403f030 con 0x7fc0b0102de0 2024-09-10T11:40:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.846+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0a4003ce0 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.846+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b019d650 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.846+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4035070 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.846+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b01a4f90 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.847+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b01031c0 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.848+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc0a4042030 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.848+0000 7fc0a2ffd640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 0x7fc09c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.849+0000 7fc0b52cd640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 0x7fc09c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.849+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fc0a40ef8c0 con 0x7fc0b0102de0 2024-09-10T11:40:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.849+0000 7fc0b52cd640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 0x7fc09c0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00fed30 tx=0x7fc0ac005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:41.853+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0a40bc8d0 con 0x7fc0b0102de0 2024-09-10T11:40:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:41 smithi081 ceph-mon[35059]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T11:40:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:41 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/170755322' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T11:40:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:41 smithi081 ceph-mon[35059]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T11:40:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:41 smithi081 ceph-mon[35059]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T11:40:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.028+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0b0107240 con 0x7fc0b0102de0 2024-09-10T11:40:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.030+0000 7fc0a2ffd640 1 -- 172.21.15.17:0/89923504 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22179 (secure 0 0 0) 0x7fc0a40bc1d0 con 0x7fc0b0102de0 2024-09-10T11:40:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:42.031 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:40.061531+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:40:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 msgr2=0x7fc09c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 0x7fc09c0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00fed30 tx=0x7fc0ac005c70 comp rx=0 tx=0).stop 2024-09-10T11:40:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 msgr2=0x7fc0b0198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4005ab0 tx=0x7fc0a40042f0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 shutdown_connections 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc09c0a2c00 0x7fc09c0a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0b0103700 0x7fc0b0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0b010c180 0x7fc0b019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 --2- 172.21.15.17:0/89923504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0b0102de0 0x7fc0b0198410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 >> 172.21.15.17:0/89923504 conn(0x7fc0b00fc7a0 msgr2=0x7fc0b00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 shutdown_connections 2024-09-10T11:40:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:42.032+0000 7fc0b7d32640 1 -- 172.21.15.17:0/89923504 wait complete. 2024-09-10T11:40:42.633 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: pgmap v278: 97 pgs: 32 creating+peering, 30 active+clean, 35 unknown; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: Cluster is now healthy 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:active 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:42 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/89923504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:42.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:40:42.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: pgmap v278: 97 pgs: 32 creating+peering, 30 active+clean, 35 unknown; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T11:40:42.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T11:40:42.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: Cluster is now healthy 2024-09-10T11:40:42.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:active 2024-09-10T11:40:42.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:42 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/89923504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: pgmap v278: 97 pgs: 32 creating+peering, 30 active+clean, 35 unknown; 578 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: Cluster is now healthy 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] up:active 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:42 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/89923504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 -- 172.21.15.17:0/414682466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0901082a0 msgr2=0x7fc09010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 --2- 172.21.15.17:0/414682466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0901082a0 0x7fc09010ec40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc088009cd0 tx=0x7fc08802a8e0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 -- 172.21.15.17:0/414682466 shutdown_connections 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 --2- 172.21.15.17:0/414682466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0901082a0 0x7fc09010ec40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 --2- 172.21.15.17:0/414682466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc090107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 --2- 172.21.15.17:0/414682466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090102d30 0x7fc090103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 -- 172.21.15.17:0/414682466 >> 172.21.15.17:0/414682466 conn(0x7fc0900fc7d0 msgr2=0x7fc0900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 -- 172.21.15.17:0/414682466 shutdown_connections 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.366+0000 7fc0968f4640 1 -- 172.21.15.17:0/414682466 wait complete. 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 Processor -- start 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 -- start start 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc09019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 0x7fc09019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901120a0 con 0x7fc090102d30 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc090111f20 con 0x7fc0901036e0 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc0968f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc090112220 con 0x7fc0901082a0 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc08ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc08ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38706/0 (socket says 172.21.15.17:38706) 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc08ffff640 1 -- 172.21.15.17:0/1044564865 learned_addr learned my addr 172.21.15.17:0/1044564865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc087fff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc09019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc08ffff640 1 -- 172.21.15.17:0/1044564865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 msgr2=0x7fc09019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc094e91640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 0x7fc09019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.367+0000 7fc08ffff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 0x7fc09019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08ffff640 1 -- 172.21.15.17:0/1044564865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 msgr2=0x7fc09019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08ffff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc09019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08ffff640 1 -- 172.21.15.17:0/1044564865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09019f6a0 con 0x7fc090102d30 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc087fff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc09019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc094e91640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 0x7fc09019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08ffff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c920 tx=0x7fc08000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080007c70 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09019f990 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc080007e10 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080018890 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.368+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0901a7270 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.369+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc090103110 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.370+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc080018a50 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.371+0000 7fc08dffb640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 0x7fc07c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.371+0000 7fc087fff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 0x7fc07c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.371+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fc0800cf390 con 0x7fc090102d30 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.371+0000 7fc087fff640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 0x7fc07c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc078005fd0 tx=0x7fc078005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.374+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc080014030 con 0x7fc090102d30 2024-09-10T11:40:43.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.553+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc09019ba50 con 0x7fc090102d30 2024-09-10T11:40:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.554+0000 7fc08dffb640 1 -- 172.21.15.17:0/1044564865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22179 (secure 0 0 0) 0x7fc08009c4d0 con 0x7fc090102d30 2024-09-10T11:40:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:40:43.555 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:40.061531+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 msgr2=0x7fc07c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 0x7fc07c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc078005fd0 tx=0x7fc078005850 comp rx=0 tx=0).stop 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 msgr2=0x7fc09019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c920 tx=0x7fc08000cde0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 shutdown_connections 2024-09-10T11:40:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc07c0a2b80 0x7fc07c0a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901082a0 0x7fc09019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0901036e0 0x7fc09019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 --2- 172.21.15.17:0/1044564865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc090102d30 0x7fc09019a6f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 >> 172.21.15.17:0/1044564865 conn(0x7fc0900fc7d0 msgr2=0x7fc0900fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 shutdown_connections 2024-09-10T11:40:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:43.556+0000 7fc0968f4640 1 -- 172.21.15.17:0/1044564865 wait complete. 2024-09-10T11:40:44.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T11:40:44.421 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:44 smithi081 ceph-mon[35059]: pgmap v279: 97 pgs: 18 creating+peering, 79 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-10T11:40:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:44 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1044564865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:44 smithi026 ceph-mon[34817]: pgmap v279: 97 pgs: 18 creating+peering, 79 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-10T11:40:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:44 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1044564865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:44.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:44 smithi017 ceph-mon[30817]: pgmap v279: 97 pgs: 18 creating+peering, 79 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-10T11:40:44.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:44 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1044564865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:40:44.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 -- 172.21.15.17:0/4127212207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd0106c30 msgr2=0x7f1bd0107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 --2- 172.21.15.17:0/4127212207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd0106c30 0x7f1bd0107010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009900 tx=0x7f1bc402a410 comp rx=0 tx=0).stop 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 -- 172.21.15.17:0/4127212207 shutdown_connections 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 --2- 172.21.15.17:0/4127212207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 0x7f1bd010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 --2- 172.21.15.17:0/4127212207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd01011a0 0x7f1bd0101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 --2- 172.21.15.17:0/4127212207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd0106c30 0x7f1bd0107010 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 -- 172.21.15.17:0/4127212207 >> 172.21.15.17:0/4127212207 conn(0x7f1bd0077210 msgr2=0x7f1bd00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 -- 172.21.15.17:0/4127212207 shutdown_connections 2024-09-10T11:40:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.893+0000 7f1bd702c640 1 -- 172.21.15.17:0/4127212207 wait complete. 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.894+0000 7f1bd702c640 1 Processor -- start 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.894+0000 7f1bd702c640 1 -- start start 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.894+0000 7f1bd702c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.894+0000 7f1bd702c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 0x7f1bd0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd702c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd0106c30 0x7f1bd01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd702c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0110fa0 con 0x7f1bd01011a0 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd702c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0110e20 con 0x7f1bd0106c30 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd702c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0111120 con 0x7f1bd0101b40 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38718/0 (socket says 172.21.15.17:38718) 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 -- 172.21.15.17:0/746946390 learned_addr learned my addr 172.21.15.17:0/746946390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd55c9640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd0106c30 0x7f1bd01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bcffff640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 0x7f1bd0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 -- 172.21.15.17:0/746946390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 msgr2=0x7f1bd0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 0x7f1bd0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 -- 172.21.15.17:0/746946390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd0106c30 msgr2=0x7f1bd01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd0106c30 0x7f1bd01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 -- 172.21.15.17:0/746946390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd01a4910 con 0x7f1bd01011a0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd4dc8640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4005ab0 tx=0x7f1bc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc403f030 con 0x7f1bd01011a0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01a4ae0 con 0x7f1bd01011a0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bc4003ce0 con 0x7f1bd01011a0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.895+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4035070 con 0x7f1bd01011a0 2024-09-10T11:40:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.896+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd01a4f90 con 0x7f1bd01011a0 2024-09-10T11:40:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.897+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd0101600 con 0x7f1bd01011a0 2024-09-10T11:40:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.898+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1bc4042030 con 0x7f1bd01011a0 2024-09-10T11:40:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.899+0000 7f1bcdffb640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 0x7f1bc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.899+0000 7f1bcffff640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 0x7f1bc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.899+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f1bc40efb80 con 0x7f1bd01011a0 2024-09-10T11:40:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.899+0000 7f1bcffff640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 0x7f1bc00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0100be0 tx=0x7f1bbc00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:44.902+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bc40bcb90 con 0x7f1bd01011a0 2024-09-10T11:40:45.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.114+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1bd01090a0 con 0x7f1bd01011a0 2024-09-10T11:40:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.492+0000 7f1bcdffb640 1 -- 172.21.15.17:0/746946390 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f1bc40bc490 con 0x7f1bd01011a0 2024-09-10T11:40:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 msgr2=0x7f1bc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 0x7f1bc00a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0100be0 tx=0x7f1bbc00a4c0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 msgr2=0x7f1bd0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4005ab0 tx=0x7f1bc40042f0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 shutdown_connections 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bc00a2b80 0x7f1bc00a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd0101b40 0x7f1bd0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd0106c30 0x7f1bd01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 --2- 172.21.15.17:0/746946390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bd01011a0 0x7f1bd0199350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 >> 172.21.15.17:0/746946390 conn(0x7f1bd0077210 msgr2=0x7f1bd00fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 shutdown_connections 2024-09-10T11:40:45.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:45.496+0000 7f1bd702c640 1 -- 172.21.15.17:0/746946390 wait complete. 2024-09-10T11:40:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:45 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T11:40:45.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:45 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T11:40:45.777 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:45 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T11:40:46.089 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T11:40:46.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T11:40:46.203 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:40:45.774+0000 7f3786473640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T11:40:46.350 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:46.725 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:46 smithi017 ceph-mon[30817]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T11:40:46.725 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:46 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T11:40:46.725 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:46 smithi017 ceph-mon[30817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:46 smithi026 ceph-mon[34817]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T11:40:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:46 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T11:40:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:46 smithi026 ceph-mon[34817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:46.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.809+0000 7ffaa51e1640 1 -- 172.21.15.17:0/368489120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0106f10 msgr2=0x7ffaa010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.809+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/368489120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0106f10 0x7ffaa010ea90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009ca0 tx=0x7ffa9802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 -- 172.21.15.17:0/368489120 shutdown_connections 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/368489120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/368489120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0106f10 0x7ffaa010ea90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/368489120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0101de0 0x7ffaa01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 -- 172.21.15.17:0/368489120 >> 172.21.15.17:0/368489120 conn(0x7ffaa00fd8c0 msgr2=0x7ffaa00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 -- 172.21.15.17:0/368489120 shutdown_connections 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 -- 172.21.15.17:0/368489120 wait complete. 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.810+0000 7ffaa51e1640 1 Processor -- start 2024-09-10T11:40:46.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 -- start start 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 0x7ffaa019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111f70 con 0x7ffaa0101de0 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111df0 con 0x7ffaa0106f10 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffaa51e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01120f0 con 0x7ffaa0102790 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38738/0 (socket says 172.21.15.17:38738) 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 -- 172.21.15.17:0/2472116479 learned_addr learned my addr 172.21.15.17:0/2472116479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9e59c640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9f59e640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 0x7ffaa019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:46.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 -- 172.21.15.17:0/2472116479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 msgr2=0x7ffaa01988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 -- 172.21.15.17:0/2472116479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 msgr2=0x7ffaa019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 0x7ffaa019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 -- 172.21.15.17:0/2472116479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa019d360 con 0x7ffaa0101de0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9e59c640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9f59e640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 0x7ffaa019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.811+0000 7ffa9ed9d640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c920 tx=0x7ffa9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.812+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90007c70 con 0x7ffaa0101de0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.812+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa019d650 con 0x7ffaa0101de0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.812+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa90007e10 con 0x7ffaa0101de0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.812+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90018890 con 0x7ffaa0101de0 2024-09-10T11:40:46.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.812+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01a4f30 con 0x7ffaa0101de0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.813+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa01021c0 con 0x7ffaa0101de0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.814+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffa90018a70 con 0x7ffaa0101de0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.814+0000 7ffa87fff640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 0x7ffa880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.815+0000 7ffa9e59c640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 0x7ffa880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.815+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7ffa900cf190 con 0x7ffaa0101de0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.815+0000 7ffa9e59c640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 0x7ffa880a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa94005fd0 tx=0x7ffa9400b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:46.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:46.819+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa90014030 con 0x7ffaa0101de0 2024-09-10T11:40:46.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:46 smithi081 ceph-mon[35059]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T11:40:46.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:46 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/746946390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T11:40:46.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:46 smithi081 ceph-mon[35059]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.032+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ffaa002d7c0 con 0x7ffaa0101de0 2024-09-10T11:40:47.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.501+0000 7ffa87fff640 1 -- 172.21.15.17:0/2472116479 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ffa9000de20 con 0x7ffaa0101de0 2024-09-10T11:40:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 msgr2=0x7ffa880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 0x7ffa880a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa94005fd0 tx=0x7ffa9400b5d0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 msgr2=0x7ffaa01983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c920 tx=0x7ffa9000cde0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 shutdown_connections 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa880a2b80 0x7ffa880a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa0102790 0x7ffaa01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa0106f10 0x7ffaa019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 --2- 172.21.15.17:0/2472116479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa0101de0 0x7ffaa01983b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 >> 172.21.15.17:0/2472116479 conn(0x7ffaa00fd8c0 msgr2=0x7ffaa00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 shutdown_connections 2024-09-10T11:40:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:47.505+0000 7ffaa51e1640 1 -- 172.21.15.17:0/2472116479 wait complete. 2024-09-10T11:40:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:47 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T11:40:47.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:47 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T11:40:47.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:47 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T11:40:48.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T11:40:48.461 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T11:40:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:48 smithi026 ceph-mon[34817]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T11:40:48.755 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T11:40:48.756 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T11:40:48.756 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:48.756 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T11:40:48.756 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:48 smithi017 ceph-mon[30817]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T11:40:48.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T11:40:48.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T11:40:48.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2472116479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T11:40:48.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T11:40:48.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T11:40:48.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-10T11:40:48.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:48 smithi081 ceph-mon[35059]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-10T11:40:48.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.977+0000 7f1447e6d640 1 -- 172.21.15.17:0/3343126477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440100a80 msgr2=0x7f1440100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.977+0000 7f1447e6d640 1 --2- 172.21.15.17:0/3343126477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440100a80 0x7f1440100ee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1430009930 tx=0x7f143002a420 comp rx=0 tx=0).stop 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 -- 172.21.15.17:0/3343126477 shutdown_connections 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 --2- 172.21.15.17:0/3343126477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440101420 0x7f144010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 --2- 172.21.15.17:0/3343126477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440100a80 0x7f1440100ee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 --2- 172.21.15.17:0/3343126477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 0x7f1440106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 -- 172.21.15.17:0/3343126477 >> 172.21.15.17:0/3343126477 conn(0x7f14400fc7a0 msgr2=0x7f14400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 -- 172.21.15.17:0/3343126477 shutdown_connections 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 -- 172.21.15.17:0/3343126477 wait complete. 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 Processor -- start 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.978+0000 7f1447e6d640 1 -- start start 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 0x7f1440198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 0x7f144019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1440110e80 con 0x7f1440101420 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1440110d00 con 0x7f1440106a80 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1447e6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1440111000 con 0x7f1440100a80 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38764/0 (socket says 172.21.15.17:38764) 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 -- 172.21.15.17:0/729497908 learned_addr learned my addr 172.21.15.17:0/729497908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445c09640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 0x7f1440198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f144640a640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 0x7f144019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 -- 172.21.15.17:0/729497908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 msgr2=0x7f1440198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 0x7f1440198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 -- 172.21.15.17:0/729497908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 msgr2=0x7f144019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 0x7f144019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 -- 172.21.15.17:0/729497908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144019d430 con 0x7f1440101420 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445c09640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 0x7f1440198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.979+0000 7f1445408640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1430009230 tx=0x7f1430004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.980+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143003f030 con 0x7f1440101420 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.980+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1430003ad0 con 0x7f1440101420 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.980+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144019d6c0 con 0x7f1440101420 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.980+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430035070 con 0x7f1440101420 2024-09-10T11:40:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.980+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a5000 con 0x7f1440101420 2024-09-10T11:40:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.981+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14401021c0 con 0x7f1440101420 2024-09-10T11:40:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.982+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1430042030 con 0x7f1440101420 2024-09-10T11:40:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.983+0000 7f1436ffd640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 0x7f142c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.983+0000 7f1445c09640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 0x7f142c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.983+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f14300ef510 con 0x7f1440101420 2024-09-10T11:40:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.983+0000 7f1445c09640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 0x7f142c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f143c005d90 tx=0x7f143c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:48.987+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14300bc520 con 0x7f1440101420 2024-09-10T11:40:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.202+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f14401a51d0 con 0x7f1440101420 2024-09-10T11:40:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.516+0000 7f1436ffd640 1 -- 172.21.15.17:0/729497908 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f14300bbe20 con 0x7f1440101420 2024-09-10T11:40:49.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 msgr2=0x7f142c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:49.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 0x7f142c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f143c005d90 tx=0x7f143c005d20 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 msgr2=0x7f14401989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1430009230 tx=0x7f1430004270 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 shutdown_connections 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f142c0a2b80 0x7f142c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1440106a80 0x7f144019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1440101420 0x7f14401989c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 --2- 172.21.15.17:0/729497908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1440100a80 0x7f1440198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 >> 172.21.15.17:0/729497908 conn(0x7f14400fc7a0 msgr2=0x7f14401048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 shutdown_connections 2024-09-10T11:40:49.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:49.519+0000 7f1447e6d640 1 -- 172.21.15.17:0/729497908 wait complete. 2024-09-10T11:40:49.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:active 2024-09-10T11:40:49.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T11:40:49.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T11:40:49.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T11:40:49.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T11:40:49.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:49 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:active 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T11:40:49.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:49 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T11:40:50.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] up:active 2024-09-10T11:40:50.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T11:40:50.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-10T11:40:50.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-10T11:40:50.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T11:40:50.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:49 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T11:40:50.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T11:40:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:50.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T11:40:50.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T11:40:50.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:active 2024-09-10T11:40:50.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T11:40:50.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T11:40:50.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T11:40:50.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:50 smithi017 ceph-mon[30817]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T11:40:50.776 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T11:40:50.776 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T11:40:50.776 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:active 2024-09-10T11:40:50.776 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T11:40:50.777 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T11:40:50.777 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T11:40:50.777 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-mon[35059]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 -- 172.21.15.17:0/3963734803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e0102b90 msgr2=0x7fa9e0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3963734803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e0102b90 0x7fa9e0102f70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009900 tx=0x7fa9d002a480 comp rx=0 tx=0).stop 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 -- 172.21.15.17:0/3963734803 shutdown_connections 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3963734803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e010bfc0 0x7fa9e010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3963734803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 0x7fa9e010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3963734803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e0102b90 0x7fa9e0102f70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 -- 172.21.15.17:0/3963734803 >> 172.21.15.17:0/3963734803 conn(0x7fa9e00fc630 msgr2=0x7fa9e00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 -- 172.21.15.17:0/3963734803 shutdown_connections 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.966+0000 7fa9dffff640 1 -- 172.21.15.17:0/3963734803 wait complete. 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 Processor -- start 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 -- start start 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 0x7fa9e0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 0x7fa9e0198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0111dc0 con 0x7fa9e010bfc0 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0111c40 con 0x7fa9e01034b0 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9dffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0111f40 con 0x7fa9e0102b90 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.967+0000 7fa9df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9de7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 0x7fa9e0198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38776/0 (socket says 172.21.15.17:38776) 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 -- 172.21.15.17:0/3462424757 learned_addr learned my addr 172.21.15.17:0/3462424757 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9deffd640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 0x7fa9e0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 -- 172.21.15.17:0/3462424757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 msgr2=0x7fa9e0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 0x7fa9e0198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 -- 172.21.15.17:0/3462424757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 msgr2=0x7fa9e0198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 0x7fa9e0198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 -- 172.21.15.17:0/3462424757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e019d1d0 con 0x7fa9e010bfc0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9deffd640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 0x7fa9e0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9df7fe640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800eb10 tx=0x7fa9d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004b20 con 0x7fa9e010bfc0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e019d4c0 con 0x7fa9e010bfc0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d8004cc0 con 0x7fa9e010bfc0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8010760 con 0x7fa9e010bfc0 2024-09-10T11:40:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.968+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01a4da0 con 0x7fa9e010bfc0 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.969+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e0102f70 con 0x7fa9e010bfc0 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.970+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa9d8005020 con 0x7fa9e010bfc0 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.971+0000 7fa9c7fff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 0x7fa9c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.971+0000 7fa9deffd640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 0x7fa9c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.971+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fa9d80cf680 con 0x7fa9e010bfc0 2024-09-10T11:40:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.972+0000 7fa9deffd640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 0x7fa9c80a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0000c00 tx=0x7fa9d0032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:50.975+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9d809c690 con 0x7fa9e010bfc0 2024-09-10T11:40:51.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-10T11:40:51.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/729497908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T11:40:51.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] up:active 2024-09-10T11:40:51.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T11:40:51.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-10T11:40:51.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-10T11:40:51.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:50 smithi026 ceph-mon[34817]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-10T11:40:51.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.187+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa9e01a50a0 con 0x7fa9e010bfc0 2024-09-10T11:40:51.203 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:40:50.775+0000 7f3786473640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T11:40:51.203 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:40:50.775+0000 7f3786473640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T11:40:51.203 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:40:50.775+0000 7f3786473640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-10T11:40:51.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.534+0000 7fa9c7fff640 1 -- 172.21.15.17:0/3462424757 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fa9d809bf90 con 0x7fa9e010bfc0 2024-09-10T11:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 msgr2=0x7fa9c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 0x7fa9c80a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0000c00 tx=0x7fa9d0032c70 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 msgr2=0x7fa9e019caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800eb10 tx=0x7fa9d800c2d0 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 shutdown_connections 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa9c80a2b80 0x7fa9c80a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9e010bfc0 0x7fa9e019caf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9e01034b0 0x7fa9e0198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 --2- 172.21.15.17:0/3462424757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9e0102b90 0x7fa9e0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.536+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 >> 172.21.15.17:0/3462424757 conn(0x7fa9e00fc630 msgr2=0x7fa9e00fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.537+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 shutdown_connections 2024-09-10T11:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:51.537+0000 7fa9dffff640 1 -- 172.21.15.17:0/3462424757 wait complete. 2024-09-10T11:40:51.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:active 2024-09-10T11:40:51.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: Cluster is now healthy 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T11:40:51.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:51 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T11:40:51.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:active 2024-09-10T11:40:51.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T11:40:51.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T11:40:51.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: Cluster is now healthy 2024-09-10T11:40:51.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T11:40:51.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T11:40:51.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T11:40:51.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:51 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T11:40:52.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] up:active 2024-09-10T11:40:52.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: Cluster is now healthy 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-10T11:40:52.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:51 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T11:40:52.194 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T11:40:52.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T11:40:52.457 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:52.864 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:52 smithi017 ceph-mon[30817]: pgmap v283: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-10T11:40:52.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:52 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T11:40:52.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:52 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:active 2024-09-10T11:40:52.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:52 smithi017 ceph-mon[30817]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T11:40:52.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:52 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:40:52.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:52 smithi081 ceph-mon[35059]: pgmap v283: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-10T11:40:52.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:52 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T11:40:52.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:52 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:active 2024-09-10T11:40:52.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:52 smithi081 ceph-mon[35059]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T11:40:52.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:52 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:40:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- 172.21.15.17:0/1218850770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0108300 msgr2=0x7f9be010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/1218850770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0108300 0x7f9be010ec70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009cd0 tx=0x7f9bd802a8f0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- 172.21.15.17:0/1218850770 shutdown_connections 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/1218850770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0103780 0x7f9be0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/1218850770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0108300 0x7f9be010ec70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/1218850770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9be0102dd0 0x7f9be01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- 172.21.15.17:0/1218850770 >> 172.21.15.17:0/1218850770 conn(0x7f9be00fc7d0 msgr2=0x7f9be00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- 172.21.15.17:0/1218850770 shutdown_connections 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- 172.21.15.17:0/1218850770 wait complete. 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 Processor -- start 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.949+0000 7f9be6fcf640 1 -- start start 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 0x7f9be01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9be0108300 0x7f9be019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9be01120f0 con 0x7f9be0103780 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9be0111f70 con 0x7f9be0108300 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9be0112270 con 0x7f9be0102dd0 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46686/0 (socket says 172.21.15.17:46686) 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 -- 172.21.15.17:0/2137793631 learned_addr learned my addr 172.21.15.17:0/2137793631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be4d6b640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 0x7f9be01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 -- 172.21.15.17:0/2137793631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 msgr2=0x7f9be01985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 0x7f9be01985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 -- 172.21.15.17:0/2137793631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9be0108300 msgr2=0x7f9be019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9be0108300 0x7f9be019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 -- 172.21.15.17:0/2137793631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be019d570 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be4d6b640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 0x7f9be01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bdffff640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc006fd0 tx=0x7f9bcc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc011830 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be019d860 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bcc016070 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.950+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00f2e0 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.951+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be01a5140 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.951+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be01031b0 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.952+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9bcc0119d0 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.953+0000 7f9bddffb640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 0x7f9bd00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.953+0000 7f9be4d6b640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 0x7f9bd00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.953+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f9bcc0ce610 con 0x7f9be0103780 2024-09-10T11:40:52.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.954+0000 7f9be4d6b640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 0x7f9bd00a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009b40 tx=0x7f9bd4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:52.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:52.958+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bcc09b6c0 con 0x7f9be0103780 2024-09-10T11:40:53.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:52 smithi026 ceph-mon[34817]: pgmap v283: 97 pgs: 97 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-10T11:40:53.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:52 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3462424757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T11:40:53.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:52 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] up:active 2024-09-10T11:40:53.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:52 smithi026 ceph-mon[34817]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T11:40:53.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:52 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:40:53.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.157+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9be0062630 con 0x7f9bd00a2b80 2024-09-10T11:40:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.185+0000 7f9bddffb640 1 -- 172.21.15.17:0/2137793631 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9be0062630 con 0x7f9bd00a2b80 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 msgr2=0x7f9bd00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 0x7f9bd00a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009b40 tx=0x7f9bd4005e50 comp rx=0 tx=0).stop 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 msgr2=0x7f9be0198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc006fd0 tx=0x7f9bcc00b8e0 comp rx=0 tx=0).stop 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 shutdown_connections 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9bd00a2b80 0x7f9bd00a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9be0108300 0x7f9be019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9be0103780 0x7f9be0198b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 --2- 172.21.15.17:0/2137793631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be0102dd0 0x7f9be01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.187+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 >> 172.21.15.17:0/2137793631 conn(0x7f9be00fc7d0 msgr2=0x7f9be0105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.188+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 shutdown_connections 2024-09-10T11:40:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:53.188+0000 7f9be6fcf640 1 -- 172.21.15.17:0/2137793631 wait complete. 2024-09-10T11:40:53.510 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:40:53.163+0000 7f603a4fb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:40:53.510 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:40:53.163+0000 7f603a4fb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:40:53.510 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:40:53.163+0000 7f603a4fb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:40:53.510 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:40:53.163+0000 7f603a4fb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:40:53.510 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:40:53.163+0000 7f603a4fb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-10T11:40:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T11:40:53.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T11:40:53.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T11:40:53.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T11:40:53.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-10T11:40:53.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T11:40:54.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:54.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T11:40:54.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-10T11:40:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T11:40:54.078 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:54.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 -- 172.21.15.17:0/440135382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa010e480 msgr2=0x7f1aa0110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:54.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 --2- 172.21.15.17:0/440135382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa010e480 0x7f1aa0110870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009ca0 tx=0x7f1a9802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 -- 172.21.15.17:0/440135382 shutdown_connections 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 --2- 172.21.15.17:0/440135382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa0101280 0x7f1aa010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 --2- 172.21.15.17:0/440135382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa010e480 0x7f1aa0110870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 --2- 172.21.15.17:0/440135382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa01008d0 0x7f1aa0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.541+0000 7f1aa7616640 1 -- 172.21.15.17:0/440135382 >> 172.21.15.17:0/440135382 conn(0x7f1aa00fc7a0 msgr2=0x7f1aa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.542+0000 7f1aa7616640 1 -- 172.21.15.17:0/440135382 shutdown_connections 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.542+0000 7f1aa7616640 1 -- 172.21.15.17:0/440135382 wait complete. 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.542+0000 7f1aa7616640 1 Processor -- start 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.542+0000 7f1aa7616640 1 -- start start 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 0x7f1aa019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa010e480 0x7f1aa019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01141d0 con 0x7f1aa0101280 2024-09-10T11:40:54.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0114050 con 0x7f1aa010e480 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa7616640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0114350 con 0x7f1aa01008d0 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46734/0 (socket says 172.21.15.17:46734) 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 -- 172.21.15.17:0/3466754550 learned_addr learned my addr 172.21.15.17:0/3466754550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa5bb3640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa010e480 0x7f1aa019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa53b2640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 0x7f1aa019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 -- 172.21.15.17:0/3466754550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 msgr2=0x7f1aa019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 0x7f1aa019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 -- 172.21.15.17:0/3466754550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa010e480 msgr2=0x7f1aa019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa010e480 0x7f1aa019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa4bb1640 1 -- 172.21.15.17:0/3466754550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa019f5c0 con 0x7f1aa0101280 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.543+0000 7f1aa53b2640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 0x7f1aa019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:54.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.544+0000 7f1aa4bb1640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c970 tx=0x7f1a9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.548+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90007bb0 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.548+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a90007d50 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.548+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa019f8b0 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.548+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000f450 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.549+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa01a7190 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.550+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0100cb0 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.552+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1a90005020 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.553+0000 7f1a967fc640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 0x7f1a8c0a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.554+0000 7f1aa53b2640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 0x7f1a8c0a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.554+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f1a900cef10 con 0x7f1aa0101280 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.555+0000 7f1aa53b2640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 0x7f1a8c0a51d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005fd0 tx=0x7f1a9c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:54.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.561+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a90014030 con 0x7f1aa0101280 2024-09-10T11:40:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.762+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1aa010f680 con 0x7f1a8c0a2d10 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T11:40:54.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T11:40:54.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:40:54.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:54 smithi017 ceph-mon[30817]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T11:40:54.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.786+0000 7f1a967fc640 1 -- 172.21.15.17:0/3466754550 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1aa010f680 con 0x7f1a8c0a2d10 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 msgr2=0x7f1a8c0a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 0x7f1a8c0a51d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005fd0 tx=0x7f1a9c00b5f0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 msgr2=0x7f1aa019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c970 tx=0x7f1a9000ce30 comp rx=0 tx=0).stop 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 shutdown_connections 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1a8c0a2d10 0x7f1a8c0a51d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa010e480 0x7f1aa019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa0101280 0x7f1aa019ab50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 --2- 172.21.15.17:0/3466754550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa01008d0 0x7f1aa019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:54.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 >> 172.21.15.17:0/3466754550 conn(0x7f1aa00fc7a0 msgr2=0x7f1aa00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:54.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 shutdown_connections 2024-09-10T11:40:54.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:54.788+0000 7f1aa7616640 1 -- 172.21.15.17:0/3466754550 wait complete. 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T11:40:54.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T11:40:54.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T11:40:54.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T11:40:54.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T11:40:54.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:40:54.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:54 smithi081 ceph-mon[35059]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T11:40:55.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: pgmap v284: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.8 KiB/s wr, 18 op/s 2024-09-10T11:40:55.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T11:40:55.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:54 smithi026 ceph-mon[34817]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T11:40:55.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T11:40:55.646 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:55.767 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:55 smithi017 ceph-mon[30817]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:40:55.767 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:55 smithi017 ceph-mon[30817]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:55 smithi081 ceph-mon[35059]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:40:55.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:55 smithi081 ceph-mon[35059]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:55.953 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:40:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:40:55.775+0000 7f3786473640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-10T11:40:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:55 smithi026 ceph-mon[34817]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T11:40:56.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:55 smithi026 ceph-mon[34817]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:56.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.080+0000 7f4382b8c640 1 -- 172.21.15.17:0/2764229154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c102db0 msgr2=0x7f437c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.080+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2764229154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c102db0 0x7f437c103190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4374009cd0 tx=0x7f437402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- 172.21.15.17:0/2764229154 shutdown_connections 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2764229154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c103760 0x7f437c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2764229154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c1082e0 0x7f437c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2764229154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c102db0 0x7f437c103190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- 172.21.15.17:0/2764229154 >> 172.21.15.17:0/2764229154 conn(0x7f437c0fc7d0 msgr2=0x7f437c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- 172.21.15.17:0/2764229154 shutdown_connections 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- 172.21.15.17:0/2764229154 wait complete. 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 Processor -- start 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- start start 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c102db0 0x7f437c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 0x7f437c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f437c112090 con 0x7f437c103760 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f437c111f10 con 0x7f437c102db0 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f4382b8c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f437c112210 con 0x7f437c1082e0 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.081+0000 7f437bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46760/0 (socket says 172.21.15.17:46760) 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 -- 172.21.15.17:0/2089546478 learned_addr learned my addr 172.21.15.17:0/2089546478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4380928640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c102db0 0x7f437c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 -- 172.21.15.17:0/2089546478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 msgr2=0x7f437c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4381129640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 0x7f437c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 0x7f437c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 -- 172.21.15.17:0/2089546478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c102db0 msgr2=0x7f437c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c102db0 0x7f437c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 -- 172.21.15.17:0/2089546478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c19f6b0 con 0x7f437c103760 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4381129640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 0x7f437c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f437bfff640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f437000c8c0 tx=0x7f437000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370007bb0 con 0x7f437c103760 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4370007d50 con 0x7f437c103760 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c19f9a0 con 0x7f437c103760 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.082+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370018830 con 0x7f437c103760 2024-09-10T11:40:56.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.083+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c1a7280 con 0x7f437c103760 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.083+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c06a7d0 con 0x7f437c103760 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.084+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4370018a10 con 0x7f437c103760 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.085+0000 7f4379ffb640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 0x7f43640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.085+0000 7f4380928640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 0x7f43640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.086+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f43700cf260 con 0x7f437c103760 2024-09-10T11:40:56.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.086+0000 7f4380928640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 0x7f43640a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4374006010 tx=0x7f4374009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:56.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.090+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4370014030 con 0x7f437c103760 2024-09-10T11:40:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.292+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f437c062630 con 0x7f43640a2c90 2024-09-10T11:40:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.297+0000 7f4379ffb640 1 -- 172.21.15.17:0/2089546478 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f437c062630 con 0x7f43640a2c90 2024-09-10T11:40:56.298 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_0/d1bbe656-1357-4cff-8fc2-5aae8f2fc841 2024-09-10T11:40:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 msgr2=0x7f43640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 0x7f43640a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4374006010 tx=0x7f4374009360 comp rx=0 tx=0).stop 2024-09-10T11:40:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 msgr2=0x7f437c19ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f437000c8c0 tx=0x7f437000cd80 comp rx=0 tx=0).stop 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 shutdown_connections 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f43640a2c90 0x7f43640a5150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f437c1082e0 0x7f437c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f437c103760 0x7f437c19ac40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 --2- 172.21.15.17:0/2089546478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f437c102db0 0x7f437c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 >> 172.21.15.17:0/2089546478 conn(0x7f437c0fc7d0 msgr2=0x7f437c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 shutdown_connections 2024-09-10T11:40:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:56.299+0000 7f4382b8c640 1 -- 172.21.15.17:0/2089546478 wait complete. 2024-09-10T11:40:56.891 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:56 smithi017 ceph-mon[30817]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-10T11:40:56.891 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:56 smithi017 ceph-mon[30817]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:56.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T11:40:56.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:56 smithi081 ceph-mon[35059]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-10T11:40:56.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:56 smithi081 ceph-mon[35059]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:57.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:56 smithi026 ceph-mon[34817]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 585 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-10T11:40:57.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:56 smithi026 ceph-mon[34817]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 -- 172.21.15.17:0/3359436951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438106a80 msgr2=0x7f6438106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 --2- 172.21.15.17:0/3359436951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438106a80 0x7f6438106e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6428009930 tx=0x7f642802a420 comp rx=0 tx=0).stop 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 -- 172.21.15.17:0/3359436951 shutdown_connections 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 --2- 172.21.15.17:0/3359436951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438101420 0x7f643810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 --2- 172.21.15.17:0/3359436951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438100a80 0x7f6438100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 --2- 172.21.15.17:0/3359436951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438106a80 0x7f6438106e60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 -- 172.21.15.17:0/3359436951 >> 172.21.15.17:0/3359436951 conn(0x7f64380fc7a0 msgr2=0x7f64380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:57.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 -- 172.21.15.17:0/3359436951 shutdown_connections 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.647+0000 7f643e1ae640 1 -- 172.21.15.17:0/3359436951 wait complete. 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 Processor -- start 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 -- start start 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 0x7f6438102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438106a80 0x7f6438103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6438110ea0 con 0x7f6438100a80 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6438110d20 con 0x7f6438101420 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f643e1ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6438111020 con 0x7f6438106a80 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f64377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f64377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46776/0 (socket says 172.21.15.17:46776) 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.648+0000 7f64377fe640 1 -- 172.21.15.17:0/1427152997 learned_addr learned my addr 172.21.15.17:0/1427152997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f6436ffd640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 0x7f6438102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:57.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 -- 172.21.15.17:0/1427152997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438106a80 msgr2=0x7f6438103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438106a80 0x7f6438103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 -- 172.21.15.17:0/1427152997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 msgr2=0x7f6438102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 0x7f6438102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 -- 172.21.15.17:0/1427152997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64381a6980 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f6436ffd640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 0x7f6438102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f64377fe640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6428009a50 tx=0x7f6428004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642803f030 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6428003ce0 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64381a6c10 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428035070 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.649+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381a7140 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.650+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6438100ee0 con 0x7f6438100a80 2024-09-10T11:40:57.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.652+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6428042030 con 0x7f6438100a80 2024-09-10T11:40:57.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.653+0000 7f6434ff9640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 0x7f64200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:57.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.653+0000 7f6436ffd640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 0x7f64200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:57.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.653+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f64280efc30 con 0x7f6438100a80 2024-09-10T11:40:57.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.653+0000 7f6436ffd640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 0x7f64200a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6438104530 tx=0x7f642c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:57.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.656+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64280bc9e0 con 0x7f6438100a80 2024-09-10T11:40:57.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.856+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f643806a790 con 0x7f64200a2c90 2024-09-10T11:40:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.883+0000 7f6434ff9640 1 -- 172.21.15.17:0/1427152997 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f643806a790 con 0x7f64200a2c90 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 msgr2=0x7f64200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 0x7f64200a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6438104530 tx=0x7f642c005d30 comp rx=0 tx=0).stop 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 msgr2=0x7f6438102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6428009a50 tx=0x7f6428004270 comp rx=0 tx=0).stop 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 shutdown_connections 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f64200a2c90 0x7f64200a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6438106a80 0x7f6438103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6438101420 0x7f6438102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 --2- 172.21.15.17:0/1427152997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6438100a80 0x7f6438102aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 >> 172.21.15.17:0/1427152997 conn(0x7f64380fc7a0 msgr2=0x7f6438104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 shutdown_connections 2024-09-10T11:40:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:57.885+0000 7f643e1ae640 1 -- 172.21.15.17:0/1427152997 wait complete. 2024-09-10T11:40:58.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T11:40:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:58 smithi017 ceph-mon[30817]: pgmap v288: 97 pgs: 2 peering, 95 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:40:58.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:40:58 smithi017 ceph-mon[30817]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:40:58.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:58 smithi081 ceph-mon[35059]: pgmap v288: 97 pgs: 2 peering, 95 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:40:58.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:40:58 smithi081 ceph-mon[35059]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:59.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:58 smithi026 ceph-mon[34817]: pgmap v288: 97 pgs: 2 peering, 95 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:40:59.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:40:58 smithi026 ceph-mon[34817]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 -- 172.21.15.17:0/3957006661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 msgr2=0x7f031c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 --2- 172.21.15.17:0/3957006661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c1031d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f030c009ca0 tx=0x7f030c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 -- 172.21.15.17:0/3957006661 shutdown_connections 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 --2- 172.21.15.17:0/3957006661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 0x7f031c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 --2- 172.21.15.17:0/3957006661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 --2- 172.21.15.17:0/3957006661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c1031d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 -- 172.21.15.17:0/3957006661 >> 172.21.15.17:0/3957006661 conn(0x7f031c0fc7d0 msgr2=0x7f031c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 -- 172.21.15.17:0/3957006661 shutdown_connections 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.238+0000 7f0322044640 1 -- 172.21.15.17:0/3957006661 wait complete. 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 Processor -- start 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 -- start start 2024-09-10T11:40:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 0x7f031c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f031c112110 con 0x7f031c102df0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f031c111f90 con 0x7f031c10c2f0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f0322044640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f031c112290 con 0x7f031c1037a0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f031b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f031b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46792/0 (socket says 172.21.15.17:46792) 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f031b7fe640 1 -- 172.21.15.17:0/4129852579 learned_addr learned my addr 172.21.15.17:0/4129852579 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f031affd640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 0x7f031c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.239+0000 7f031bfff640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 -- 172.21.15.17:0/4129852579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 msgr2=0x7f031c198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 0x7f031c198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 -- 172.21.15.17:0/4129852579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 msgr2=0x7f031c19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c19cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 -- 172.21.15.17:0/4129852579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c19d5e0 con 0x7f031c102df0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031bfff640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f031b7fe640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f030c02ade0 tx=0x7f030c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c02fa20 con 0x7f031c102df0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c19d870 con 0x7f031c102df0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030c02fbc0 con 0x7f031c102df0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c0466e0 con 0x7f031c102df0 2024-09-10T11:40:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.240+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1a51b0 con 0x7f031c102df0 2024-09-10T11:40:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.241+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c1031d0 con 0x7f031c102df0 2024-09-10T11:40:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.242+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f030c046940 con 0x7f031c102df0 2024-09-10T11:40:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.243+0000 7f0318ff9640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 0x7f03040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.243+0000 7f031affd640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 0x7f03040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.243+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f030c0f0690 con 0x7f031c102df0 2024-09-10T11:40:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.244+0000 7f031affd640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 0x7f03040a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f031c10d7c0 tx=0x7f0310005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:59.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.247+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f030c0bd5b0 con 0x7f031c102df0 2024-09-10T11:40:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.450+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f031c062630 con 0x7f03040a2c10 2024-09-10T11:40:59.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.454+0000 7f0318ff9640 1 -- 172.21.15.17:0/4129852579 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f031c062630 con 0x7f03040a2c10 2024-09-10T11:40:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_1/d1de11f4-901c-44a0-9cec-ac13d8d115c4 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.456+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 msgr2=0x7f03040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.456+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 0x7f03040a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f031c10d7c0 tx=0x7f0310005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 msgr2=0x7f031c198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f030c02ade0 tx=0x7f030c0319f0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 shutdown_connections 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03040a2c10 0x7f03040a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f031c1037a0 0x7f031c198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f031c10c2f0 0x7f031c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 --2- 172.21.15.17:0/4129852579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f031c102df0 0x7f031c198630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 >> 172.21.15.17:0/4129852579 conn(0x7f031c0fc7d0 msgr2=0x7f031c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 shutdown_connections 2024-09-10T11:40:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:40:59.457+0000 7f0322044640 1 -- 172.21.15.17:0/4129852579 wait complete. 2024-09-10T11:41:00.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:41:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 -- 172.21.15.17:0/3172230830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c102790 msgr2=0x7fb75c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 --2- 172.21.15.17:0/3172230830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c102790 0x7fb75c1067e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb750009900 tx=0x7fb75002a410 comp rx=0 tx=0).stop 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 -- 172.21.15.17:0/3172230830 shutdown_connections 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 --2- 172.21.15.17:0/3172230830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c106f10 0x7fb75c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 --2- 172.21.15.17:0/3172230830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c102790 0x7fb75c1067e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 --2- 172.21.15.17:0/3172230830 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 0x7fb75c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 -- 172.21.15.17:0/3172230830 >> 172.21.15.17:0/3172230830 conn(0x7fb75c0fd8c0 msgr2=0x7fb75c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 -- 172.21.15.17:0/3172230830 shutdown_connections 2024-09-10T11:41:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.881+0000 7fb760d02640 1 -- 172.21.15.17:0/3172230830 wait complete. 2024-09-10T11:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 Processor -- start 2024-09-10T11:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 -- start start 2024-09-10T11:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 0x7fb75c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:00.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c102790 0x7fb75c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c112010 con 0x7fb75c106f10 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c111e90 con 0x7fb75c101de0 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb760d02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c112190 con 0x7fb75c102790 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb75ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb75a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 0x7fb75c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb75ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46800/0 (socket says 172.21.15.17:46800) 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.882+0000 7fb75ad9d640 1 -- 172.21.15.17:0/3963257843 learned_addr learned my addr 172.21.15.17:0/3963257843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb759d9b640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c102790 0x7fb75c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 -- 172.21.15.17:0/3963257843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c102790 msgr2=0x7fb75c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c102790 0x7fb75c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 -- 172.21.15.17:0/3963257843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 msgr2=0x7fb75c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 0x7fb75c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 -- 172.21.15.17:0/3963257843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c1a6a70 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb75ad9d640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb75400b970 tx=0x7fb75400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754019070 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb754014440 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75c1a6d60 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7540075d0 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.883+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75c1a7220 con 0x7fb75c106f10 2024-09-10T11:41:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.884+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb75c102240 con 0x7fb75c106f10 2024-09-10T11:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.885+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb75401c070 con 0x7fb75c106f10 2024-09-10T11:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.886+0000 7fb74b7fe640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 0x7fb7440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.886+0000 7fb75a59c640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 0x7fb7440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.886+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fb7540ce630 con 0x7fb75c106f10 2024-09-10T11:41:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.887+0000 7fb75a59c640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 0x7fb7440a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009990 tx=0x7fb74c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:00.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:00.890+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb75409af00 con 0x7fb75c106f10 2024-09-10T11:41:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.102+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb75c10a0f0 con 0x7fb75c106f10 2024-09-10T11:41:01.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.103+0000 7fb74b7fe640 1 -- 172.21.15.17:0/3963257843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7fb75409f200 con 0x7fb75c106f10 2024-09-10T11:41:01.104 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:01.104 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:41:01.104 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 msgr2=0x7fb7440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 0x7fb7440a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009990 tx=0x7fb74c009110 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 msgr2=0x7fb75c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb75400b970 tx=0x7fb75400bd70 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 shutdown_connections 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7440a2c10 0x7fb7440a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb75c102790 0x7fb75c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c106f10 0x7fb75c074f70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 --2- 172.21.15.17:0/3963257843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb75c101de0 0x7fb75c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 >> 172.21.15.17:0/3963257843 conn(0x7fb75c0fd8c0 msgr2=0x7fb75c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 shutdown_connections 2024-09-10T11:41:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:01.105+0000 7fb760d02640 1 -- 172.21.15.17:0/3963257843 wait complete. 2024-09-10T11:41:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:01 smithi081 ceph-mon[35059]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:01 smithi081 ceph-mon[35059]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:41:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:01 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3963257843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:01 smithi026 ceph-mon[34817]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:01 smithi026 ceph-mon[34817]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:41:01.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:01 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3963257843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:01 smithi017 ceph-mon[30817]: pgmap v289: 97 pgs: 97 active+clean; 610 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 27 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:01.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:01 smithi017 ceph-mon[30817]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:41:01.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:01 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3963257843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:01.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:41:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:02.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 -- 172.21.15.17:0/114765733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c100a80 msgr2=0x7f748c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 --2- 172.21.15.17:0/114765733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c100a80 0x7f748c100ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7480009930 tx=0x7f748002a420 comp rx=0 tx=0).stop 2024-09-10T11:41:02.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 -- 172.21.15.17:0/114765733 shutdown_connections 2024-09-10T11:41:02.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 --2- 172.21.15.17:0/114765733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c101420 0x7f748c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 --2- 172.21.15.17:0/114765733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c100a80 0x7f748c100ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 --2- 172.21.15.17:0/114765733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c106a80 0x7f748c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 -- 172.21.15.17:0/114765733 >> 172.21.15.17:0/114765733 conn(0x7f748c0fc7a0 msgr2=0x7f748c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 -- 172.21.15.17:0/114765733 shutdown_connections 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 -- 172.21.15.17:0/114765733 wait complete. 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.430+0000 7f74911bb640 1 Processor -- start 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 -- start start 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c100a80 0x7f748c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c101420 0x7f748c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f748c110e80 con 0x7f748c106a80 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f748c110d00 con 0x7f748c100a80 2024-09-10T11:41:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f74911bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f748c111000 con 0x7f748c101420 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43906/0 (socket says 172.21.15.17:43906) 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 -- 172.21.15.17:0/3946097774 learned_addr learned my addr 172.21.15.17:0/3946097774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748ad9d640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c100a80 0x7f748c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748a59c640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c101420 0x7f748c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 -- 172.21.15.17:0/3946097774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c101420 msgr2=0x7f748c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c101420 0x7f748c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 -- 172.21.15.17:0/3946097774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c100a80 msgr2=0x7f748c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c100a80 0x7f748c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.431+0000 7f748b59e640 1 -- 172.21.15.17:0/3946097774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1a48d0 con 0x7f748c106a80 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f748b59e640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f748400eaa0 tx=0x7f748400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748400cdb0 con 0x7f748c106a80 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7484005020 con 0x7f748c106a80 2024-09-10T11:41:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c1a4aa0 con 0x7f748c106a80 2024-09-10T11:41:02.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74840116b0 con 0x7f748c106a80 2024-09-10T11:41:02.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.432+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1a4f60 con 0x7f748c106a80 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.433+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748c100ee0 con 0x7f748c106a80 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.434+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7484005560 con 0x7f748c106a80 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.435+0000 7f7473fff640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 0x7f74740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.435+0000 7f748ad9d640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 0x7f74740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.435+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f74840cf360 con 0x7f748c106a80 2024-09-10T11:41:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.435+0000 7f748ad9d640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 0x7f74740a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f747c009b30 tx=0x7f747c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.439+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7484016030 con 0x7f748c106a80 2024-09-10T11:41:02.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.619+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f748c108a60 con 0x7f748c106a80 2024-09-10T11:41:02.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.621+0000 7f7473fff640 1 -- 172.21.15.17:0/3946097774 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7f748409bac0 con 0x7f748c106a80 2024-09-10T11:41:02.622 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:02.622 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:41:02.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 msgr2=0x7f74740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 0x7f74740a5150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f747c009b30 tx=0x7f747c005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 msgr2=0x7f748c1a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f748400eaa0 tx=0x7f748400ef60 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 shutdown_connections 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74740a2c90 0x7f74740a5150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c101420 0x7f748c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c106a80 0x7f748c1a4390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 --2- 172.21.15.17:0/3946097774 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f748c100a80 0x7f748c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.623+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 >> 172.21.15.17:0/3946097774 conn(0x7f748c0fc7a0 msgr2=0x7f748c0fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.624+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 shutdown_connections 2024-09-10T11:41:02.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:02.624+0000 7f74911bb640 1 -- 172.21.15.17:0/3946097774 wait complete. 2024-09-10T11:41:03.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:03 smithi081 ceph-mon[35059]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:03.548 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:03 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3946097774' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:03.549 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:03 smithi026 ceph-mon[34817]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:03.549 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:03 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3946097774' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:03.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:03 smithi017 ceph-mon[30817]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:03.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:03 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3946097774' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:03.551 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T11:41:03.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:41:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.262+0000 7f9004ceb640 1 -- 172.21.15.17:0/9434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000106a80 msgr2=0x7f9000106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.262+0000 7f9004ceb640 1 --2- 172.21.15.17:0/9434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000106a80 0x7f9000106e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009930 tx=0x7f8ff002a420 comp rx=0 tx=0).stop 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 -- 172.21.15.17:0/9434834 shutdown_connections 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 --2- 172.21.15.17:0/9434834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 0x7f9000100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 --2- 172.21.15.17:0/9434834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000101420 0x7f900010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 --2- 172.21.15.17:0/9434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000106a80 0x7f9000106e60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 -- 172.21.15.17:0/9434834 >> 172.21.15.17:0/9434834 conn(0x7f90000fc7a0 msgr2=0x7f90000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 -- 172.21.15.17:0/9434834 shutdown_connections 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 -- 172.21.15.17:0/9434834 wait complete. 2024-09-10T11:41:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 Processor -- start 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.263+0000 7f9004ceb640 1 -- start start 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 0x7f900010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000106a80 0x7f900010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9000111f60 con 0x7f9000101420 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9000111de0 con 0x7f9000106a80 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90001120e0 con 0x7f9000100a80 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43916/0 (socket says 172.21.15.17:43916) 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 -- 172.21.15.17:0/2113078295 learned_addr learned my addr 172.21.15.17:0/2113078295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffed9d640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000106a80 0x7f900010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffe59c640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 0x7f900010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 -- 172.21.15.17:0/2113078295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 msgr2=0x7f900010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 0x7f900010e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 -- 172.21.15.17:0/2113078295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000106a80 msgr2=0x7f900010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000106a80 0x7f900010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 -- 172.21.15.17:0/2113078295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001a68e0 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8ffdd9b640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c920 tx=0x7f8ff400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007c70 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ff4007e10 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001a6bd0 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4018890 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.264+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001a7110 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.266+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9000100ee0 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.267+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ff4018a70 con 0x7f9000101420 2024-09-10T11:41:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.267+0000 7f8fef7fe640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 0x7f8fe80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.268+0000 7f8ffe59c640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 0x7f8fe80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.268+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8ff40cf260 con 0x7f9000101420 2024-09-10T11:41:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.268+0000 7f8ffe59c640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 0x7f8fe80a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.272+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ff4014030 con 0x7f9000101420 2024-09-10T11:41:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.443+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9000109060 con 0x7f8fe80a2c10 2024-09-10T11:41:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.451+0000 7f8fef7fe640 1 -- 172.21.15.17:0/2113078295 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258758 (secure 0 0 0) 0x7f8ff0031730 con 0x7f8fe80a2c10 2024-09-10T11:41:04.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:41:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 msgr2=0x7f8fe80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 0x7f8fe80a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff00058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 msgr2=0x7f900010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:04.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c920 tx=0x7f8ff400cde0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 shutdown_connections 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fe80a2c10 0x7f8fe80a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9000106a80 0x7f900010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9000101420 0x7f900010e920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 --2- 172.21.15.17:0/2113078295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9000100a80 0x7f900010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 >> 172.21.15.17:0/2113078295 conn(0x7f90000fc7a0 msgr2=0x7f90000fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 shutdown_connections 2024-09-10T11:41:04.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:04.454+0000 7f9004ceb640 1 -- 172.21.15.17:0/2113078295 wait complete. 2024-09-10T11:41:05.189 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-10T11:41:03.413805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647413,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":267,"num_read_kb":243,"num_write":416,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391508,"kb_used_data":13112,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550316,"statfs":{"total":1151940427776,"available":1151539523584,"internally_reserved":0,"allocated":13426688,"data_stored":7359087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49240,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":36,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.870267"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550175+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:40:54.550175+0000","last_peered":"2024-09-10T11:40:54.550175+0000","last_clean":"2024-09-10T11:40:54.550175+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:40:54.550175+0000","last_undegraded":"2024-09-10T11:40:54.550175+0000","last_fullsized":"2024-09-10T11:40:54.550175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549686+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:40:54.549686+0000","last_peered":"2024-09-10T11:40:54.549686+0000","last_clean":"2024-09-10T11:40:54.549686+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:40:54.549686+0000","last_undegraded":"2024-09-10T11:40:54.549686+0000","last_fullsized":"2024-09-10T11:40:54.549686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549555+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:40:54.549555+0000","last_peered":"2024-09-10T11:40:54.549555+0000","last_clean":"2024-09-10T11:40:54.549555+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:40:54.549555+0000","last_undegraded":"2024-09-10T11:40:54.549555+0000","last_fullsized":"2024-09-10T11:40:54.549555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546920+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:40:54.546920+0000","last_peered":"2024-09-10T11:40:54.546920+0000","last_clean":"2024-09-10T11:40:54.546920+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:40:54.546920+0000","last_undegraded":"2024-09-10T11:40:54.546920+0000","last_fullsized":"2024-09-10T11:40:54.546920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549293+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:40:54.549293+0000","last_peered":"2024-09-10T11:40:54.549293+0000","last_clean":"2024-09-10T11:40:54.549293+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:40:54.549293+0000","last_undegraded":"2024-09-10T11:40:54.549293+0000","last_fullsized":"2024-09-10T11:40:54.549293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561390+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:40:54.561390+0000","last_peered":"2024-09-10T11:40:54.561390+0000","last_clean":"2024-09-10T11:40:54.561390+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:40:54.561390+0000","last_undegraded":"2024-09-10T11:40:54.561390+0000","last_fullsized":"2024-09-10T11:40:54.561390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558483+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:40:54.558483+0000","last_peered":"2024-09-10T11:40:54.558483+0000","last_clean":"2024-09-10T11:40:54.558483+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:40:54.558483+0000","last_undegraded":"2024-09-10T11:40:54.558483+0000","last_fullsized":"2024-09-10T11:40:54.558483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545752+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:40:54.545752+0000","last_peered":"2024-09-10T11:40:54.545752+0000","last_clean":"2024-09-10T11:40:54.545752+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:40:54.545752+0000","last_undegraded":"2024-09-10T11:40:54.545752+0000","last_fullsized":"2024-09-10T11:40:54.545752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550045+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:40:54.550045+0000","last_peered":"2024-09-10T11:40:54.550045+0000","last_clean":"2024-09-10T11:40:54.550045+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:40:54.550045+0000","last_undegraded":"2024-09-10T11:40:54.550045+0000","last_fullsized":"2024-09-10T11:40:54.550045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561787+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:40:54.561787+0000","last_peered":"2024-09-10T11:40:54.561787+0000","last_clean":"2024-09-10T11:40:54.561787+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:40:54.561787+0000","last_undegraded":"2024-09-10T11:40:54.561787+0000","last_fullsized":"2024-09-10T11:40:54.561787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558760+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:40:54.558760+0000","last_peered":"2024-09-10T11:40:54.558760+0000","last_clean":"2024-09-10T11:40:54.558760+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:40:54.558760+0000","last_undegraded":"2024-09-10T11:40:54.558760+0000","last_fullsized":"2024-09-10T11:40:54.558760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546930+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:40:54.546930+0000","last_peered":"2024-09-10T11:40:54.546930+0000","last_clean":"2024-09-10T11:40:54.546930+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:40:54.546930+0000","last_undegraded":"2024-09-10T11:40:54.546930+0000","last_fullsized":"2024-09-10T11:40:54.546930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548998+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:40:54.548998+0000","last_peered":"2024-09-10T11:40:54.548998+0000","last_clean":"2024-09-10T11:40:54.548998+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:40:54.548998+0000","last_undegraded":"2024-09-10T11:40:54.548998+0000","last_fullsized":"2024-09-10T11:40:54.548998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548369+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:40:54.548369+0000","last_peered":"2024-09-10T11:40:54.548369+0000","last_clean":"2024-09-10T11:40:54.548369+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:40:54.548369+0000","last_undegraded":"2024-09-10T11:40:54.548369+0000","last_fullsized":"2024-09-10T11:40:54.548369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549094+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:40:54.549094+0000","last_peered":"2024-09-10T11:40:54.549094+0000","last_clean":"2024-09-10T11:40:54.549094+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:40:54.549094+0000","last_undegraded":"2024-09-10T11:40:54.549094+0000","last_fullsized":"2024-09-10T11:40:54.549094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549375+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:40:54.549375+0000","last_peered":"2024-09-10T11:40:54.549375+0000","last_clean":"2024-09-10T11:40:54.549375+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:40:54.549375+0000","last_undegraded":"2024-09-10T11:40:54.549375+0000","last_fullsized":"2024-09-10T11:40:54.549375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550286+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:40:54.550286+0000","last_peered":"2024-09-10T11:40:54.550286+0000","last_clean":"2024-09-10T11:40:54.550286+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:40:54.550286+0000","last_undegraded":"2024-09-10T11:40:54.550286+0000","last_fullsized":"2024-09-10T11:40:54.550286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547974+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:40:54.547974+0000","last_peered":"2024-09-10T11:40:54.547974+0000","last_clean":"2024-09-10T11:40:54.547974+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:40:54.547974+0000","last_undegraded":"2024-09-10T11:40:54.547974+0000","last_fullsized":"2024-09-10T11:40:54.547974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548565+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:40:54.548565+0000","last_peered":"2024-09-10T11:40:54.548565+0000","last_clean":"2024-09-10T11:40:54.548565+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:40:54.548565+0000","last_undegraded":"2024-09-10T11:40:54.548565+0000","last_fullsized":"2024-09-10T11:40:54.548565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548540+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:40:54.548540+0000","last_peered":"2024-09-10T11:40:54.548540+0000","last_clean":"2024-09-10T11:40:54.548540+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:40:54.548540+0000","last_undegraded":"2024-09-10T11:40:54.548540+0000","last_fullsized":"2024-09-10T11:40:54.548540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549070+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:40:54.549070+0000","last_peered":"2024-09-10T11:40:54.549070+0000","last_clean":"2024-09-10T11:40:54.549070+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:40:54.549070+0000","last_undegraded":"2024-09-10T11:40:54.549070+0000","last_fullsized":"2024-09-10T11:40:54.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549519+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:40:54.549519+0000","last_peered":"2024-09-10T11:40:54.549519+0000","last_clean":"2024-09-10T11:40:54.549519+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:40:54.549519+0000","last_undegraded":"2024-09-10T11:40:54.549519+0000","last_fullsized":"2024-09-10T11:40:54.549519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545811+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:40:54.545811+0000","last_peered":"2024-09-10T11:40:54.545811+0000","last_clean":"2024-09-10T11:40:54.545811+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:40:54.545811+0000","last_undegraded":"2024-09-10T11:40:54.545811+0000","last_fullsized":"2024-09-10T11:40:54.545811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547441+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:40:54.547441+0000","last_peered":"2024-09-10T11:40:54.547441+0000","last_clean":"2024-09-10T11:40:54.547441+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:40:54.547441+0000","last_undegraded":"2024-09-10T11:40:54.547441+0000","last_fullsized":"2024-09-10T11:40:54.547441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546325+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:40:54.546325+0000","last_peered":"2024-09-10T11:40:54.546325+0000","last_clean":"2024-09-10T11:40:54.546325+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:40:54.546325+0000","last_undegraded":"2024-09-10T11:40:54.546325+0000","last_fullsized":"2024-09-10T11:40:54.546325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548943+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:40:54.548943+0000","last_peered":"2024-09-10T11:40:54.548943+0000","last_clean":"2024-09-10T11:40:54.548943+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:40:54.548943+0000","last_undegraded":"2024-09-10T11:40:54.548943+0000","last_fullsized":"2024-09-10T11:40:54.548943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549068+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:40:54.549068+0000","last_peered":"2024-09-10T11:40:54.549068+0000","last_clean":"2024-09-10T11:40:54.549068+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:40:54.549068+0000","last_undegraded":"2024-09-10T11:40:54.549068+0000","last_fullsized":"2024-09-10T11:40:54.549068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553544+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:40:54.553544+0000","last_peered":"2024-09-10T11:40:54.553544+0000","last_clean":"2024-09-10T11:40:54.553544+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:40:54.553544+0000","last_undegraded":"2024-09-10T11:40:54.553544+0000","last_fullsized":"2024-09-10T11:40:54.553544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559961+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:40:54.559961+0000","last_peered":"2024-09-10T11:40:54.559961+0000","last_clean":"2024-09-10T11:40:54.559961+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:40:54.559961+0000","last_undegraded":"2024-09-10T11:40:54.559961+0000","last_fullsized":"2024-09-10T11:40:54.559961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553618+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:40:54.553618+0000","last_peered":"2024-09-10T11:40:54.553618+0000","last_clean":"2024-09-10T11:40:54.553618+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:40:54.553618+0000","last_undegraded":"2024-09-10T11:40:54.553618+0000","last_fullsized":"2024-09-10T11:40:54.553618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548342+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:40:54.548342+0000","last_peered":"2024-09-10T11:40:54.548342+0000","last_clean":"2024-09-10T11:40:54.548342+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:40:54.548342+0000","last_undegraded":"2024-09-10T11:40:54.548342+0000","last_fullsized":"2024-09-10T11:40:54.548342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548335+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:40:54.548335+0000","last_peered":"2024-09-10T11:40:54.548335+0000","last_clean":"2024-09-10T11:40:54.548335+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:40:54.548335+0000","last_undegraded":"2024-09-10T11:40:54.548335+0000","last_fullsized":"2024-09-10T11:40:54.548335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.555100+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:40:54.555100+0000","last_peered":"2024-09-10T11:40:54.555100+0000","last_clean":"2024-09-10T11:40:54.555100+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:40:54.555100+0000","last_undegraded":"2024-09-10T11:40:54.555100+0000","last_fullsized":"2024-09-10T11:40:54.555100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.572209+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:41:01.572209+0000","last_peered":"2024-09-10T11:41:01.572209+0000","last_clean":"2024-09-10T11:41:01.572209+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:41:01.572209+0000","last_undegraded":"2024-09-10T11:41:01.572209+0000","last_fullsized":"2024-09-10T11:41:01.572209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547340+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:40:54.547340+0000","last_peered":"2024-09-10T11:40:54.547340+0000","last_clean":"2024-09-10T11:40:54.547340+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:40:54.547340+0000","last_undegraded":"2024-09-10T11:40:54.547340+0000","last_fullsized":"2024-09-10T11:40:54.547340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545822+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:40:54.545822+0000","last_peered":"2024-09-10T11:40:54.545822+0000","last_clean":"2024-09-10T11:40:54.545822+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:40:54.545822+0000","last_undegraded":"2024-09-10T11:40:54.545822+0000","last_fullsized":"2024-09-10T11:40:54.545822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547572+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:40:54.547572+0000","last_peered":"2024-09-10T11:40:54.547572+0000","last_clean":"2024-09-10T11:40:54.547572+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:40:54.547572+0000","last_undegraded":"2024-09-10T11:40:54.547572+0000","last_fullsized":"2024-09-10T11:40:54.547572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.570074+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:41:00.570074+0000","last_peered":"2024-09-10T11:41:00.570074+0000","last_clean":"2024-09-10T11:41:00.570074+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:41:00.570074+0000","last_undegraded":"2024-09-10T11:41:00.570074+0000","last_fullsized":"2024-09-10T11:41:00.570074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549910+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:40:54.549910+0000","last_peered":"2024-09-10T11:40:54.549910+0000","last_clean":"2024-09-10T11:40:54.549910+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:40:54.549910+0000","last_undegraded":"2024-09-10T11:40:54.549910+0000","last_fullsized":"2024-09-10T11:40:54.549910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549932+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:40:54.549932+0000","last_peered":"2024-09-10T11:40:54.549932+0000","last_clean":"2024-09-10T11:40:54.549932+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:40:54.549932+0000","last_undegraded":"2024-09-10T11:40:54.549932+0000","last_fullsized":"2024-09-10T11:40:54.549932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549629+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:40:54.549629+0000","last_peered":"2024-09-10T11:40:54.549629+0000","last_clean":"2024-09-10T11:40:54.549629+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:40:54.549629+0000","last_undegraded":"2024-09-10T11:40:54.549629+0000","last_fullsized":"2024-09-10T11:40:54.549629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.570935+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:41:00.570935+0000","last_peered":"2024-09-10T11:41:00.570935+0000","last_clean":"2024-09-10T11:41:00.570935+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:41:00.570935+0000","last_undegraded":"2024-09-10T11:41:00.570935+0000","last_fullsized":"2024-09-10T11:41:00.570935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550738+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:40:54.550738+0000","last_peered":"2024-09-10T11:40:54.550738+0000","last_clean":"2024-09-10T11:40:54.550738+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:40:54.550738+0000","last_undegraded":"2024-09-10T11:40:54.550738+0000","last_fullsized":"2024-09-10T11:40:54.550738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548714+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:40:54.548714+0000","last_peered":"2024-09-10T11:40:54.548714+0000","last_clean":"2024-09-10T11:40:54.548714+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:40:54.548714+0000","last_undegraded":"2024-09-10T11:40:54.548714+0000","last_fullsized":"2024-09-10T11:40:54.548714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558658+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:40:54.558658+0000","last_peered":"2024-09-10T11:40:54.558658+0000","last_clean":"2024-09-10T11:40:54.558658+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:40:54.558658+0000","last_undegraded":"2024-09-10T11:40:54.558658+0000","last_fullsized":"2024-09-10T11:40:54.558658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.565917+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:41:01.565917+0000","last_peered":"2024-09-10T11:41:01.565917+0000","last_clean":"2024-09-10T11:41:01.565917+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:41:01.565917+0000","last_undegraded":"2024-09-10T11:41:01.565917+0000","last_fullsized":"2024-09-10T11:41:01.565917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558371+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:40:54.558371+0000","last_peered":"2024-09-10T11:40:54.558371+0000","last_clean":"2024-09-10T11:40:54.558371+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:40:54.558371+0000","last_undegraded":"2024-09-10T11:40:54.558371+0000","last_fullsized":"2024-09-10T11:40:54.558371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.554828+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:40:54.554828+0000","last_peered":"2024-09-10T11:40:54.554828+0000","last_clean":"2024-09-10T11:40:54.554828+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:40:54.554828+0000","last_undegraded":"2024-09-10T11:40:54.554828+0000","last_fullsized":"2024-09-10T11:40:54.554828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558930+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:40:54.558930+0000","last_peered":"2024-09-10T11:40:54.558930+0000","last_clean":"2024-09-10T11:40:54.558930+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:40:54.558930+0000","last_undegraded":"2024-09-10T11:40:54.558930+0000","last_fullsized":"2024-09-10T11:40:54.558930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558885+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:40:54.558885+0000","last_peered":"2024-09-10T11:40:54.558885+0000","last_clean":"2024-09-10T11:40:54.558885+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:40:54.558885+0000","last_undegraded":"2024-09-10T11:40:54.558885+0000","last_fullsized":"2024-09-10T11:40:54.558885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:56.565010+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:40:56.565010+0000","last_peered":"2024-09-10T11:40:56.565010+0000","last_clean":"2024-09-10T11:40:56.565010+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:40:56.565010+0000","last_undegraded":"2024-09-10T11:40:56.565010+0000","last_fullsized":"2024-09-10T11:40:56.565010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558790+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:40:54.558790+0000","last_peered":"2024-09-10T11:40:54.558790+0000","last_clean":"2024-09-10T11:40:54.558790+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:40:54.558790+0000","last_undegraded":"2024-09-10T11:40:54.558790+0000","last_fullsized":"2024-09-10T11:40:54.558790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558543+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558543+0000","last_peered":"2024-09-10T11:40:54.558543+0000","last_clean":"2024-09-10T11:40:54.558543+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558543+0000","last_undegraded":"2024-09-10T11:40:54.558543+0000","last_fullsized":"2024-09-10T11:40:54.558543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546077+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:40:54.546077+0000","last_peered":"2024-09-10T11:40:54.546077+0000","last_clean":"2024-09-10T11:40:54.546077+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:40:54.546077+0000","last_undegraded":"2024-09-10T11:40:54.546077+0000","last_fullsized":"2024-09-10T11:40:54.546077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550138+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:40:54.550138+0000","last_peered":"2024-09-10T11:40:54.550138+0000","last_clean":"2024-09-10T11:40:54.550138+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:40:54.550138+0000","last_undegraded":"2024-09-10T11:40:54.550138+0000","last_fullsized":"2024-09-10T11:40:54.550138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.565416+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:41:01.565416+0000","last_peered":"2024-09-10T11:41:01.565416+0000","last_clean":"2024-09-10T11:41:01.565416+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:41:01.565416+0000","last_undegraded":"2024-09-10T11:41:01.565416+0000","last_fullsized":"2024-09-10T11:41:01.565416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.564664+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:41:00.564664+0000","last_peered":"2024-09-10T11:41:00.564664+0000","last_clean":"2024-09-10T11:41:00.564664+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:41:00.564664+0000","last_undegraded":"2024-09-10T11:41:00.564664+0000","last_fullsized":"2024-09-10T11:41:00.564664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561567+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:40:54.561567+0000","last_peered":"2024-09-10T11:40:54.561567+0000","last_clean":"2024-09-10T11:40:54.561567+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:40:54.561567+0000","last_undegraded":"2024-09-10T11:40:54.561567+0000","last_fullsized":"2024-09-10T11:40:54.561567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561648+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:40:54.561648+0000","last_peered":"2024-09-10T11:40:54.561648+0000","last_clean":"2024-09-10T11:40:54.561648+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:40:54.561648+0000","last_undegraded":"2024-09-10T11:40:54.561648+0000","last_fullsized":"2024-09-10T11:40:54.561648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549049+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:40:54.549049+0000","last_peered":"2024-09-10T11:40:54.549049+0000","last_clean":"2024-09-10T11:40:54.549049+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:40:54.549049+0000","last_undegraded":"2024-09-10T11:40:54.549049+0000","last_fullsized":"2024-09-10T11:40:54.549049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:58.496656+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:40:58.496656+0000","last_peered":"2024-09-10T11:40:58.496656+0000","last_clean":"2024-09-10T11:40:58.496656+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:40:58.496656+0000","last_undegraded":"2024-09-10T11:40:58.496656+0000","last_fullsized":"2024-09-10T11:40:58.496656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546358+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:40:54.546358+0000","last_peered":"2024-09-10T11:40:54.546358+0000","last_clean":"2024-09-10T11:40:54.546358+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:40:54.546358+0000","last_undegraded":"2024-09-10T11:40:54.546358+0000","last_fullsized":"2024-09-10T11:40:54.546358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549754+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:40:54.549754+0000","last_peered":"2024-09-10T11:40:54.549754+0000","last_clean":"2024-09-10T11:40:54.549754+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:40:54.549754+0000","last_undegraded":"2024-09-10T11:40:54.549754+0000","last_fullsized":"2024-09-10T11:40:54.549754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549394+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:40:54.549394+0000","last_peered":"2024-09-10T11:40:54.549394+0000","last_clean":"2024-09-10T11:40:54.549394+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:40:54.549394+0000","last_undegraded":"2024-09-10T11:40:54.549394+0000","last_fullsized":"2024-09-10T11:40:54.549394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548720+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:40:54.548720+0000","last_peered":"2024-09-10T11:40:54.548720+0000","last_clean":"2024-09-10T11:40:54.548720+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:40:54.548720+0000","last_undegraded":"2024-09-10T11:40:54.548720+0000","last_fullsized":"2024-09-10T11:40:54.548720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548418+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548418+0000","last_peered":"2024-09-10T11:40:54.548418+0000","last_clean":"2024-09-10T11:40:54.548418+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548418+0000","last_undegraded":"2024-09-10T11:40:54.548418+0000","last_fullsized":"2024-09-10T11:40:54.548418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546136+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:40:54.546136+0000","last_peered":"2024-09-10T11:40:54.546136+0000","last_clean":"2024-09-10T11:40:54.546136+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:40:54.546136+0000","last_undegraded":"2024-09-10T11:40:54.546136+0000","last_fullsized":"2024-09-10T11:40:54.546136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558570+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:40:54.558570+0000","last_peered":"2024-09-10T11:40:54.558570+0000","last_clean":"2024-09-10T11:40:54.558570+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:40:54.558570+0000","last_undegraded":"2024-09-10T11:40:54.558570+0000","last_fullsized":"2024-09-10T11:40:54.558570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547105+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:40:54.547105+0000","last_peered":"2024-09-10T11:40:54.547105+0000","last_clean":"2024-09-10T11:40:54.547105+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:40:54.547105+0000","last_undegraded":"2024-09-10T11:40:54.547105+0000","last_fullsized":"2024-09-10T11:40:54.547105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549522+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:40:54.549522+0000","last_peered":"2024-09-10T11:40:54.549522+0000","last_clean":"2024-09-10T11:40:54.549522+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:40:54.549522+0000","last_undegraded":"2024-09-10T11:40:54.549522+0000","last_fullsized":"2024-09-10T11:40:54.549522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549911+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:40:54.549911+0000","last_peered":"2024-09-10T11:40:54.549911+0000","last_clean":"2024-09-10T11:40:54.549911+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:40:54.549911+0000","last_undegraded":"2024-09-10T11:40:54.549911+0000","last_fullsized":"2024-09-10T11:40:54.549911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553494+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:40:54.553494+0000","last_peered":"2024-09-10T11:40:54.553494+0000","last_clean":"2024-09-10T11:40:54.553494+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:40:54.553494+0000","last_undegraded":"2024-09-10T11:40:54.553494+0000","last_fullsized":"2024-09-10T11:40:54.553494+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.563345+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:40:59.563345+0000","last_peered":"2024-09-10T11:40:59.563345+0000","last_clean":"2024-09-10T11:40:59.563345+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:40:59.563345+0000","last_undegraded":"2024-09-10T11:40:59.563345+0000","last_fullsized":"2024-09-10T11:40:59.563345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":233,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":153357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449104,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1626112,"data_stored":1095044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874267,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103200,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":454059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":453920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":495864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":496037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:41:05.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:41:05.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:05 smithi081 ceph-mon[35059]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:05 smithi026 ceph-mon[34817]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:05 smithi017 ceph-mon[30817]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 KiB/s wr, 14 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:05.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 -- 172.21.15.17:0/2077953898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 msgr2=0x7ffa5410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:05.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 --2- 172.21.15.17:0/2077953898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5410def0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009900 tx=0x7ffa3c02a480 comp rx=0 tx=0).stop 2024-09-10T11:41:05.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 -- 172.21.15.17:0/2077953898 shutdown_connections 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 --2- 172.21.15.17:0/2077953898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa5410e430 0x7ffa54110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 --2- 172.21.15.17:0/2077953898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5410def0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 --2- 172.21.15.17:0/2077953898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa540745c0 0x7ffa540749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 -- 172.21.15.17:0/2077953898 >> 172.21.15.17:0/2077953898 conn(0x7ffa540fd8f0 msgr2=0x7ffa540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 -- 172.21.15.17:0/2077953898 shutdown_connections 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 -- 172.21.15.17:0/2077953898 wait complete. 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.895+0000 7ffa595ca640 1 Processor -- start 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 -- start start 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540745c0 0x7ffa5419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:05.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa5410e430 0x7ffa5419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54114170 con 0x7ffa54074ee0 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54113ff0 con 0x7ffa540745c0 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa595ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa541142f0 con 0x7ffa5410e430 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43926/0 (socket says 172.21.15.17:43926) 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 -- 172.21.15.17:0/3684652245 learned_addr learned my addr 172.21.15.17:0/3684652245 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa537fe640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa5410e430 0x7ffa5419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa52ffd640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540745c0 0x7ffa5419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 -- 172.21.15.17:0/3684652245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa5410e430 msgr2=0x7ffa5419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa5410e430 0x7ffa5419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 -- 172.21.15.17:0/3684652245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540745c0 msgr2=0x7ffa5419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540745c0 0x7ffa5419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.896+0000 7ffa527fc640 1 -- 172.21.15.17:0/3684652245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5419f600 con 0x7ffa54074ee0 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa527fc640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006010 tx=0x7ffa3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c03f030 con 0x7ffa54074ee0 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa3c003ce0 con 0x7ffa54074ee0 2024-09-10T11:41:05.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5419f890 con 0x7ffa54074ee0 2024-09-10T11:41:05.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c035070 con 0x7ffa54074ee0 2024-09-10T11:41:05.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.897+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa541a71d0 con 0x7ffa54074ee0 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.898+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa540749a0 con 0x7ffa54074ee0 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.900+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa3c042030 con 0x7ffa54074ee0 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.900+0000 7ffa4bfff640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 0x7ffa400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.901+0000 7ffa52ffd640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 0x7ffa400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.901+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ffa3c0ef9e0 con 0x7ffa54074ee0 2024-09-10T11:41:05.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.901+0000 7ffa52ffd640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 0x7ffa400a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005fd0 tx=0x7ffa44009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:05.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:05.904+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa3c0bc850 con 0x7ffa54074ee0 2024-09-10T11:41:06.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.074+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa541095e0 con 0x7ffa400a2c10 2024-09-10T11:41:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.080+0000 7ffa4bfff640 1 -- 172.21.15.17:0/3684652245 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258759 (secure 0 0 0) 0x7ffa541095e0 con 0x7ffa400a2c10 2024-09-10T11:41:06.084 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:06.085 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 msgr2=0x7ffa400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 0x7ffa400a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005fd0 tx=0x7ffa44009500 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 msgr2=0x7ffa5419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006010 tx=0x7ffa3c0042f0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 shutdown_connections 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ffa400a2c10 0x7ffa400a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa5410e430 0x7ffa5419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa54074ee0 0x7ffa5419ab90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 --2- 172.21.15.17:0/3684652245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa540745c0 0x7ffa5419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 >> 172.21.15.17:0/3684652245 conn(0x7ffa540fd8f0 msgr2=0x7ffa540ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 shutdown_connections 2024-09-10T11:41:06.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:06.083+0000 7ffa595ca640 1 -- 172.21.15.17:0/3684652245 wait complete. 2024-09-10T11:41:06.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:06 smithi081 ceph-mon[35059]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:06.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:06 smithi026 ceph-mon[34817]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:06.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:06 smithi017 ceph-mon[30817]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:07.015 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-10T11:41:05.414300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647413,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":272,"num_read_kb":243,"num_write":416,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391524,"kb_used_data":13128,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550300,"statfs":{"total":1151940427776,"available":1151539507200,"internally_reserved":0,"allocated":13443072,"data_stored":7376163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48618,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":102,"num_write":30,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.869652"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550175+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:40:54.550175+0000","last_peered":"2024-09-10T11:40:54.550175+0000","last_clean":"2024-09-10T11:40:54.550175+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:40:54.550175+0000","last_undegraded":"2024-09-10T11:40:54.550175+0000","last_fullsized":"2024-09-10T11:40:54.550175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549686+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:40:54.549686+0000","last_peered":"2024-09-10T11:40:54.549686+0000","last_clean":"2024-09-10T11:40:54.549686+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:40:54.549686+0000","last_undegraded":"2024-09-10T11:40:54.549686+0000","last_fullsized":"2024-09-10T11:40:54.549686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549555+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:40:54.549555+0000","last_peered":"2024-09-10T11:40:54.549555+0000","last_clean":"2024-09-10T11:40:54.549555+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:40:54.549555+0000","last_undegraded":"2024-09-10T11:40:54.549555+0000","last_fullsized":"2024-09-10T11:40:54.549555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546920+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:40:54.546920+0000","last_peered":"2024-09-10T11:40:54.546920+0000","last_clean":"2024-09-10T11:40:54.546920+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:40:54.546920+0000","last_undegraded":"2024-09-10T11:40:54.546920+0000","last_fullsized":"2024-09-10T11:40:54.546920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549293+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:40:54.549293+0000","last_peered":"2024-09-10T11:40:54.549293+0000","last_clean":"2024-09-10T11:40:54.549293+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:40:54.549293+0000","last_undegraded":"2024-09-10T11:40:54.549293+0000","last_fullsized":"2024-09-10T11:40:54.549293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561390+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:40:54.561390+0000","last_peered":"2024-09-10T11:40:54.561390+0000","last_clean":"2024-09-10T11:40:54.561390+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:40:54.561390+0000","last_undegraded":"2024-09-10T11:40:54.561390+0000","last_fullsized":"2024-09-10T11:40:54.561390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558483+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:40:54.558483+0000","last_peered":"2024-09-10T11:40:54.558483+0000","last_clean":"2024-09-10T11:40:54.558483+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:40:54.558483+0000","last_undegraded":"2024-09-10T11:40:54.558483+0000","last_fullsized":"2024-09-10T11:40:54.558483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545752+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:40:54.545752+0000","last_peered":"2024-09-10T11:40:54.545752+0000","last_clean":"2024-09-10T11:40:54.545752+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:40:54.545752+0000","last_undegraded":"2024-09-10T11:40:54.545752+0000","last_fullsized":"2024-09-10T11:40:54.545752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550045+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:40:54.550045+0000","last_peered":"2024-09-10T11:40:54.550045+0000","last_clean":"2024-09-10T11:40:54.550045+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:40:54.550045+0000","last_undegraded":"2024-09-10T11:40:54.550045+0000","last_fullsized":"2024-09-10T11:40:54.550045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561787+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:40:54.561787+0000","last_peered":"2024-09-10T11:40:54.561787+0000","last_clean":"2024-09-10T11:40:54.561787+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:40:54.561787+0000","last_undegraded":"2024-09-10T11:40:54.561787+0000","last_fullsized":"2024-09-10T11:40:54.561787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558760+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:40:54.558760+0000","last_peered":"2024-09-10T11:40:54.558760+0000","last_clean":"2024-09-10T11:40:54.558760+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:40:54.558760+0000","last_undegraded":"2024-09-10T11:40:54.558760+0000","last_fullsized":"2024-09-10T11:40:54.558760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546930+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:40:54.546930+0000","last_peered":"2024-09-10T11:40:54.546930+0000","last_clean":"2024-09-10T11:40:54.546930+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:40:54.546930+0000","last_undegraded":"2024-09-10T11:40:54.546930+0000","last_fullsized":"2024-09-10T11:40:54.546930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548998+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:40:54.548998+0000","last_peered":"2024-09-10T11:40:54.548998+0000","last_clean":"2024-09-10T11:40:54.548998+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:40:54.548998+0000","last_undegraded":"2024-09-10T11:40:54.548998+0000","last_fullsized":"2024-09-10T11:40:54.548998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548369+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:40:54.548369+0000","last_peered":"2024-09-10T11:40:54.548369+0000","last_clean":"2024-09-10T11:40:54.548369+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:40:54.548369+0000","last_undegraded":"2024-09-10T11:40:54.548369+0000","last_fullsized":"2024-09-10T11:40:54.548369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549094+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:40:54.549094+0000","last_peered":"2024-09-10T11:40:54.549094+0000","last_clean":"2024-09-10T11:40:54.549094+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:40:54.549094+0000","last_undegraded":"2024-09-10T11:40:54.549094+0000","last_fullsized":"2024-09-10T11:40:54.549094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549375+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:40:54.549375+0000","last_peered":"2024-09-10T11:40:54.549375+0000","last_clean":"2024-09-10T11:40:54.549375+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:40:54.549375+0000","last_undegraded":"2024-09-10T11:40:54.549375+0000","last_fullsized":"2024-09-10T11:40:54.549375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550286+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:40:54.550286+0000","last_peered":"2024-09-10T11:40:54.550286+0000","last_clean":"2024-09-10T11:40:54.550286+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:40:54.550286+0000","last_undegraded":"2024-09-10T11:40:54.550286+0000","last_fullsized":"2024-09-10T11:40:54.550286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547974+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:40:54.547974+0000","last_peered":"2024-09-10T11:40:54.547974+0000","last_clean":"2024-09-10T11:40:54.547974+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:40:54.547974+0000","last_undegraded":"2024-09-10T11:40:54.547974+0000","last_fullsized":"2024-09-10T11:40:54.547974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548565+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:40:54.548565+0000","last_peered":"2024-09-10T11:40:54.548565+0000","last_clean":"2024-09-10T11:40:54.548565+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:40:54.548565+0000","last_undegraded":"2024-09-10T11:40:54.548565+0000","last_fullsized":"2024-09-10T11:40:54.548565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548540+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:40:54.548540+0000","last_peered":"2024-09-10T11:40:54.548540+0000","last_clean":"2024-09-10T11:40:54.548540+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:40:54.548540+0000","last_undegraded":"2024-09-10T11:40:54.548540+0000","last_fullsized":"2024-09-10T11:40:54.548540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549070+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:40:54.549070+0000","last_peered":"2024-09-10T11:40:54.549070+0000","last_clean":"2024-09-10T11:40:54.549070+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:40:54.549070+0000","last_undegraded":"2024-09-10T11:40:54.549070+0000","last_fullsized":"2024-09-10T11:40:54.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549519+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:40:54.549519+0000","last_peered":"2024-09-10T11:40:54.549519+0000","last_clean":"2024-09-10T11:40:54.549519+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:40:54.549519+0000","last_undegraded":"2024-09-10T11:40:54.549519+0000","last_fullsized":"2024-09-10T11:40:54.549519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545811+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:40:54.545811+0000","last_peered":"2024-09-10T11:40:54.545811+0000","last_clean":"2024-09-10T11:40:54.545811+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:40:54.545811+0000","last_undegraded":"2024-09-10T11:40:54.545811+0000","last_fullsized":"2024-09-10T11:40:54.545811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547441+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:40:54.547441+0000","last_peered":"2024-09-10T11:40:54.547441+0000","last_clean":"2024-09-10T11:40:54.547441+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:40:54.547441+0000","last_undegraded":"2024-09-10T11:40:54.547441+0000","last_fullsized":"2024-09-10T11:40:54.547441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546325+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:40:54.546325+0000","last_peered":"2024-09-10T11:40:54.546325+0000","last_clean":"2024-09-10T11:40:54.546325+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:40:54.546325+0000","last_undegraded":"2024-09-10T11:40:54.546325+0000","last_fullsized":"2024-09-10T11:40:54.546325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548943+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:40:54.548943+0000","last_peered":"2024-09-10T11:40:54.548943+0000","last_clean":"2024-09-10T11:40:54.548943+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:40:54.548943+0000","last_undegraded":"2024-09-10T11:40:54.548943+0000","last_fullsized":"2024-09-10T11:40:54.548943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549068+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:40:54.549068+0000","last_peered":"2024-09-10T11:40:54.549068+0000","last_clean":"2024-09-10T11:40:54.549068+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:40:54.549068+0000","last_undegraded":"2024-09-10T11:40:54.549068+0000","last_fullsized":"2024-09-10T11:40:54.549068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553544+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:40:54.553544+0000","last_peered":"2024-09-10T11:40:54.553544+0000","last_clean":"2024-09-10T11:40:54.553544+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:40:54.553544+0000","last_undegraded":"2024-09-10T11:40:54.553544+0000","last_fullsized":"2024-09-10T11:40:54.553544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559961+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:40:54.559961+0000","last_peered":"2024-09-10T11:40:54.559961+0000","last_clean":"2024-09-10T11:40:54.559961+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:40:54.559961+0000","last_undegraded":"2024-09-10T11:40:54.559961+0000","last_fullsized":"2024-09-10T11:40:54.559961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553618+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:40:54.553618+0000","last_peered":"2024-09-10T11:40:54.553618+0000","last_clean":"2024-09-10T11:40:54.553618+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:40:54.553618+0000","last_undegraded":"2024-09-10T11:40:54.553618+0000","last_fullsized":"2024-09-10T11:40:54.553618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548342+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:40:54.548342+0000","last_peered":"2024-09-10T11:40:54.548342+0000","last_clean":"2024-09-10T11:40:54.548342+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:40:54.548342+0000","last_undegraded":"2024-09-10T11:40:54.548342+0000","last_fullsized":"2024-09-10T11:40:54.548342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548335+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:40:54.548335+0000","last_peered":"2024-09-10T11:40:54.548335+0000","last_clean":"2024-09-10T11:40:54.548335+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:40:54.548335+0000","last_undegraded":"2024-09-10T11:40:54.548335+0000","last_fullsized":"2024-09-10T11:40:54.548335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.555100+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:40:54.555100+0000","last_peered":"2024-09-10T11:40:54.555100+0000","last_clean":"2024-09-10T11:40:54.555100+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:40:54.555100+0000","last_undegraded":"2024-09-10T11:40:54.555100+0000","last_fullsized":"2024-09-10T11:40:54.555100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.572209+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:41:01.572209+0000","last_peered":"2024-09-10T11:41:01.572209+0000","last_clean":"2024-09-10T11:41:01.572209+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:41:01.572209+0000","last_undegraded":"2024-09-10T11:41:01.572209+0000","last_fullsized":"2024-09-10T11:41:01.572209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547340+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:40:54.547340+0000","last_peered":"2024-09-10T11:40:54.547340+0000","last_clean":"2024-09-10T11:40:54.547340+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:40:54.547340+0000","last_undegraded":"2024-09-10T11:40:54.547340+0000","last_fullsized":"2024-09-10T11:40:54.547340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545822+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:40:54.545822+0000","last_peered":"2024-09-10T11:40:54.545822+0000","last_clean":"2024-09-10T11:40:54.545822+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:40:54.545822+0000","last_undegraded":"2024-09-10T11:40:54.545822+0000","last_fullsized":"2024-09-10T11:40:54.545822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547572+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:40:54.547572+0000","last_peered":"2024-09-10T11:40:54.547572+0000","last_clean":"2024-09-10T11:40:54.547572+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:40:54.547572+0000","last_undegraded":"2024-09-10T11:40:54.547572+0000","last_fullsized":"2024-09-10T11:40:54.547572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.570074+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:41:00.570074+0000","last_peered":"2024-09-10T11:41:00.570074+0000","last_clean":"2024-09-10T11:41:00.570074+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:41:00.570074+0000","last_undegraded":"2024-09-10T11:41:00.570074+0000","last_fullsized":"2024-09-10T11:41:00.570074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549910+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:40:54.549910+0000","last_peered":"2024-09-10T11:40:54.549910+0000","last_clean":"2024-09-10T11:40:54.549910+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:40:54.549910+0000","last_undegraded":"2024-09-10T11:40:54.549910+0000","last_fullsized":"2024-09-10T11:40:54.549910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549932+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:40:54.549932+0000","last_peered":"2024-09-10T11:40:54.549932+0000","last_clean":"2024-09-10T11:40:54.549932+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:40:54.549932+0000","last_undegraded":"2024-09-10T11:40:54.549932+0000","last_fullsized":"2024-09-10T11:40:54.549932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549629+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:40:54.549629+0000","last_peered":"2024-09-10T11:40:54.549629+0000","last_clean":"2024-09-10T11:40:54.549629+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:40:54.549629+0000","last_undegraded":"2024-09-10T11:40:54.549629+0000","last_fullsized":"2024-09-10T11:40:54.549629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.570935+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:41:00.570935+0000","last_peered":"2024-09-10T11:41:00.570935+0000","last_clean":"2024-09-10T11:41:00.570935+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:41:00.570935+0000","last_undegraded":"2024-09-10T11:41:00.570935+0000","last_fullsized":"2024-09-10T11:41:00.570935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550738+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:40:54.550738+0000","last_peered":"2024-09-10T11:40:54.550738+0000","last_clean":"2024-09-10T11:40:54.550738+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:40:54.550738+0000","last_undegraded":"2024-09-10T11:40:54.550738+0000","last_fullsized":"2024-09-10T11:40:54.550738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548714+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:40:54.548714+0000","last_peered":"2024-09-10T11:40:54.548714+0000","last_clean":"2024-09-10T11:40:54.548714+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:40:54.548714+0000","last_undegraded":"2024-09-10T11:40:54.548714+0000","last_fullsized":"2024-09-10T11:40:54.548714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558658+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:40:54.558658+0000","last_peered":"2024-09-10T11:40:54.558658+0000","last_clean":"2024-09-10T11:40:54.558658+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:40:54.558658+0000","last_undegraded":"2024-09-10T11:40:54.558658+0000","last_fullsized":"2024-09-10T11:40:54.558658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.565917+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:41:01.565917+0000","last_peered":"2024-09-10T11:41:01.565917+0000","last_clean":"2024-09-10T11:41:01.565917+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:41:01.565917+0000","last_undegraded":"2024-09-10T11:41:01.565917+0000","last_fullsized":"2024-09-10T11:41:01.565917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558371+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:40:54.558371+0000","last_peered":"2024-09-10T11:40:54.558371+0000","last_clean":"2024-09-10T11:40:54.558371+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:40:54.558371+0000","last_undegraded":"2024-09-10T11:40:54.558371+0000","last_fullsized":"2024-09-10T11:40:54.558371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.554828+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:40:54.554828+0000","last_peered":"2024-09-10T11:40:54.554828+0000","last_clean":"2024-09-10T11:40:54.554828+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:40:54.554828+0000","last_undegraded":"2024-09-10T11:40:54.554828+0000","last_fullsized":"2024-09-10T11:40:54.554828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558930+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:40:54.558930+0000","last_peered":"2024-09-10T11:40:54.558930+0000","last_clean":"2024-09-10T11:40:54.558930+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:40:54.558930+0000","last_undegraded":"2024-09-10T11:40:54.558930+0000","last_fullsized":"2024-09-10T11:40:54.558930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558885+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:40:54.558885+0000","last_peered":"2024-09-10T11:40:54.558885+0000","last_clean":"2024-09-10T11:40:54.558885+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:40:54.558885+0000","last_undegraded":"2024-09-10T11:40:54.558885+0000","last_fullsized":"2024-09-10T11:40:54.558885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.572022+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:41:01.572022+0000","last_peered":"2024-09-10T11:41:01.572022+0000","last_clean":"2024-09-10T11:41:01.572022+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:41:01.572022+0000","last_undegraded":"2024-09-10T11:41:01.572022+0000","last_fullsized":"2024-09-10T11:41:01.572022+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558790+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:40:54.558790+0000","last_peered":"2024-09-10T11:40:54.558790+0000","last_clean":"2024-09-10T11:40:54.558790+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:40:54.558790+0000","last_undegraded":"2024-09-10T11:40:54.558790+0000","last_fullsized":"2024-09-10T11:40:54.558790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558543+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558543+0000","last_peered":"2024-09-10T11:40:54.558543+0000","last_clean":"2024-09-10T11:40:54.558543+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558543+0000","last_undegraded":"2024-09-10T11:40:54.558543+0000","last_fullsized":"2024-09-10T11:40:54.558543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546077+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:40:54.546077+0000","last_peered":"2024-09-10T11:40:54.546077+0000","last_clean":"2024-09-10T11:40:54.546077+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:40:54.546077+0000","last_undegraded":"2024-09-10T11:40:54.546077+0000","last_fullsized":"2024-09-10T11:40:54.546077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550138+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:40:54.550138+0000","last_peered":"2024-09-10T11:40:54.550138+0000","last_clean":"2024-09-10T11:40:54.550138+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:40:54.550138+0000","last_undegraded":"2024-09-10T11:40:54.550138+0000","last_fullsized":"2024-09-10T11:40:54.550138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:01.565416+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:41:01.565416+0000","last_peered":"2024-09-10T11:41:01.565416+0000","last_clean":"2024-09-10T11:41:01.565416+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:41:01.565416+0000","last_undegraded":"2024-09-10T11:41:01.565416+0000","last_fullsized":"2024-09-10T11:41:01.565416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'6","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:00.564664+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:41:00.564664+0000","last_peered":"2024-09-10T11:41:00.564664+0000","last_clean":"2024-09-10T11:41:00.564664+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:41:00.564664+0000","last_undegraded":"2024-09-10T11:41:00.564664+0000","last_fullsized":"2024-09-10T11:41:00.564664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561567+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:40:54.561567+0000","last_peered":"2024-09-10T11:40:54.561567+0000","last_clean":"2024-09-10T11:40:54.561567+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:40:54.561567+0000","last_undegraded":"2024-09-10T11:40:54.561567+0000","last_fullsized":"2024-09-10T11:40:54.561567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561648+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:40:54.561648+0000","last_peered":"2024-09-10T11:40:54.561648+0000","last_clean":"2024-09-10T11:40:54.561648+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:40:54.561648+0000","last_undegraded":"2024-09-10T11:40:54.561648+0000","last_fullsized":"2024-09-10T11:40:54.561648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549049+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:40:54.549049+0000","last_peered":"2024-09-10T11:40:54.549049+0000","last_clean":"2024-09-10T11:40:54.549049+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:40:54.549049+0000","last_undegraded":"2024-09-10T11:40:54.549049+0000","last_fullsized":"2024-09-10T11:40:54.549049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:58.496656+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:40:58.496656+0000","last_peered":"2024-09-10T11:40:58.496656+0000","last_clean":"2024-09-10T11:40:58.496656+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:40:58.496656+0000","last_undegraded":"2024-09-10T11:40:58.496656+0000","last_fullsized":"2024-09-10T11:40:58.496656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546358+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:40:54.546358+0000","last_peered":"2024-09-10T11:40:54.546358+0000","last_clean":"2024-09-10T11:40:54.546358+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:40:54.546358+0000","last_undegraded":"2024-09-10T11:40:54.546358+0000","last_fullsized":"2024-09-10T11:40:54.546358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549754+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:40:54.549754+0000","last_peered":"2024-09-10T11:40:54.549754+0000","last_clean":"2024-09-10T11:40:54.549754+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:40:54.549754+0000","last_undegraded":"2024-09-10T11:40:54.549754+0000","last_fullsized":"2024-09-10T11:40:54.549754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549394+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:40:54.549394+0000","last_peered":"2024-09-10T11:40:54.549394+0000","last_clean":"2024-09-10T11:40:54.549394+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:40:54.549394+0000","last_undegraded":"2024-09-10T11:40:54.549394+0000","last_fullsized":"2024-09-10T11:40:54.549394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548720+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:40:54.548720+0000","last_peered":"2024-09-10T11:40:54.548720+0000","last_clean":"2024-09-10T11:40:54.548720+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:40:54.548720+0000","last_undegraded":"2024-09-10T11:40:54.548720+0000","last_fullsized":"2024-09-10T11:40:54.548720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548418+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548418+0000","last_peered":"2024-09-10T11:40:54.548418+0000","last_clean":"2024-09-10T11:40:54.548418+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548418+0000","last_undegraded":"2024-09-10T11:40:54.548418+0000","last_fullsized":"2024-09-10T11:40:54.548418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546136+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:40:54.546136+0000","last_peered":"2024-09-10T11:40:54.546136+0000","last_clean":"2024-09-10T11:40:54.546136+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:40:54.546136+0000","last_undegraded":"2024-09-10T11:40:54.546136+0000","last_fullsized":"2024-09-10T11:40:54.546136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558570+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:40:54.558570+0000","last_peered":"2024-09-10T11:40:54.558570+0000","last_clean":"2024-09-10T11:40:54.558570+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:40:54.558570+0000","last_undegraded":"2024-09-10T11:40:54.558570+0000","last_fullsized":"2024-09-10T11:40:54.558570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547105+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:40:54.547105+0000","last_peered":"2024-09-10T11:40:54.547105+0000","last_clean":"2024-09-10T11:40:54.547105+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:40:54.547105+0000","last_undegraded":"2024-09-10T11:40:54.547105+0000","last_fullsized":"2024-09-10T11:40:54.547105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549522+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:40:54.549522+0000","last_peered":"2024-09-10T11:40:54.549522+0000","last_clean":"2024-09-10T11:40:54.549522+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:40:54.549522+0000","last_undegraded":"2024-09-10T11:40:54.549522+0000","last_fullsized":"2024-09-10T11:40:54.549522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549911+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:40:54.549911+0000","last_peered":"2024-09-10T11:40:54.549911+0000","last_clean":"2024-09-10T11:40:54.549911+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:40:54.549911+0000","last_undegraded":"2024-09-10T11:40:54.549911+0000","last_fullsized":"2024-09-10T11:40:54.549911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553494+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:40:54.553494+0000","last_peered":"2024-09-10T11:40:54.553494+0000","last_clean":"2024-09-10T11:40:54.553494+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:40:54.553494+0000","last_undegraded":"2024-09-10T11:40:54.553494+0000","last_fullsized":"2024-09-10T11:40:54.553494+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.563345+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:40:59.563345+0000","last_peered":"2024-09-10T11:40:59.563345+0000","last_clean":"2024-09-10T11:40:59.563345+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:40:59.563345+0000","last_undegraded":"2024-09-10T11:40:59.563345+0000","last_fullsized":"2024-09-10T11:40:59.563345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":146,"num_read_kb":134,"num_write":233,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":170433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449104,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678036,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1626112,"data_stored":1095044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874267,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103200,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":454059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":453920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":504402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":504575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:41:07.019 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T11:41:07.019 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T11:41:07.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T11:41:07.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:07 smithi017 ceph-mon[30817]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:07.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:07 smithi017 ceph-mon[30817]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:07.277 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:07 smithi081 ceph-mon[35059]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:07 smithi081 ceph-mon[35059]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:07 smithi026 ceph-mon[34817]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T11:41:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:07 smithi026 ceph-mon[34817]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:07.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 -- 172.21.15.17:0/438440440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 msgr2=0x7f93e4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:07.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 --2- 172.21.15.17:0/438440440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4100ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009900 tx=0x7f93e002a410 comp rx=0 tx=0).stop 2024-09-10T11:41:07.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 -- 172.21.15.17:0/438440440 shutdown_connections 2024-09-10T11:41:07.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 --2- 172.21.15.17:0/438440440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 0x7f93e4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 --2- 172.21.15.17:0/438440440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 0x7f93e4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 --2- 172.21.15.17:0/438440440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4100ed0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.810+0000 7f93ec31d640 1 -- 172.21.15.17:0/438440440 >> 172.21.15.17:0/438440440 conn(0x7f93e40fc280 msgr2=0x7f93e40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- 172.21.15.17:0/438440440 shutdown_connections 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- 172.21.15.17:0/438440440 wait complete. 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 Processor -- start 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- start start 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 0x7f93e41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 0x7f93e419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410d8c0 con 0x7f93e4100ad0 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410d740 con 0x7f93e4101cd0 2024-09-10T11:41:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.811+0000 7f93ec31d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410da40 con 0x7f93e4102690 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43952/0 (socket says 172.21.15.17:43952) 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 -- 172.21.15.17:0/753890511 learned_addr learned my addr 172.21.15.17:0/753890511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93e98b8640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 0x7f93e41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea8ba640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 0x7f93e419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 -- 172.21.15.17:0/753890511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 msgr2=0x7f93e419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 0x7f93e419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 -- 172.21.15.17:0/753890511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 msgr2=0x7f93e41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 0x7f93e41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 -- 172.21.15.17:0/753890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e419fba0 con 0x7f93e4100ad0 2024-09-10T11:41:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ea0b9640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93e0031610 tx=0x7f93e00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e003f030 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e0003ce0 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e419fe30 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0035070 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.812+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e41a0300 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.813+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4107f20 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.815+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93e0042030 con 0x7f93e4100ad0 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.815+0000 7f93db7fe640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 0x7f93d00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:07.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.815+0000 7f93e98b8640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 0x7f93d00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:07.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.815+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f93e00ef7a0 con 0x7f93e4100ad0 2024-09-10T11:41:07.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.816+0000 7f93e98b8640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 0x7f93d00a5180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93e4199490 tx=0x7f93d400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:07.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:07.819+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93e00bc5b0 con 0x7f93e4100ad0 2024-09-10T11:41:08.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.063+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f93e402d7c0 con 0x7f93e4100ad0 2024-09-10T11:41:08.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.066+0000 7f93db7fe640 1 -- 172.21.15.17:0/753890511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f93e00bbeb0 con 0x7f93e4100ad0 2024-09-10T11:41:08.067 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T11:41:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBUMOBmyNTfAxAAlOCCdaRbrSUiM+OOIjOkCg== 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 msgr2=0x7f93d00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 0x7f93d00a5180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93e4199490 tx=0x7f93d400a2d0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 msgr2=0x7f93e4197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f93e0031610 tx=0x7f93e00043b0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 shutdown_connections 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f93d00a2cc0 0x7f93d00a5180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4102690 0x7f93e419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93e4101cd0 0x7f93e41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 --2- 172.21.15.17:0/753890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4100ad0 0x7f93e4197f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 >> 172.21.15.17:0/753890511 conn(0x7f93e40fc280 msgr2=0x7f93e41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 shutdown_connections 2024-09-10T11:41:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:08.068+0000 7f93ec31d640 1 -- 172.21.15.17:0/753890511 wait complete. 2024-09-10T11:41:08.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:08 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:41:08.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:08 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:41:08.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:08 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:41:08.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:08 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:41:08.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:08 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T11:41:08.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:08 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/753890511' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T11:41:08.863 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:41:08.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T11:41:08.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T11:41:08.901 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T11:41:08.902 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T11:41:08.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T11:41:09.195 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:09.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:09 smithi081 ceph-mon[35059]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T11:41:09.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:09 smithi017 ceph-mon[30817]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T11:41:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:09 smithi026 ceph-mon[34817]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 -- 172.21.15.17:0/214648185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90101de0 msgr2=0x7f3e901021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 --2- 172.21.15.17:0/214648185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90101de0 0x7f3e901021c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009900 tx=0x7f3e8c02a410 comp rx=0 tx=0).stop 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 -- 172.21.15.17:0/214648185 shutdown_connections 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 --2- 172.21.15.17:0/214648185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90102790 0x7f3e901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 --2- 172.21.15.17:0/214648185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 --2- 172.21.15.17:0/214648185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90101de0 0x7f3e901021c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 -- 172.21.15.17:0/214648185 >> 172.21.15.17:0/214648185 conn(0x7f3e900fd8c0 msgr2=0x7f3e900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 -- 172.21.15.17:0/214648185 shutdown_connections 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.710+0000 7f3e98673640 1 -- 172.21.15.17:0/214648185 wait complete. 2024-09-10T11:41:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 Processor -- start 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 -- start start 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 0x7f3e90198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90111f30 con 0x7f3e90102790 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90111db0 con 0x7f3e90106f10 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e98673640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901120b0 con 0x7f3e90101de0 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e95c0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e95c0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43970/0 (socket says 172.21.15.17:43970) 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e95c0e640 1 -- 172.21.15.17:0/970388095 learned_addr learned my addr 172.21.15.17:0/970388095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e9640f640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 0x7f3e90198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e96c10640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e95c0e640 1 -- 172.21.15.17:0/970388095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 msgr2=0x7f3e90198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.711+0000 7f3e95c0e640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 0x7f3e90198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e95c0e640 1 -- 172.21.15.17:0/970388095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 msgr2=0x7f3e9019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e95c0e640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e95c0e640 1 -- 172.21.15.17:0/970388095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9019d4c0 con 0x7f3e90102790 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e9640f640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 0x7f3e90198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e96c10640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:09.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e95c0e640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d950 tx=0x7f3e8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80017070 con 0x7f3e90102790 2024-09-10T11:41:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9019d7b0 con 0x7f3e90102790 2024-09-10T11:41:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e80009c30 con 0x7f3e90102790 2024-09-10T11:41:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8000f6b0 con 0x7f3e90102790 2024-09-10T11:41:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.712+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901a5090 con 0x7f3e90102790 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.713+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e901021c0 con 0x7f3e90102790 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.714+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e800109d0 con 0x7f3e90102790 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.715+0000 7f3e877fe640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 0x7f3e7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.715+0000 7f3e9640f640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 0x7f3e7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.715+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3e800cee90 con 0x7f3e90102790 2024-09-10T11:41:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.716+0000 7f3e9640f640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 0x7f3e7c0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005ab0 tx=0x7f3e8c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.718+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e80009de0 con 0x7f3e90102790 2024-09-10T11:41:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.945+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3e9010a0f0 con 0x7f3e90102790 2024-09-10T11:41:09.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.950+0000 7f3e877fe640 1 -- 172.21.15.17:0/970388095 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263199 (secure 0 0 0) 0x7f3e8009bca0 con 0x7f3e90102790 2024-09-10T11:41:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 msgr2=0x7f3e7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 0x7f3e7c0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005ab0 tx=0x7f3e8c005a20 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 msgr2=0x7f3e90198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d950 tx=0x7f3e8000de10 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 shutdown_connections 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3e7c0a2c10 0x7f3e7c0a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e90106f10 0x7f3e9019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e90102790 0x7f3e90198a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 --2- 172.21.15.17:0/970388095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e90101de0 0x7f3e90198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 >> 172.21.15.17:0/970388095 conn(0x7f3e900fd8c0 msgr2=0x7f3e900fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 shutdown_connections 2024-09-10T11:41:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:09.953+0000 7f3e98673640 1 -- 172.21.15.17:0/970388095 wait complete. 2024-09-10T11:41:10.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:10 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/970388095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:41:10.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:10 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/970388095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:41:10.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:10 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/970388095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T11:41:10.535 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3008774641},{"type":"v1","addr":"172.21.15.17:6801","nonce":3008774641}]},"active_addr":"172.21.15.17:6801/3008774641","active_change":"2024-09-10T11:33:53.328345+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3851758063}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":738548507}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3487151896}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3148704408}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":792274910}]}]} 2024-09-10T11:41:10.541 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T11:41:10.541 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T11:41:10.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:41:10.798 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:11.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 -- 172.21.15.17:0/2602449798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc102790 msgr2=0x7fa8dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 --2- 172.21.15.17:0/2602449798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc102790 0x7fa8dc1067e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009900 tx=0x7fa8cc02a410 comp rx=0 tx=0).stop 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 -- 172.21.15.17:0/2602449798 shutdown_connections 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 --2- 172.21.15.17:0/2602449798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc106f10 0x7fa8dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 --2- 172.21.15.17:0/2602449798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc102790 0x7fa8dc1067e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 --2- 172.21.15.17:0/2602449798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc101de0 0x7fa8dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 -- 172.21.15.17:0/2602449798 >> 172.21.15.17:0/2602449798 conn(0x7fa8dc0fd8c0 msgr2=0x7fa8dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 -- 172.21.15.17:0/2602449798 shutdown_connections 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.276+0000 7fa8e3536640 1 -- 172.21.15.17:0/2602449798 wait complete. 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 Processor -- start 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 -- start start 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 0x7fa8dc198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 0x7fa8dc19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111f90 con 0x7fa8dc101de0 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111e10 con 0x7fa8dc106f10 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e3536640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc112110 con 0x7fa8dc102790 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43992/0 (socket says 172.21.15.17:43992) 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 -- 172.21.15.17:0/1771570681 learned_addr learned my addr 172.21.15.17:0/1771570681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e1ad3640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 0x7fa8dc19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e0ad1640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 0x7fa8dc198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 -- 172.21.15.17:0/1771570681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 msgr2=0x7fa8dc198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 0x7fa8dc198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 -- 172.21.15.17:0/1771570681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 msgr2=0x7fa8dc19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 0x7fa8dc19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.277+0000 7fa8e12d2640 1 -- 172.21.15.17:0/1771570681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc19d520 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8e1ad3640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 0x7fa8dc19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8e0ad1640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 0x7fa8dc198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8e12d2640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d950 tx=0x7fa8d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8017070 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc19d810 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d8009c30 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800f6b0 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.278+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a50f0 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.279+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc1021c0 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.280+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa8d80109d0 con 0x7fa8dc101de0 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.281+0000 7fa8d27fc640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 0x7fa8c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:11.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.281+0000 7fa8e0ad1640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 0x7fa8c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:11.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.281+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa8d80cef00 con 0x7fa8dc101de0 2024-09-10T11:41:11.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.281+0000 7fa8e0ad1640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 0x7fa8c80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc000c00 tx=0x7fa8cc032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:11.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.285+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8d8009de0 con 0x7fa8dc101de0 2024-09-10T11:41:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:11 smithi081 ceph-mon[35059]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T11:41:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.460+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8dc10a150 con 0x7fa8dc101de0 2024-09-10T11:41:11.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:11 smithi017 ceph-mon[30817]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T11:41:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.462+0000 7fa8d27fc640 1 -- 172.21.15.17:0/1771570681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7fa8d809bd10 con 0x7fa8dc101de0 2024-09-10T11:41:11.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:11.464 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:41:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 msgr2=0x7fa8c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 0x7fa8c80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc000c00 tx=0x7fa8cc032c70 comp rx=0 tx=0).stop 2024-09-10T11:41:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 msgr2=0x7fa8dc198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d950 tx=0x7fa8d800de10 comp rx=0 tx=0).stop 2024-09-10T11:41:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 shutdown_connections 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8c80a2c10 0x7fa8c80a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc102790 0x7fa8dc198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8dc106f10 0x7fa8dc19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 --2- 172.21.15.17:0/1771570681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8dc101de0 0x7fa8dc198570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 >> 172.21.15.17:0/1771570681 conn(0x7fa8dc0fd8c0 msgr2=0x7fa8dc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 shutdown_connections 2024-09-10T11:41:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:11.465+0000 7fa8e3536640 1 -- 172.21.15.17:0/1771570681 wait complete. 2024-09-10T11:41:11.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:11 smithi026 ceph-mon[34817]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T11:41:12.130 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T11:41:12.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:41:12.389 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:12 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1771570681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:12.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:12 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1771570681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:12.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:12 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1771570681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:12.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 -- 172.21.15.17:0/3555742225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8106a80 msgr2=0x7f52b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/3555742225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8106a80 0x7f52b8106e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009930 tx=0x7f52b402a420 comp rx=0 tx=0).stop 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 -- 172.21.15.17:0/3555742225 shutdown_connections 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/3555742225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8100a80 0x7f52b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/3555742225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8101420 0x7f52b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/3555742225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8106a80 0x7f52b8106e60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 -- 172.21.15.17:0/3555742225 >> 172.21.15.17:0/3555742225 conn(0x7f52b80fc7a0 msgr2=0x7f52b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 -- 172.21.15.17:0/3555742225 shutdown_connections 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.857+0000 7f52bf8dc640 1 -- 172.21.15.17:0/3555742225 wait complete. 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 Processor -- start 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 -- start start 2024-09-10T11:41:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8100a80 0x7f52b8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 0x7f52b819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8111fa0 con 0x7f52b8101420 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8111e20 con 0x7f52b8100a80 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bf8dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8112120 con 0x7f52b8106a80 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bce77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bce77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50306/0 (socket says 172.21.15.17:50306) 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bce77640 1 -- 172.21.15.17:0/589209551 learned_addr learned my addr 172.21.15.17:0/589209551 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.858+0000 7f52bd678640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8100a80 0x7f52b8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bde79640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 0x7f52b819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 -- 172.21.15.17:0/589209551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 msgr2=0x7f52b819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 0x7f52b819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 -- 172.21.15.17:0/589209551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8100a80 msgr2=0x7f52b8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8100a80 0x7f52b8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 -- 172.21.15.17:0/589209551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b819d4b0 con 0x7f52b8101420 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bde79640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 0x7f52b819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bce77640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52a800b4a0 tx=0x7f52a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8014070 con 0x7f52b8101420 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a8010af0 con 0x7f52b8101420 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b819d7a0 con 0x7f52b8101420 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8017d10 con 0x7f52b8101420 2024-09-10T11:41:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.859+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b81a5080 con 0x7f52b8101420 2024-09-10T11:41:12.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.860+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b8100ee0 con 0x7f52b8101420 2024-09-10T11:41:12.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.862+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f52a8017070 con 0x7f52b8101420 2024-09-10T11:41:12.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.862+0000 7f52ae7fc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 0x7f52a40a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:12.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.862+0000 7f52bd678640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 0x7f52a40a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.862+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f52a80ce770 con 0x7f52b8101420 2024-09-10T11:41:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.863+0000 7f52bd678640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 0x7f52a40a5220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:12.866+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52a809b710 con 0x7f52b8101420 2024-09-10T11:41:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.041+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52b8199860 con 0x7f52b8101420 2024-09-10T11:41:13.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.042+0000 7f52ae7fc640 1 -- 172.21.15.17:0/589209551 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7f52b8199860 con 0x7f52b8101420 2024-09-10T11:41:13.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:13.044 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 msgr2=0x7f52a40a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 0x7f52a40a5220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b40058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 msgr2=0x7f52b8198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52a800b4a0 tx=0x7f52a800b960 comp rx=0 tx=0).stop 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 shutdown_connections 2024-09-10T11:41:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f52a40a2d60 0x7f52a40a5220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52b8106a80 0x7f52b819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52b8101420 0x7f52b8198a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 --2- 172.21.15.17:0/589209551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52b8100a80 0x7f52b8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 >> 172.21.15.17:0/589209551 conn(0x7f52b80fc7a0 msgr2=0x7f52b80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 shutdown_connections 2024-09-10T11:41:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:13.045+0000 7f52bf8dc640 1 -- 172.21.15.17:0/589209551 wait complete. 2024-09-10T11:41:13.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:13 smithi017 ceph-mon[30817]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-10T11:41:13.431 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:13 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/589209551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:13 smithi026 ceph-mon[34817]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-10T11:41:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:13 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/589209551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:13 smithi081 ceph-mon[35059]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-09-10T11:41:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:13 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/589209551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:13.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T11:41:13.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T11:41:13.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T11:41:13.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T11:41:13.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T11:41:13.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T11:41:13.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T11:41:13.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T11:41:13.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T11:41:13.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T11:41:13.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T11:41:13.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T11:41:14.465 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:14.471 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:14.596 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:14.632 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:15.432 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:15 smithi017 ceph-mon[30817]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:41:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:15 smithi026 ceph-mon[34817]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:41:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:15 smithi081 ceph-mon[35059]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 -- 172.21.15.17:0/3527826587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c101420 msgr2=0x7f533c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3527826587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c101420 0x7f533c10d950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cd0 tx=0x7f533402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 -- 172.21.15.17:0/3527826587 shutdown_connections 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3527826587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c101420 0x7f533c10d950 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3527826587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c100a80 0x7f533c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3527826587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c106a80 0x7f533c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 -- 172.21.15.17:0/3527826587 >> 172.21.15.17:0/3527826587 conn(0x7f533c0fc7a0 msgr2=0x7f533c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 -- 172.21.15.17:0/3527826587 shutdown_connections 2024-09-10T11:41:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.823+0000 7f5343f7f640 1 -- 172.21.15.17:0/3527826587 wait complete. 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 Processor -- start 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 -- start start 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 0x7f533c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c101420 0x7f533c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c106a80 0x7f533c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f533c110f70 con 0x7f533c100a80 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f533c110df0 con 0x7f533c106a80 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5343f7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1110f0 con 0x7f533c101420 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 0x7f533c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 0x7f533c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50316/0 (socket says 172.21.15.17:50316) 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 -- 172.21.15.17:0/3356632389 learned_addr learned my addr 172.21.15.17:0/3356632389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f534151a640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c101420 0x7f533c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f534251c640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c106a80 0x7f533c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 -- 172.21.15.17:0/3356632389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c101420 msgr2=0x7f533c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c101420 0x7f533c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 -- 172.21.15.17:0/3356632389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c106a80 msgr2=0x7f533c1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c106a80 0x7f533c1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f5341d1b640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c1a4990 con 0x7f533c100a80 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f534151a640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f533c101420 0x7f533c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.824+0000 7f534251c640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f533c106a80 0x7f533c1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5341d1b640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 0x7f533c1993d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f533800b4a0 tx=0x7f533800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:15.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338014070 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5338010af0 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1a4b60 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338017d10 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.825+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c1a5070 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.826+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f533c0628c0 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.827+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5338017070 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f5332ffd640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53280a2c10 0x7f53280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f534151a640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53280a2c10 0x7f53280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f53380ce8c0 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f5332ffd640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] conn(0x7f53280ac7c0 0x7f53280aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f533800dec0 con 0x7f53280ac7c0 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f53380ced10 con 0x7f533c100a80 2024-09-10T11:41:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f534251c640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] conn(0x7f53280ac7c0 0x7f53280aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.828+0000 7f534151a640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53280a2c10 0x7f53280a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f533c06b2e0 tx=0x7f532c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.829+0000 7f534251c640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] conn(0x7f53280ac7c0 0x7f53280aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.829+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== osd.6 v2:172.21.15.17:6818/3749111347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f533800dec0 con 0x7f53280ac7c0 2024-09-10T11:41:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 --> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f533c062d40 con 0x7f53280ac7c0 2024-09-10T11:41:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5332ffd640 1 -- 172.21.15.17:0/3356632389 <== osd.6 v2:172.21.15.17:6818/3749111347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f533c062d40 con 0x7f53280ac7c0 2024-09-10T11:41:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] conn(0x7f53280ac7c0 msgr2=0x7f53280aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] conn(0x7f53280ac7c0 0x7f53280aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53280a2c10 msgr2=0x7f53280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53280a2c10 0x7f53280a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f533c06b2e0 tx=0x7f532c008040 comp rx=0 tx=0).stop 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 msgr2=0x7f533c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 --2- 172.21.15.17:0/3356632389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f533c100a80 0x7f533c1993d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f533800b4a0 tx=0x7f533800b960 comp rx=0 tx=0).stop 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f534251c640 1 -- 172.21.15.17:0/3356632389 reap_dead start 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 shutdown_connections 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.844+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 >> 172.21.15.17:0/3356632389 conn(0x7f533c0fc7a0 msgr2=0x7f533c0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.845+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 shutdown_connections 2024-09-10T11:41:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:15.845+0000 7f5343f7f640 1 -- 172.21.15.17:0/3356632389 wait complete. 2024-09-10T11:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 -- 172.21.15.17:0/2108378339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184102790 msgr2=0x7ff1841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 --2- 172.21.15.17:0/2108378339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184102790 0x7ff1841067e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009900 tx=0x7ff16c02a410 comp rx=0 tx=0).stop 2024-09-10T11:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 -- 172.21.15.17:0/2108378339 shutdown_connections 2024-09-10T11:41:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 --2- 172.21.15.17:0/2108378339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184106f10 0x7ff18410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 --2- 172.21.15.17:0/2108378339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184102790 0x7ff1841067e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 --2- 172.21.15.17:0/2108378339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184101de0 0x7ff1841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.032+0000 7ff189aba640 1 -- 172.21.15.17:0/2108378339 >> 172.21.15.17:0/2108378339 conn(0x7ff1840fd8c0 msgr2=0x7ff1840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 -- 172.21.15.17:0/2108378339 shutdown_connections 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 -- 172.21.15.17:0/2108378339 wait complete. 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 Processor -- start 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 -- start start 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101de0 0x7ff18419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184102790 0x7ff18419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 0x7ff18419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.033+0000 7ff189aba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff184111f70 con 0x7ff184106f10 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff189aba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff184111df0 con 0x7ff184102790 2024-09-10T11:41:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff189aba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841120f0 con 0x7ff184101de0 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 0x7ff18419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 0x7ff18419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50334/0 (socket says 172.21.15.17:50334) 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 -- 172.21.15.17:0/2778377548 learned_addr learned my addr 172.21.15.17:0/2778377548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff1837fe640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101de0 0x7ff18419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184102790 0x7ff18419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 -- 172.21.15.17:0/2778377548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101de0 msgr2=0x7ff18419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff184101de0 0x7ff18419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 -- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184102790 msgr2=0x7ff18419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184102790 0x7ff18419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18419f640 con 0x7ff184106f10 2024-09-10T11:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff184102790 0x7ff18419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff183fff640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 0x7ff18419ef60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c970 tx=0x7ff17c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007bb0 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff17c007d50 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18419f930 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c018800 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.034+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1841a7210 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.035+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff18410e130 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.036+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff17c00fa50 con 0x7ff184106f10 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.037+0000 7ff180ff9640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1700a2c10 0x7ff1700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.037+0000 7ff1837fe640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1700a2c10 0x7ff1700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.037+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff17c0cf5f0 con 0x7ff184106f10 2024-09-10T11:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.038+0000 7ff180ff9640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] conn(0x7ff1700ac7c0 0x7ff1700aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.038+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff17c00eec0 con 0x7ff1700ac7c0 2024-09-10T11:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.038+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7ff17c0cfa40 con 0x7ff184106f10 2024-09-10T11:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.038+0000 7ff1837fe640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1700a2c10 0x7ff1700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff174005fd0 tx=0x7ff174009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.038+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] conn(0x7ff1700ac7c0 0x7ff1700aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.039+0000 7ff182ffd640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] conn(0x7ff1700ac7c0 0x7ff1700aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.039+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== osd.1 v2:172.21.15.26:6800/3714938498 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff17c00eec0 con 0x7ff1700ac7c0 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.053+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 --> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1841032c0 con 0x7ff1700ac7c0 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff180ff9640 1 -- 172.21.15.17:0/2778377548 <== osd.1 v2:172.21.15.26:6800/3714938498 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1841032c0 con 0x7ff1700ac7c0 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] conn(0x7ff1700ac7c0 msgr2=0x7ff1700aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] conn(0x7ff1700ac7c0 0x7ff1700aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1700a2c10 msgr2=0x7ff1700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1700a2c10 0x7ff1700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff174005fd0 tx=0x7ff174009500 comp rx=0 tx=0).stop 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 msgr2=0x7ff18419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 --2- 172.21.15.17:0/2778377548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184106f10 0x7ff18419ef60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c970 tx=0x7ff17c00ce30 comp rx=0 tx=0).stop 2024-09-10T11:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff183fff640 1 -- 172.21.15.17:0/2778377548 reap_dead start 2024-09-10T11:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 shutdown_connections 2024-09-10T11:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 >> 172.21.15.17:0/2778377548 conn(0x7ff1840fd8c0 msgr2=0x7ff1840feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 shutdown_connections 2024-09-10T11:41:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:16.054+0000 7ff189aba640 1 -- 172.21.15.17:0/2778377548 wait complete. 2024-09-10T11:41:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:55834574918 2024-09-10T11:41:16.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T11:41:17.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.167+0000 7f83d94d4640 1 -- 172.21.15.17:0/3430770969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d41027a0 msgr2=0x7f83d41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.167+0000 7f83d94d4640 1 --2- 172.21.15.17:0/3430770969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d41027a0 0x7f83d41067f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009ca0 tx=0x7f83c802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 -- 172.21.15.17:0/3430770969 shutdown_connections 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 --2- 172.21.15.17:0/3430770969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83d4106f20 0x7f83d410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 --2- 172.21.15.17:0/3430770969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d41027a0 0x7f83d41067f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 --2- 172.21.15.17:0/3430770969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d4101df0 0x7f83d41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 -- 172.21.15.17:0/3430770969 >> 172.21.15.17:0/3430770969 conn(0x7f83d40fd8f0 msgr2=0x7f83d40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 -- 172.21.15.17:0/3430770969 shutdown_connections 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 -- 172.21.15.17:0/3430770969 wait complete. 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 Processor -- start 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.168+0000 7f83d94d4640 1 -- start start 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d4101df0 0x7f83d41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83d41027a0 0x7f83d41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 0x7f83d419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4111fa0 con 0x7f83d4106f20 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4111e20 con 0x7f83d41027a0 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d94d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4112120 con 0x7f83d4101df0 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 0x7f83d419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 0x7f83d419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50352/0 (socket says 172.21.15.17:50352) 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 -- 172.21.15.17:0/2355688219 learned_addr learned my addr 172.21.15.17:0/2355688219 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d27fc640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83d41027a0 0x7f83d41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d2ffd640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d4101df0 0x7f83d41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 -- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d4101df0 msgr2=0x7f83d41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d4101df0 0x7f83d41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 -- 172.21.15.17:0/2355688219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83d41027a0 msgr2=0x7f83d41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83d41027a0 0x7f83d41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d419d450 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83d37fe640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 0x7f83d419cd70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c970 tx=0x7f83cc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.169+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc007bb0 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.170+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83cc007d50 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.170+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d419d740 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.170+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc018770 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.170+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d41a5020 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.171+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83d4062980 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.172+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f83cc00f450 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83bbfff640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f83bc0a2c10 0x7f83bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83d2ffd640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f83bc0a2c10 0x7f83bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f83cc0cf3f0 con 0x7f83d4106f20 2024-09-10T11:41:17.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83bbfff640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] conn(0x7f83bc0ac7c0 0x7f83bc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83cc012ec0 con 0x7f83bc0ac7c0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f83cc0cf7a0 con 0x7f83d4106f20 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83d2ffd640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f83bc0a2c10 0x7f83bc0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009990 tx=0x7f83c4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.173+0000 7f83d27fc640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] conn(0x7f83bc0ac7c0 0x7f83bc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.174+0000 7f83d27fc640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] conn(0x7f83bc0ac7c0 0x7f83bc0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.175+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== osd.11 v2:172.21.15.81:6824/2880107876 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83cc012ec0 con 0x7f83bc0ac7c0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.188+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 --> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83d4062e00 con 0x7f83bc0ac7c0 2024-09-10T11:41:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.189+0000 7f83bbfff640 1 -- 172.21.15.17:0/2355688219 <== osd.11 v2:172.21.15.81:6824/2880107876 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f83d4062e00 con 0x7f83bc0ac7c0 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] conn(0x7f83bc0ac7c0 msgr2=0x7f83bc0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] conn(0x7f83bc0ac7c0 0x7f83bc0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f83bc0a2c10 msgr2=0x7f83bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f83bc0a2c10 0x7f83bc0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009990 tx=0x7f83c4009110 comp rx=0 tx=0).stop 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 msgr2=0x7f83d419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 --2- 172.21.15.17:0/2355688219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d4106f20 0x7f83d419cd70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c970 tx=0x7f83cc00cd70 comp rx=0 tx=0).stop 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d37fe640 1 -- 172.21.15.17:0/2355688219 reap_dead start 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 shutdown_connections 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 >> 172.21.15.17:0/2355688219 conn(0x7f83d40fd8f0 msgr2=0x7f83d40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 shutdown_connections 2024-09-10T11:41:17.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.190+0000 7f83d94d4640 1 -- 172.21.15.17:0/2355688219 wait complete. 2024-09-10T11:41:17.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:17 smithi017 ceph-mon[30817]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-10T11:41:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:17 smithi026 ceph-mon[34817]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- 172.21.15.17:0/1419852785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 msgr2=0x7faf74101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 --2- 172.21.15.17:0/1419852785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf74101200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf64009900 tx=0x7faf6402a480 comp rx=0 tx=0).stop 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- 172.21.15.17:0/1419852785 shutdown_connections 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 --2- 172.21.15.17:0/1419852785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf74102ef0 0x7faf7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 --2- 172.21.15.17:0/1419852785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102570 0x7faf741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 --2- 172.21.15.17:0/1419852785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf74101200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- 172.21.15.17:0/1419852785 >> 172.21.15.17:0/1419852785 conn(0x7faf740fc7d0 msgr2=0x7faf740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- 172.21.15.17:0/1419852785 shutdown_connections 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- 172.21.15.17:0/1419852785 wait complete. 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 Processor -- start 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.554+0000 7faf795a0640 1 -- start start 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf7419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf74102570 0x7faf7419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102ef0 0x7faf7419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf74110f80 con 0x7faf74100e20 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faf74110e00 con 0x7faf74102ef0 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf795a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf74111100 con 0x7faf74102570 2024-09-10T11:41:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf7419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf7419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50360/0 (socket says 172.21.15.17:50360) 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 -- 172.21.15.17:0/3319598065 learned_addr learned my addr 172.21.15.17:0/3319598065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf727fc640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf74102570 0x7faf7419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf737fe640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102ef0 0x7faf7419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 -- 172.21.15.17:0/3319598065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf74102570 msgr2=0x7faf7419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf74102570 0x7faf7419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 -- 172.21.15.17:0/3319598065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102ef0 msgr2=0x7faf7419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102ef0 0x7faf7419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7419f700 con 0x7faf74100e20 2024-09-10T11:41:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf737fe640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf74102ef0 0x7faf7419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf72ffd640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf7419a750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf64006010 tx=0x7faf64003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.555+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6403f070 con 0x7faf74100e20 2024-09-10T11:41:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.556+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7419f990 con 0x7faf74100e20 2024-09-10T11:41:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.556+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf741a72d0 con 0x7faf74100e20 2024-09-10T11:41:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.556+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf6403b940 con 0x7faf74100e20 2024-09-10T11:41:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.556+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64049060 con 0x7faf74100e20 2024-09-10T11:41:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.556+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf60001030 con 0x7faf74100e20 2024-09-10T11:41:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.558+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faf64042070 con 0x7faf74100e20 2024-09-10T11:41:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.558+0000 7faf5bfff640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faf5c0a2c90 0x7faf5c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf727fc640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faf5c0a2c90 0x7faf5c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7faf640ef8c0 con 0x7faf74100e20 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf5bfff640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] conn(0x7faf5c0ac840 0x7faf5c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf5c0af3b0 con 0x7faf5c0ac840 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7faf640efd10 con 0x7faf74100e20 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf737fe640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] conn(0x7faf5c0ac840 0x7faf5c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf727fc640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faf5c0a2c90 0x7faf5c0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf7410de80 tx=0x7faf68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.559+0000 7faf737fe640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] conn(0x7faf5c0ac840 0x7faf5c0aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.560+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== osd.3 v2:172.21.15.17:6810/3673598588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf5c0af3b0 con 0x7faf5c0ac840 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.573+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 --> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf60002dd0 con 0x7faf5c0ac840 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf5bfff640 1 -- 172.21.15.17:0/3319598065 <== osd.3 v2:172.21.15.17:6810/3673598588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf60002dd0 con 0x7faf5c0ac840 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] conn(0x7faf5c0ac840 msgr2=0x7faf5c0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] conn(0x7faf5c0ac840 0x7faf5c0aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faf5c0a2c90 msgr2=0x7faf5c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7faf5c0a2c90 0x7faf5c0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf7410de80 tx=0x7faf68005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 msgr2=0x7faf7419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 --2- 172.21.15.17:0/3319598065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf74100e20 0x7faf7419a750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf64006010 tx=0x7faf64003c10 comp rx=0 tx=0).stop 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf737fe640 1 -- 172.21.15.17:0/3319598065 reap_dead start 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 shutdown_connections 2024-09-10T11:41:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 >> 172.21.15.17:0/3319598065 conn(0x7faf740fc7d0 msgr2=0x7faf74069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:17.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 shutdown_connections 2024-09-10T11:41:17.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:17.574+0000 7faf795a0640 1 -- 172.21.15.17:0/3319598065 wait complete. 2024-09-10T11:41:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:17 smithi081 ceph-mon[35059]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-10T11:41:18.203 INFO:teuthology.orchestra.run.smithi017.stdout:107374182460 2024-09-10T11:41:18.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T11:41:18.806 INFO:teuthology.orchestra.run.smithi017.stdout:197568495660 2024-09-10T11:41:18.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T11:41:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 -- 172.21.15.17:0/2195286254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0102790 msgr2=0x7fe9b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/2195286254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0102790 0x7fe9b01067e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009900 tx=0x7fe9a002a410 comp rx=0 tx=0).stop 2024-09-10T11:41:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 -- 172.21.15.17:0/2195286254 shutdown_connections 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/2195286254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9b0106f10 0x7fe9b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/2195286254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0102790 0x7fe9b01067e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/2195286254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0101de0 0x7fe9b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 -- 172.21.15.17:0/2195286254 >> 172.21.15.17:0/2195286254 conn(0x7fe9b00fd8c0 msgr2=0x7fe9b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 -- 172.21.15.17:0/2195286254 shutdown_connections 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.161+0000 7fe9b85e8640 1 -- 172.21.15.17:0/2195286254 wait complete. 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 Processor -- start 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 -- start start 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 0x7fe9b0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0102790 0x7fe9b01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9b0106f10 0x7fe9b019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0111f90 con 0x7fe9b0101de0 2024-09-10T11:41:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b6384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 0x7fe9b0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0111e10 con 0x7fe9b0106f10 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b85e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0112110 con 0x7fe9b0102790 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b6384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 0x7fe9b0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50380/0 (socket says 172.21.15.17:50380) 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b6384640 1 -- 172.21.15.17:0/1732922993 learned_addr learned my addr 172.21.15.17:0/1732922993 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b6b85640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9b0106f10 0x7fe9b019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.162+0000 7fe9b5b83640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0102790 0x7fe9b01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 -- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0102790 msgr2=0x7fe9b01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0102790 0x7fe9b01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 -- 172.21.15.17:0/1732922993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9b0106f10 msgr2=0x7fe9b019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9b0106f10 0x7fe9b019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b019d420 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b6384640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 0x7fe9b0198470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00d950 tx=0x7fe9ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac017030 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9ac004020 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b019d710 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0047a0 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.163+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b01a4ff0 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.164+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9b0062980 con 0x7fe9b0101de0 2024-09-10T11:41:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.165+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe9ac0041d0 con 0x7fe9b0101de0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9a77fe640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe99c0a2c10 0x7fe99c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fe9ac0cf1c0 con 0x7fe9b0101de0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9b5b83640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe99c0a2c10 0x7fe99c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9a77fe640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] conn(0x7fe99c0ac7c0 0x7fe99c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe99c0af330 con 0x7fe99c0ac7c0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.166+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe9ac0cf610 con 0x7fe9b0101de0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.167+0000 7fe9b5b83640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe99c0a2c10 0x7fe99c0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009230 tx=0x7fe9a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.167+0000 7fe9b6b85640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] conn(0x7fe99c0ac7c0 0x7fe99c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.167+0000 7fe9b6b85640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] conn(0x7fe99c0ac7c0 0x7fe99c0aec60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.168+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== osd.5 v2:172.21.15.81:6808/2098201169 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe99c0af330 con 0x7fe99c0ac7c0 2024-09-10T11:41:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.181+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 --> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9b0062e00 con 0x7fe99c0ac7c0 2024-09-10T11:41:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9a77fe640 1 -- 172.21.15.17:0/1732922993 <== osd.5 v2:172.21.15.81:6808/2098201169 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe9b0062e00 con 0x7fe99c0ac7c0 2024-09-10T11:41:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] conn(0x7fe99c0ac7c0 msgr2=0x7fe99c0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] conn(0x7fe99c0ac7c0 0x7fe99c0aec60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe99c0a2c10 msgr2=0x7fe99c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe99c0a2c10 0x7fe99c0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009230 tx=0x7fe9a00058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 msgr2=0x7fe9b0198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 --2- 172.21.15.17:0/1732922993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9b0101de0 0x7fe9b0198470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00d950 tx=0x7fe9ac00de10 comp rx=0 tx=0).stop 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b6b85640 1 -- 172.21.15.17:0/1732922993 reap_dead start 2024-09-10T11:41:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 shutdown_connections 2024-09-10T11:41:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 >> 172.21.15.17:0/1732922993 conn(0x7fe9b00fd8c0 msgr2=0x7fe9b00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 shutdown_connections 2024-09-10T11:41:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:19.182+0000 7fe9b85e8640 1 -- 172.21.15.17:0/1732922993 wait complete. 2024-09-10T11:41:19.407 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:19.407 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:19.486 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:19 smithi017 ceph-mon[30817]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T11:41:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:19 smithi026 ceph-mon[34817]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T11:41:19.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:19 smithi081 ceph-mon[35059]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T11:41:19.962 INFO:teuthology.orchestra.run.smithi017.stdout:335007449108 2024-09-10T11:41:19.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T11:41:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 -- 172.21.15.17:0/4022642113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc100e20 msgr2=0x7f40bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/4022642113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc100e20 0x7f40bc101200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009900 tx=0x7f40ac02a480 comp rx=0 tx=0).stop 2024-09-10T11:41:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 -- 172.21.15.17:0/4022642113 shutdown_connections 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/4022642113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 0x7f40bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/4022642113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40bc102ef0 0x7f40bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.037+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/4022642113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc100e20 0x7f40bc101200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- 172.21.15.17:0/4022642113 >> 172.21.15.17:0/4022642113 conn(0x7f40bc0fc7d0 msgr2=0x7f40bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- 172.21.15.17:0/4022642113 shutdown_connections 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- 172.21.15.17:0/4022642113 wait complete. 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 Processor -- start 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- start start 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40bc100e20 0x7f40bc1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 0x7f40bc1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 0x7f40bc1a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc111020 con 0x7f40bc102ef0 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc110ea0 con 0x7f40bc100e20 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.038+0000 7f40c2bf2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc1111a0 con 0x7f40bc102570 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 0x7f40bc1a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 0x7f40bc1a4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50430/0 (socket says 172.21.15.17:50430) 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 -- 172.21.15.17:0/1244331504 learned_addr learned my addr 172.21.15.17:0/1244331504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c098e640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40bc100e20 0x7f40bc1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40bbfff640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 0x7f40bc1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 -- 172.21.15.17:0/1244331504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 msgr2=0x7f40bc1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 0x7f40bc1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 -- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40bc100e20 msgr2=0x7f40bc1994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40bc100e20 0x7f40bc1994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc1a4a70 con 0x7f40bc102ef0 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40bbfff640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc102570 0x7f40bc1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c118f640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 0x7f40bc1a4530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40b400b970 tx=0x7f40b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4019070 con 0x7f40bc102ef0 2024-09-10T11:41:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b400cb40 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc1a4c40 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.039+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4007650 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.040+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1a5130 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.040+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f40bc062900 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f40b401c070 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f40a40a2c10 0x7f40a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40c098e640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f40a40a2c10 0x7f40a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f40b40cee80 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] conn(0x7f40a40ac7c0 0x7f40a40aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40b40047d0 con 0x7f40a40ac7c0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.042+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f40b40cf2d0 con 0x7f40bc102ef0 2024-09-10T11:41:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.043+0000 7f40c098e640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f40a40a2c10 0x7f40a40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000c00 tx=0x7f40ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.043+0000 7f40bbfff640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] conn(0x7f40a40ac7c0 0x7f40a40aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.043+0000 7f40bbfff640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] conn(0x7f40a40ac7c0 0x7f40a40aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.044+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== osd.7 v2:172.21.15.26:6816/2390923493 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40b40047d0 con 0x7f40a40ac7c0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.058+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 --> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40bc062d80 con 0x7f40a40ac7c0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1244331504 <== osd.7 v2:172.21.15.26:6816/2390923493 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f40bc062d80 con 0x7f40a40ac7c0 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] conn(0x7f40a40ac7c0 msgr2=0x7f40a40aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] conn(0x7f40a40ac7c0 0x7f40a40aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f40a40a2c10 msgr2=0x7f40a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f40a40a2c10 0x7f40a40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000c00 tx=0x7f40ac0058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 msgr2=0x7f40bc1a4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 --2- 172.21.15.17:0/1244331504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40bc102ef0 0x7f40bc1a4530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40b400b970 tx=0x7f40b400be30 comp rx=0 tx=0).stop 2024-09-10T11:41:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c118f640 1 -- 172.21.15.17:0/1244331504 reap_dead start 2024-09-10T11:41:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 shutdown_connections 2024-09-10T11:41:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 >> 172.21.15.17:0/1244331504 conn(0x7f40bc0fc7d0 msgr2=0x7f40bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 shutdown_connections 2024-09-10T11:41:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:21.059+0000 7f40c2bf2640 1 -- 172.21.15.17:0/1244331504 wait complete. 2024-09-10T11:41:21.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:21 smithi017 ceph-mon[30817]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:41:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:21 smithi026 ceph-mon[34817]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:41:21.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:21 smithi081 ceph-mon[35059]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:41:21.934 INFO:teuthology.orchestra.run.smithi017.stdout:219043332136 2024-09-10T11:41:21.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/3379924954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac1082a0 msgr2=0x7fc8ac10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/3379924954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac10ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009cd0 tx=0x7fc8a402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/3379924954 shutdown_connections 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/3379924954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac10ec40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/3379924954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 0x7fc8ac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/3379924954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac102d30 0x7fc8ac103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/3379924954 >> 172.21.15.17:0/3379924954 conn(0x7fc8ac0fc7d0 msgr2=0x7fc8ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/3379924954 shutdown_connections 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.938+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/3379924954 wait complete. 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 Processor -- start 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 -- start start 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 0x7fc8ac100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 0x7fc8ac100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac112100 con 0x7fc8ac102d30 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac111f80 con 0x7fc8ac1036e0 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8b0ef9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac112280 con 0x7fc8ac1082a0 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 0x7fc8ac100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 0x7fc8ac100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50410/0 (socket says 172.21.15.17:50410) 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 -- 172.21.15.17:0/1134135573 learned_addr learned my addr 172.21.15.17:0/1134135573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8a9d9b640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 0x7fc8ac100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aad9d640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 -- 172.21.15.17:0/1134135573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac1082a0 msgr2=0x7fc8ac101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 -- 172.21.15.17:0/1134135573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 msgr2=0x7fc8ac100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 0x7fc8ac100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aa59c640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac1a6a90 con 0x7fc8ac102d30 2024-09-10T11:41:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8a9d9b640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8ac1036e0 0x7fc8ac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.939+0000 7fc8aad9d640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8ac1082a0 0x7fc8ac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc8aa59c640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 0x7fc8ac100990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00b4a0 tx=0x7fc89c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c014070 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc89c010af0 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c017d10 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ac1a6d80 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.940+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ac1a7210 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.941+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8ac0628c0 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.942+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc89c017070 con 0x7fc8ac102d30 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc89b7fe640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc8940a2c10 0x7fc8940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc8a9d9b640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc8940a2c10 0x7fc8940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc89c0ce900 con 0x7fc8ac102d30 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc89b7fe640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] conn(0x7fc8940ac7c0 0x7fc8940aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8940af330 con 0x7fc8940ac7c0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc89c0ced50 con 0x7fc8ac102d30 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc8aad9d640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] conn(0x7fc8940ac7c0 0x7fc8940aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc8a9d9b640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc8940a2c10 0x7fc8940a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac102420 tx=0x7fc8a0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.943+0000 7fc8aad9d640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] conn(0x7fc8940ac7c0 0x7fc8940aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.944+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== osd.9 v2:172.21.15.17:6826/356908580 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8940af330 con 0x7fc8940ac7c0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.958+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 --> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8ac062cc0 con 0x7fc8940ac7c0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc89b7fe640 1 -- 172.21.15.17:0/1134135573 <== osd.9 v2:172.21.15.17:6826/356908580 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8ac062cc0 con 0x7fc8940ac7c0 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] conn(0x7fc8940ac7c0 msgr2=0x7fc8940aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] conn(0x7fc8940ac7c0 0x7fc8940aec60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc8940a2c10 msgr2=0x7fc8940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc8940a2c10 0x7fc8940a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac102420 tx=0x7fc8a0005e50 comp rx=0 tx=0).stop 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 msgr2=0x7fc8ac100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 --2- 172.21.15.17:0/1134135573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8ac102d30 0x7fc8ac100990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00b4a0 tx=0x7fc89c00b960 comp rx=0 tx=0).stop 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8aad9d640 1 -- 172.21.15.17:0/1134135573 reap_dead start 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 shutdown_connections 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 >> 172.21.15.17:0/1134135573 conn(0x7fc8ac0fc7d0 msgr2=0x7fc8ac105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 shutdown_connections 2024-09-10T11:41:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:20.959+0000 7fc8b0ef9640 1 -- 172.21.15.17:0/1134135573 wait complete. 2024-09-10T11:41:23.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 -- 172.21.15.17:0/2720094054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8101420 msgr2=0x7f4ff810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 --2- 172.21.15.17:0/2720094054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8101420 0x7f4ff810d950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009cd0 tx=0x7f4ff002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 -- 172.21.15.17:0/2720094054 shutdown_connections 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 --2- 172.21.15.17:0/2720094054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff8100a80 0x7f4ff8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 --2- 172.21.15.17:0/2720094054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8101420 0x7f4ff810d950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 --2- 172.21.15.17:0/2720094054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff8106a80 0x7f4ff8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 -- 172.21.15.17:0/2720094054 >> 172.21.15.17:0/2720094054 conn(0x7f4ff80fc7a0 msgr2=0x7f4ff80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 -- 172.21.15.17:0/2720094054 shutdown_connections 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.065+0000 7f4ffe858640 1 -- 172.21.15.17:0/2720094054 wait complete. 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 Processor -- start 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 -- start start 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 0x7f4ff80fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff8101420 0x7f4ff80fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff8106a80 0x7f4ff80fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8110e80 con 0x7f4ff8100a80 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8110d00 con 0x7f4ff8106a80 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffe858640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8111000 con 0x7f4ff8101420 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ff7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 0x7f4ff80fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ff7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 0x7f4ff80fcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46366/0 (socket says 172.21.15.17:46366) 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ff7fff640 1 -- 172.21.15.17:0/3844872417 learned_addr learned my addr 172.21.15.17:0/3844872417 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.066+0000 7f4ffcdf5640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff8106a80 0x7f4ff80fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff77fe640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff8101420 0x7f4ff80fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 -- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff8101420 msgr2=0x7f4ff80fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff8101420 0x7f4ff80fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 -- 172.21.15.17:0/3844872417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff8106a80 msgr2=0x7f4ff80fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff8106a80 0x7f4ff80fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81a68d0 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff7fff640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 0x7f4ff80fcd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d950 tx=0x7f4fe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8017030 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe8004020 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81a6bc0 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80047a0 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.067+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81a7100 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.068+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ff80628c0 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.069+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4fe80041d0 con 0x7f4ff8100a80 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff57fa640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff77fe640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4fe80cf240 con 0x7f4ff8100a80 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff57fa640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] conn(0x7f4fe00ac7c0 0x7f4fe00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fe00af330 con 0x7f4fe00ac7c0 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f4fe80cf5f0 con 0x7f4ff8100a80 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ff77fe640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80fe800 tx=0x7f4fec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.070+0000 7f4ffcdf5640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] conn(0x7f4fe00ac7c0 0x7f4fe00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.071+0000 7f4ffcdf5640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] conn(0x7f4fe00ac7c0 0x7f4fe00aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:23.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.072+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== osd.2 v2:172.21.15.81:6800/318742081 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fe00af330 con 0x7f4fe00ac7c0 2024-09-10T11:41:23.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.086+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 --> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ff8062d40 con 0x7f4fe00ac7c0 2024-09-10T11:41:23.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.086+0000 7f4ff57fa640 1 -- 172.21.15.17:0/3844872417 <== osd.2 v2:172.21.15.81:6800/318742081 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ff8062d40 con 0x7f4fe00ac7c0 2024-09-10T11:41:23.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] conn(0x7f4fe00ac7c0 msgr2=0x7f4fe00aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] conn(0x7f4fe00ac7c0 0x7f4fe00aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fe00a2c10 msgr2=0x7f4fe00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80fe800 tx=0x7f4fec005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 msgr2=0x7f4ff80fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 --2- 172.21.15.17:0/3844872417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff8100a80 0x7f4ff80fcd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d950 tx=0x7f4fe800de10 comp rx=0 tx=0).stop 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffcdf5640 1 -- 172.21.15.17:0/3844872417 reap_dead start 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 shutdown_connections 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 >> 172.21.15.17:0/3844872417 conn(0x7f4ff80fc7a0 msgr2=0x7f4ff806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 shutdown_connections 2024-09-10T11:41:23.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.087+0000 7f4ffe858640 1 -- 172.21.15.17:0/3844872417 wait complete. 2024-09-10T11:41:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:23 smithi026 ceph-mon[34817]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T11:41:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:23 smithi017 ceph-mon[30817]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T11:41:23.548 INFO:teuthology.orchestra.run.smithi017.stdout:279172874271 2024-09-10T11:41:23.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T11:41:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:23 smithi081 ceph-mon[35059]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T11:41:23.953 INFO:teuthology.orchestra.run.smithi017.stdout:77309411394 2024-09-10T11:41:23.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T11:41:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 -- 172.21.15.17:0/380087133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324101420 msgr2=0x7f032410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 --2- 172.21.15.17:0/380087133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324101420 0x7f032410d950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f031c009cd0 tx=0x7f031c02a8e0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 -- 172.21.15.17:0/380087133 shutdown_connections 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 --2- 172.21.15.17:0/380087133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0324100a80 0x7f0324100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 --2- 172.21.15.17:0/380087133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324101420 0x7f032410d950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 --2- 172.21.15.17:0/380087133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0324106a80 0x7f0324106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 -- 172.21.15.17:0/380087133 >> 172.21.15.17:0/380087133 conn(0x7f03240fc7a0 msgr2=0x7f03240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 -- 172.21.15.17:0/380087133 shutdown_connections 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.612+0000 7f032c5f8640 1 -- 172.21.15.17:0/380087133 wait complete. 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 Processor -- start 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 -- start start 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 0x7f0324102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0324101420 0x7f0324102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0324106a80 0x7f03241030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0324110e80 con 0x7f0324100a80 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0324110d00 con 0x7f0324106a80 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032c5f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0324111000 con 0x7f0324101420 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032a394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 0x7f0324102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032a394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 0x7f0324102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46386/0 (socket says 172.21.15.17:46386) 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032a394640 1 -- 172.21.15.17:0/2492123760 learned_addr learned my addr 172.21.15.17:0/2492123760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.613+0000 7f032ab95640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0324106a80 0x7f03241030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f0329b93640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0324101420 0x7f0324102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 -- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0324101420 msgr2=0x7f0324102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0324101420 0x7f0324102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 -- 172.21.15.17:0/2492123760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0324106a80 msgr2=0x7f03241030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0324106a80 0x7f03241030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03241a68d0 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032a394640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 0x7f0324102650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f032000d950 tx=0x7f032000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320017070 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03241a6bc0 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0320009c30 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032000f6b0 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.614+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03241a7100 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.615+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f032406b190 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.616+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f03200109d0 con 0x7f0324100a80 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f031b7fe640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03100a2c10 0x7f03100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f0329b93640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03100a2c10 0x7f03100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f03200cf130 con 0x7f0324100a80 2024-09-10T11:41:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f031b7fe640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] conn(0x7f03100ac7c0 0x7f03100aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03100af330 con 0x7f03100ac7c0 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f03200cf580 con 0x7f0324100a80 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.617+0000 7f0329b93640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03100a2c10 0x7f03100a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f03240fea90 tx=0x7f0314005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.618+0000 7f032ab95640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] conn(0x7f03100ac7c0 0x7f03100aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.618+0000 7f032ab95640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] conn(0x7f03100ac7c0 0x7f03100aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.619+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== osd.8 v2:172.21.15.81:6816/476521742 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03100af330 con 0x7f03100ac7c0 2024-09-10T11:41:24.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.632+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 --> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f03241021c0 con 0x7f03100ac7c0 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.633+0000 7f031b7fe640 1 -- 172.21.15.17:0/2492123760 <== osd.8 v2:172.21.15.81:6816/476521742 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f03241021c0 con 0x7f03100ac7c0 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.633+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] conn(0x7f03100ac7c0 msgr2=0x7f03100aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.633+0000 7f032c5f8640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] conn(0x7f03100ac7c0 0x7f03100aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03100a2c10 msgr2=0x7f03100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f03100a2c10 0x7f03100a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f03240fea90 tx=0x7f0314005c60 comp rx=0 tx=0).stop 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 msgr2=0x7f0324102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 --2- 172.21.15.17:0/2492123760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0324100a80 0x7f0324102650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f032000d950 tx=0x7f032000de10 comp rx=0 tx=0).stop 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032ab95640 1 -- 172.21.15.17:0/2492123760 reap_dead start 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 shutdown_connections 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 >> 172.21.15.17:0/2492123760 conn(0x7f03240fc7a0 msgr2=0x7f032406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 shutdown_connections 2024-09-10T11:41:24.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:24.634+0000 7f032c5f8640 1 -- 172.21.15.17:0/2492123760 wait complete. 2024-09-10T11:41:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:163208757299 2024-09-10T11:41:25.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T11:41:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:25 smithi026 ceph-mon[34817]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 -- 172.21.15.17:0/2180995505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 msgr2=0x7f72a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 --2- 172.21.15.17:0/2180995505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4101200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a002a480 comp rx=0 tx=0).stop 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 -- 172.21.15.17:0/2180995505 shutdown_connections 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 --2- 172.21.15.17:0/2180995505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102570 0x7f72a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 --2- 172.21.15.17:0/2180995505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a4102ef0 0x7f72a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 --2- 172.21.15.17:0/2180995505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4101200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 -- 172.21.15.17:0/2180995505 >> 172.21.15.17:0/2180995505 conn(0x7f72a40fc7d0 msgr2=0x7f72a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 -- 172.21.15.17:0/2180995505 shutdown_connections 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.978+0000 7f72ac2da640 1 -- 172.21.15.17:0/2180995505 wait complete. 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.979+0000 7f72ac2da640 1 Processor -- start 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.979+0000 7f72ac2da640 1 -- start start 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.979+0000 7f72ac2da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72ac2da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a4102570 0x7f72a4103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72ac2da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102ef0 0x7f72a41041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72ac2da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4110f80 con 0x7f72a4100e20 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72ac2da640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4110e00 con 0x7f72a4102570 2024-09-10T11:41:25.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72ac2da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4111100 con 0x7f72a4102ef0 2024-09-10T11:41:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72aa076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72aa877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102ef0 0x7f72a41041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72aa076640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46350/0 (socket says 172.21.15.17:46350) 2024-09-10T11:41:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72aa076640 1 -- 172.21.15.17:0/4187132818 learned_addr learned my addr 172.21.15.17:0/4187132818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.980+0000 7f72a9875640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a4102570 0x7f72a4103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 -- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a4102570 msgr2=0x7f72a4103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72a4102570 0x7f72a4103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 -- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 msgr2=0x7f72a4103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4100e20 0x7f72a4103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a41a68f0 con 0x7f72a4102ef0 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72aa877640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102ef0 0x7f72a41041d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f729c00cab0 tx=0x7f729c00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ae20 con 0x7f72a4102ef0 2024-09-10T11:41:25.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f729c00f930 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a41a6be0 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c018b30 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.981+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a41a70d0 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.983+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72a4106bb0 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.984+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f729c00fae0 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.984+0000 7f729b7fe640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f72900a2c10 0x7f72900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f72aa076640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f72900a2c10 0x7f72900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f729c0cf810 con 0x7f72a4102ef0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f729b7fe640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] conn(0x7f72900ac7c0 0x7f72900aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f729c01ee50 con 0x7f72900ac7c0 2024-09-10T11:41:25.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f729c0d42c0 con 0x7f72a4102ef0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f72aa076640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f72900a2c10 0x7f72900a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005770 tx=0x7f72a0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.985+0000 7f72a9875640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] conn(0x7f72900ac7c0 0x7f72900aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.986+0000 7f72a9875640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] conn(0x7f72900ac7c0 0x7f72900aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:22.986+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== osd.4 v2:172.21.15.26:6808/1261155050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f729c01ee50 con 0x7f72900ac7c0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.000+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 --> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72a41021b0 con 0x7f72900ac7c0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f729b7fe640 1 -- 172.21.15.17:0/4187132818 <== osd.4 v2:172.21.15.26:6808/1261155050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f72a41021b0 con 0x7f72900ac7c0 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] conn(0x7f72900ac7c0 msgr2=0x7f72900aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] conn(0x7f72900ac7c0 0x7f72900aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f72900a2c10 msgr2=0x7f72900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f72900a2c10 0x7f72900a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005770 tx=0x7f72a0005a20 comp rx=0 tx=0).stop 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102ef0 msgr2=0x7f72a41041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 --2- 172.21.15.17:0/4187132818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a4102ef0 0x7f72a41041d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f729c00cab0 tx=0x7f729c00cf70 comp rx=0 tx=0).stop 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72aa877640 1 -- 172.21.15.17:0/4187132818 reap_dead start 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 shutdown_connections 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 >> 172.21.15.17:0/4187132818 conn(0x7f72a40fc7d0 msgr2=0x7f72a406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 shutdown_connections 2024-09-10T11:41:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:23.001+0000 7f72ac2da640 1 -- 172.21.15.17:0/4187132818 wait complete. 2024-09-10T11:41:25.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:25 smithi017 ceph-mon[30817]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:25.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:25 smithi081 ceph-mon[35059]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:26.128 INFO:teuthology.orchestra.run.smithi017.stdout:141733920824 2024-09-10T11:41:26.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T11:41:26.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 -- 172.21.15.17:0/955945128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170102790 msgr2=0x7fa1701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 --2- 172.21.15.17:0/955945128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170102790 0x7fa1701067e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa158009900 tx=0x7fa15802a410 comp rx=0 tx=0).stop 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 -- 172.21.15.17:0/955945128 shutdown_connections 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 --2- 172.21.15.17:0/955945128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa170106f10 0x7fa17010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 --2- 172.21.15.17:0/955945128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170102790 0x7fa1701067e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 --2- 172.21.15.17:0/955945128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170101de0 0x7fa1701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 -- 172.21.15.17:0/955945128 >> 172.21.15.17:0/955945128 conn(0x7fa1700fd8c0 msgr2=0x7fa1700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 -- 172.21.15.17:0/955945128 shutdown_connections 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 -- 172.21.15.17:0/955945128 wait complete. 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.383+0000 7fa176232640 1 Processor -- start 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 -- start start 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 0x7fa170198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170102790 0x7fa1701989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa170106f10 0x7fa17019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa170111f90 con 0x7fa170101de0 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa170111e10 con 0x7fa170106f10 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa176232640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa170112110 con 0x7fa170102790 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 0x7fa170198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 0x7fa170198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46390/0 (socket says 172.21.15.17:46390) 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 -- 172.21.15.17:0/3069645893 learned_addr learned my addr 172.21.15.17:0/3069645893 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16ffff640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa170106f10 0x7fa17019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa166ffd640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170102790 0x7fa1701989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 -- 172.21.15.17:0/3069645893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170102790 msgr2=0x7fa1701989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170102790 0x7fa1701989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 -- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa170106f10 msgr2=0x7fa17019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa170106f10 0x7fa17019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa16f7fe640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17019d440 con 0x7fa170101de0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.384+0000 7fa166ffd640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa170102790 0x7fa1701989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa16f7fe640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 0x7fa170198490 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa16000b4a0 tx=0x7fa16000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160014070 con 0x7fa170101de0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17019d730 con 0x7fa170101de0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa160010af0 con 0x7fa170101de0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160017d10 con 0x7fa170101de0 2024-09-10T11:41:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.385+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1701a5010 con 0x7fa170101de0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.386+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa170062980 con 0x7fa170101de0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.387+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa160017070 con 0x7fa170101de0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa16d7fa640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa15c0a2c10 0x7fa15c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa166ffd640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa15c0a2c10 0x7fa15c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa1600ce480 con 0x7fa170101de0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa16d7fa640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] conn(0x7fa15c0ac7c0 0x7fa15c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa16001ce50 con 0x7fa15c0ac7c0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa1600d5050 con 0x7fa170101de0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.388+0000 7fa166ffd640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa15c0a2c10 0x7fa15c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1700fdce0 tx=0x7fa158005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.389+0000 7fa16ffff640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] conn(0x7fa15c0ac7c0 0x7fa15c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.389+0000 7fa16ffff640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] conn(0x7fa15c0ac7c0 0x7fa15c0aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.390+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== osd.10 v2:172.21.15.26:6824/926527219 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa16001ce50 con 0x7fa15c0ac7c0 2024-09-10T11:41:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.403+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 --> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa170062d80 con 0x7fa15c0ac7c0 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.404+0000 7fa16d7fa640 1 -- 172.21.15.17:0/3069645893 <== osd.10 v2:172.21.15.26:6824/926527219 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa170062d80 con 0x7fa15c0ac7c0 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.404+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] conn(0x7fa15c0ac7c0 msgr2=0x7fa15c0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.404+0000 7fa176232640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] conn(0x7fa15c0ac7c0 0x7fa15c0aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa15c0a2c10 msgr2=0x7fa15c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa15c0a2c10 0x7fa15c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1700fdce0 tx=0x7fa158005a20 comp rx=0 tx=0).stop 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 msgr2=0x7fa170198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 --2- 172.21.15.17:0/3069645893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa170101de0 0x7fa170198490 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa16000b4a0 tx=0x7fa16000b960 comp rx=0 tx=0).stop 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa16ffff640 1 -- 172.21.15.17:0/3069645893 reap_dead start 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 shutdown_connections 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 >> 172.21.15.17:0/3069645893 conn(0x7fa1700fd8c0 msgr2=0x7fa1700fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 shutdown_connections 2024-09-10T11:41:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.405+0000 7fa176232640 1 -- 172.21.15.17:0/3069645893 wait complete. 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 -- 172.21.15.17:0/1530037926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410c590 msgr2=0x7fc1b410c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1530037926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410c590 0x7fc1b410c9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009900 tx=0x7fc1a802a410 comp rx=0 tx=0).stop 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 -- 172.21.15.17:0/1530037926 shutdown_connections 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1530037926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b410cf30 0x7fc1b4119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1530037926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410c590 0x7fc1b410c9f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1530037926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 0x7fc1b4112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 -- 172.21.15.17:0/1530037926 >> 172.21.15.17:0/1530037926 conn(0x7fc1b406cdc0 msgr2=0x7fc1b406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 -- 172.21.15.17:0/1530037926 shutdown_connections 2024-09-10T11:41:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 -- 172.21.15.17:0/1530037926 wait complete. 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.993+0000 7fc1ba262640 1 Processor -- start 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 -- start start 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b410c590 0x7fc1b41a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 0x7fc1b41a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 0x7fc1b41a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b411c9a0 con 0x7fc1b410cf30 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b411c820 con 0x7fc1b4112640 2024-09-10T11:41:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1ba262640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b411cb20 con 0x7fc1b410c590 2024-09-10T11:41:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 0x7fc1b41a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 0x7fc1b41a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46408/0 (socket says 172.21.15.17:46408) 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1b2ffd640 1 -- 172.21.15.17:0/1148130161 learned_addr learned my addr 172.21.15.17:0/1148130161 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1b37fe640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b410c590 0x7fc1b41a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.994+0000 7fc1b3fff640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 0x7fc1b41a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 -- 172.21.15.17:0/1148130161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b410c590 msgr2=0x7fc1b41a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b410c590 0x7fc1b41a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 -- 172.21.15.17:0/1148130161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 msgr2=0x7fc1b41a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 0x7fc1b41a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b41a7e40 con 0x7fc1b410cf30 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b3fff640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1b4112640 0x7fc1b41a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b2ffd640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 0x7fc1b41a33d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8006010 tx=0x7fc1a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a803f070 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41a80d0 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a8031c30 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8035030 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.995+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41afa10 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.996+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1b4062980 con 0x7fc1b410cf30 2024-09-10T11:41:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.998+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc1a8042070 con 0x7fc1b410cf30 2024-09-10T11:41:27.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b0ff9640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc19c0a2c10 0x7fc19c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc1a80f01f0 con 0x7fc1b410cf30 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b37fe640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc19c0a2c10 0x7fc19c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b0ff9640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] conn(0x7fc19c0ac7c0 0x7fc19c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc19c0af330 con 0x7fc19c0ac7c0 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:26.999+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc1a80f05a0 con 0x7fc1b410cf30 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.000+0000 7fc1b3fff640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] conn(0x7fc19c0ac7c0 0x7fc19c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.000+0000 7fc1b37fe640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc19c0a2c10 0x7fc19c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009b50 tx=0x7fc1a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:27.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.000+0000 7fc1b3fff640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] conn(0x7fc19c0ac7c0 0x7fc19c0aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:27.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.001+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== osd.0 v2:172.21.15.17:6802/3742829700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc19c0af330 con 0x7fc19c0ac7c0 2024-09-10T11:41:27.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.024+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 --> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1b4062d80 con 0x7fc19c0ac7c0 2024-09-10T11:41:27.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1b0ff9640 1 -- 172.21.15.17:0/1148130161 <== osd.0 v2:172.21.15.17:6802/3742829700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc1b4062d80 con 0x7fc19c0ac7c0 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] conn(0x7fc19c0ac7c0 msgr2=0x7fc19c0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] conn(0x7fc19c0ac7c0 0x7fc19c0aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc19c0a2c10 msgr2=0x7fc19c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc19c0a2c10 0x7fc19c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009b50 tx=0x7fc1a4005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 msgr2=0x7fc1b41a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 --2- 172.21.15.17:0/1148130161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b410cf30 0x7fc1b41a33d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8006010 tx=0x7fc1a8003c10 comp rx=0 tx=0).stop 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1b3fff640 1 -- 172.21.15.17:0/1148130161 reap_dead start 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 shutdown_connections 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 >> 172.21.15.17:0/1148130161 conn(0x7fc1b406cdc0 msgr2=0x7fc1b410af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 shutdown_connections 2024-09-10T11:41:27.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:27.025+0000 7fc1ba262640 1 -- 172.21.15.17:0/1148130161 wait complete. 2024-09-10T11:41:27.487 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:27 smithi017 ceph-mon[30817]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T11:41:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:27 smithi026 ceph-mon[34817]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T11:41:27.518 INFO:teuthology.orchestra.run.smithi017.stdout:304942678042 2024-09-10T11:41:27.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T11:41:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:27 smithi081 ceph-mon[35059]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T11:41:27.884 INFO:teuthology.orchestra.run.smithi017.stdout:249108103205 2024-09-10T11:41:27.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T11:41:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:28.103 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:28.673 INFO:teuthology.orchestra.run.smithi017.stdout:34359738445 2024-09-10T11:41:28.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T11:41:28.677 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:29.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 -- 172.21.15.17:0/1663096556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 msgr2=0x7fa13c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:29.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 --2- 172.21.15.17:0/1663096556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c107b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa130009930 tx=0x7fa13002a420 comp rx=0 tx=0).stop 2024-09-10T11:41:29.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 -- 172.21.15.17:0/1663096556 shutdown_connections 2024-09-10T11:41:29.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 --2- 172.21.15.17:0/1663096556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c108290 0x7fa13c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 --2- 172.21.15.17:0/1663096556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c107b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 --2- 172.21.15.17:0/1663096556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102d90 0x7fa13c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.325+0000 7fa142180640 1 -- 172.21.15.17:0/1663096556 >> 172.21.15.17:0/1663096556 conn(0x7fa13c0fc7d0 msgr2=0x7fa13c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 -- 172.21.15.17:0/1663096556 shutdown_connections 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 -- 172.21.15.17:0/1663096556 wait complete. 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 Processor -- start 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 -- start start 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c102d90 0x7fa13c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.326+0000 7fa142180640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa142180640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 0x7fa13c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa142180640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c112090 con 0x7fa13c103740 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa142180640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c111f10 con 0x7fa13c102d90 2024-09-10T11:41:29.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa142180640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c112210 con 0x7fa13c108290 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46434/0 (socket says 172.21.15.17:46434) 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 -- 172.21.15.17:0/2643706272 learned_addr learned my addr 172.21.15.17:0/2643706272 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13b7fe640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c102d90 0x7fa13c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13bfff640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 0x7fa13c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 -- 172.21.15.17:0/2643706272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 msgr2=0x7fa13c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 0x7fa13c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 -- 172.21.15.17:0/2643706272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c102d90 msgr2=0x7fa13c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c102d90 0x7fa13c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 -- 172.21.15.17:0/2643706272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c19d4e0 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13bfff640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 0x7fa13c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa13affd640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa130009230 tx=0x7fa1300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13003f030 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c19d770 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa130003ce0 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.327+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130035070 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.328+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1a50b0 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.328+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c06a7f0 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.330+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa130042030 con 0x7fa13c103740 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.330+0000 7fa138ff9640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 0x7fa1240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.331+0000 7fa13b7fe640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 0x7fa1240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.331+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa1300efbd0 con 0x7fa13c103740 2024-09-10T11:41:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.331+0000 7fa13b7fe640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 0x7fa1240a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa12c005c40 tx=0x7fa12c00a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.334+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1300bc980 con 0x7fa13c103740 2024-09-10T11:41:29.499 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:29 smithi017 ceph-mon[30817]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:29 smithi026 ceph-mon[34817]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:29.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.513+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa13c103170 con 0x7fa13c103740 2024-09-10T11:41:29.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.513+0000 7fa138ff9640 1 -- 172.21.15.17:0/2643706272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa13c103170 con 0x7fa13c103740 2024-09-10T11:41:29.514 INFO:teuthology.orchestra.run.smithi017.stdout:107374182462 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 msgr2=0x7fa1240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 0x7fa1240a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa12c005c40 tx=0x7fa12c00a570 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 msgr2=0x7fa13c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa130009230 tx=0x7fa1300042f0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 shutdown_connections 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1240a2c10 0x7fa1240a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c108290 0x7fa13c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa13c103740 0x7fa13c198a70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.515+0000 7fa142180640 1 --2- 172.21.15.17:0/2643706272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa13c102d90 0x7fa13c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.516+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 >> 172.21.15.17:0/2643706272 conn(0x7fa13c0fc7d0 msgr2=0x7fa13c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.516+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 shutdown_connections 2024-09-10T11:41:29.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:29.516+0000 7fa142180640 1 -- 172.21.15.17:0/2643706272 wait complete. 2024-09-10T11:41:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:29 smithi081 ceph-mon[35059]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T11:41:30.217 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182462 for osd.3 2024-09-10T11:41:30.217 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:30.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:30 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2643706272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:41:30.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:30 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2643706272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:41:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 -- 172.21.15.17:0/2614201637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0100ca0 msgr2=0x7fa8f0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 --2- 172.21.15.17:0/2614201637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0106840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009930 tx=0x7fa8e402a420 comp rx=0 tx=0).stop 2024-09-10T11:41:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 -- 172.21.15.17:0/2614201637 shutdown_connections 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 --2- 172.21.15.17:0/2614201637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0106f50 0x7fa8f010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 --2- 172.21.15.17:0/2614201637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0106840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 --2- 172.21.15.17:0/2614201637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 0x7fa8f01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 -- 172.21.15.17:0/2614201637 >> 172.21.15.17:0/2614201637 conn(0x7fa8f0077210 msgr2=0x7fa8f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 -- 172.21.15.17:0/2614201637 shutdown_connections 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.610+0000 7fa8f6824640 1 -- 172.21.15.17:0/2614201637 wait complete. 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 Processor -- start 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 -- start start 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 0x7fa8f01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0111ff0 con 0x7fa8f0106f50 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0111e70 con 0x7fa8f01002f0 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f6824640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0112170 con 0x7fa8f0100ca0 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f4dc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f4dc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46456/0 (socket says 172.21.15.17:46456) 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8f4dc1640 1 -- 172.21.15.17:0/3499740768 learned_addr learned my addr 172.21.15.17:0/3499740768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8ef7fe640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.611+0000 7fa8effff640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 0x7fa8f01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 -- 172.21.15.17:0/3499740768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0100ca0 msgr2=0x7fa8f0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 -- 172.21.15.17:0/3499740768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 msgr2=0x7fa8f01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 0x7fa8f01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 -- 172.21.15.17:0/3499740768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f019d380 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f4dc1640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800eaa0 tx=0x7fa8e800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8004d20 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8e8005020 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80116d0 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f019d670 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.612+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f01a4f50 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.613+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f01006d0 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.614+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa8e80051d0 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.615+0000 7fa8ed7fa640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 0x7fa8d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.615+0000 7fa8effff640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 0x7fa8d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.615+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa8e80cf2a0 con 0x7fa8f0106f50 2024-09-10T11:41:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.615+0000 7fa8effff640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 0x7fa8d80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000abe0 tx=0x7fa8e000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.619+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8e8016030 con 0x7fa8f0106f50 2024-09-10T11:41:30.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:30 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2643706272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T11:41:30.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.811+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa8f002d7c0 con 0x7fa8f0106f50 2024-09-10T11:41:30.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.811+0000 7fa8ed7fa640 1 -- 172.21.15.17:0/3499740768 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa8e809c0b0 con 0x7fa8f0106f50 2024-09-10T11:41:30.813 INFO:teuthology.orchestra.run.smithi017.stdout:197568495663 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 msgr2=0x7fa8d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 0x7fa8d80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000abe0 tx=0x7fa8e000a2d0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 msgr2=0x7fa8f019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800eaa0 tx=0x7fa8e800eea0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 shutdown_connections 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa8d80a2c10 0x7fa8d80a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f0100ca0 0x7fa8f0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0106f50 0x7fa8f019cca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 --2- 172.21.15.17:0/3499740768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8f01002f0 0x7fa8f01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 >> 172.21.15.17:0/3499740768 conn(0x7fa8f0077210 msgr2=0x7fa8f0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 shutdown_connections 2024-09-10T11:41:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.814+0000 7fa8f6824640 1 -- 172.21.15.17:0/3499740768 wait complete. 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3459947622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8106f10 msgr2=0x7f00a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3459947622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8106f10 0x7f00a810ea90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009900 tx=0x7f00a002a410 comp rx=0 tx=0).stop 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3459947622 shutdown_connections 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3459947622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8102790 0x7f00a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3459947622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8106f10 0x7f00a810ea90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3459947622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8101de0 0x7f00a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3459947622 >> 172.21.15.17:0/3459947622 conn(0x7f00a80fd8c0 msgr2=0x7f00a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3459947622 shutdown_connections 2024-09-10T11:41:30.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.976+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3459947622 wait complete. 2024-09-10T11:41:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00ad4ea640 1 Processor -- start 2024-09-10T11:41:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00ad4ea640 1 -- start start 2024-09-10T11:41:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00ad4ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8101de0 0x7f00a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00ad4ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46482/0 (socket says 172.21.15.17:46482) 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00a67fc640 1 -- 172.21.15.17:0/3985678856 learned_addr learned my addr 172.21.15.17:0/3985678856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.977+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8106f10 0x7f00a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8111f70 con 0x7f00a8102790 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a6ffd640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8101de0 0x7f00a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8111df0 con 0x7f00a8106f10 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81120f0 con 0x7f00a8101de0 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 -- 172.21.15.17:0/3985678856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8101de0 msgr2=0x7f00a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8101de0 0x7f00a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 -- 172.21.15.17:0/3985678856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8106f10 msgr2=0x7f00a8074f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8106f10 0x7f00a8074f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a81a6940 con 0x7f00a8102790 2024-09-10T11:41:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.978+0000 7f00a67fc640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f009c00d9d0 tx=0x7f009c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.979+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c017070 con 0x7f00a8102790 2024-09-10T11:41:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.979+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009c005500 con 0x7f00a8102790 2024-09-10T11:41:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.979+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a81a6c30 con 0x7f00a8102790 2024-09-10T11:41:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.979+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c010460 con 0x7f00a8102790 2024-09-10T11:41:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.980+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81a7170 con 0x7f00a8102790 2024-09-10T11:41:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.983+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a81021c0 con 0x7f00a8102790 2024-09-10T11:41:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.983+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f009c004ea0 con 0x7f00a8102790 2024-09-10T11:41:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.985+0000 7f008ffff640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 0x7f00900a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.985+0000 7f00a6ffd640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 0x7f00900a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.985+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f009c0cebd0 con 0x7f00a8102790 2024-09-10T11:41:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.986+0000 7f00a6ffd640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 0x7f00900a52a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0098005fd0 tx=0x7f0098009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:30.991+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f009c09b980 con 0x7f00a8102790 2024-09-10T11:41:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.184+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f00a810a150 con 0x7f00a8102790 2024-09-10T11:41:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.185+0000 7f008ffff640 1 -- 172.21.15.17:0/3985678856 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f009c09b280 con 0x7f00a8102790 2024-09-10T11:41:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:55834574921 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 msgr2=0x7f00900a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 0x7f00900a52a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0098005fd0 tx=0x7f0098009680 comp rx=0 tx=0).stop 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 msgr2=0x7f00a8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f009c00d9d0 tx=0x7f009c00de90 comp rx=0 tx=0).stop 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 shutdown_connections 2024-09-10T11:41:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00900a2de0 0x7f00900a52a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00a8106f10 0x7f00a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8102790 0x7f00a8074a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 --2- 172.21.15.17:0/3985678856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a8101de0 0x7f00a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 >> 172.21.15.17:0/3985678856 conn(0x7f00a80fd8c0 msgr2=0x7f00a80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 shutdown_connections 2024-09-10T11:41:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.187+0000 7f00ad4ea640 1 -- 172.21.15.17:0/3985678856 wait complete. 2024-09-10T11:41:31.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:31 smithi017 ceph-mon[30817]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T11:41:31.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:31 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3499740768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:41:31.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:31 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3985678856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:41:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:31 smithi026 ceph-mon[34817]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T11:41:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:31 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3499740768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:41:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:31 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3985678856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 -- 172.21.15.17:0/2710507934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4106f10 msgr2=0x7f4fd410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 --2- 172.21.15.17:0/2710507934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4106f10 0x7f4fd410ea90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009ca0 tx=0x7f4fcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 -- 172.21.15.17:0/2710507934 shutdown_connections 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 --2- 172.21.15.17:0/2710507934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 --2- 172.21.15.17:0/2710507934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4106f10 0x7f4fd410ea90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 --2- 172.21.15.17:0/2710507934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4101de0 0x7f4fd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 -- 172.21.15.17:0/2710507934 >> 172.21.15.17:0/2710507934 conn(0x7f4fd40fd8c0 msgr2=0x7f4fd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 -- 172.21.15.17:0/2710507934 shutdown_connections 2024-09-10T11:41:31.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.530+0000 7f4fda371640 1 -- 172.21.15.17:0/2710507934 wait complete. 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 Processor -- start 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 -- start start 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4106f10 0x7f4fd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4111f90 con 0x7f4fd4101de0 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4111e10 con 0x7f4fd4106f10 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fda371640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4112110 con 0x7f4fd4102790 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53654/0 (socket says 172.21.15.17:53654) 2024-09-10T11:41:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fd3fff640 1 -- 172.21.15.17:0/1058766568 learned_addr learned my addr 172.21.15.17:0/1058766568 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fd890e640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4106f10 0x7f4fd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.531+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 -- 172.21.15.17:0/1058766568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 msgr2=0x7f4fd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 -- 172.21.15.17:0/1058766568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4106f10 msgr2=0x7f4fd4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4106f10 0x7f4fd4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 -- 172.21.15.17:0/1058766568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd41a69c0 con 0x7f4fd4101de0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd3fff640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400d950 tx=0x7f4fc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4017070 con 0x7f4fd4101de0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd41a6cb0 con 0x7f4fd4101de0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc4009c30 con 0x7f4fd4101de0 2024-09-10T11:41:31.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f6b0 con 0x7f4fd4101de0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.532+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd41a71e0 con 0x7f4fd4101de0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.533+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd41021c0 con 0x7f4fd4101de0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.534+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4fc40109d0 con 0x7f4fd4101de0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.535+0000 7f4fd17fa640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 0x7f4fbc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.535+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4fc40cee30 con 0x7f4fd4101de0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.535+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 0x7f4fbc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.536+0000 7f4fd37fe640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 0x7f4fbc0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fd41087b0 tx=0x7f4fc8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.539+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fc4009de0 con 0x7f4fd4101de0 2024-09-10T11:41:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:31 smithi081 ceph-mon[35059]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T11:41:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:31 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3499740768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T11:41:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:31 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3985678856' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T11:41:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.719+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f4fd410a180 con 0x7f4fd4101de0 2024-09-10T11:41:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.720+0000 7f4fd17fa640 1 -- 172.21.15.17:0/1058766568 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4fc409bbe0 con 0x7f4fd4101de0 2024-09-10T11:41:31.722 INFO:teuthology.orchestra.run.smithi017.stdout:335007449110 2024-09-10T11:41:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 msgr2=0x7f4fbc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 0x7f4fbc0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fd41087b0 tx=0x7f4fc8008040 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 msgr2=0x7f4fd40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400d950 tx=0x7f4fc400de10 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 shutdown_connections 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4fbc0a2c10 0x7f4fbc0a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd4102790 0x7f4fd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4fd4106f10 0x7f4fd4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 --2- 172.21.15.17:0/1058766568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fd4101de0 0x7f4fd40744f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 >> 172.21.15.17:0/1058766568 conn(0x7f4fd40fd8c0 msgr2=0x7f4fd40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 shutdown_connections 2024-09-10T11:41:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:31.722+0000 7f4fda371640 1 -- 172.21.15.17:0/1058766568 wait complete. 2024-09-10T11:41:32.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574921 for osd.1 2024-09-10T11:41:32.079 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:32.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:32 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1058766568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:41:32.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:32 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1058766568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:41:32.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:32 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1058766568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T11:41:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 -- 172.21.15.17:0/3340428541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b4102df0 msgr2=0x7f19b41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 --2- 172.21.15.17:0/3340428541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b4102df0 0x7f19b41031d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009900 tx=0x7f19a402a410 comp rx=0 tx=0).stop 2024-09-10T11:41:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 -- 172.21.15.17:0/3340428541 shutdown_connections 2024-09-10T11:41:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 --2- 172.21.15.17:0/3340428541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b41037a0 0x7f19b410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 --2- 172.21.15.17:0/3340428541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b410c2f0 0x7f19b410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 --2- 172.21.15.17:0/3340428541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b4102df0 0x7f19b41031d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 -- 172.21.15.17:0/3340428541 >> 172.21.15.17:0/3340428541 conn(0x7f19b40fc7d0 msgr2=0x7f19b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 -- 172.21.15.17:0/3340428541 shutdown_connections 2024-09-10T11:41:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.094+0000 7f19ba195640 1 -- 172.21.15.17:0/3340428541 wait complete. 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 Processor -- start 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 -- start start 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b4102df0 0x7f19b4100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b410c2f0 0x7f19b41014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4112110 con 0x7f19b41037a0 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4111f90 con 0x7f19b4102df0 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19ba195640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19b4112290 con 0x7f19b410c2f0 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53672/0 (socket says 172.21.15.17:53672) 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1412421320 learned_addr learned my addr 172.21.15.17:0/1412421320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.095+0000 7f19b37fe640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b4102df0 0x7f19b4100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b3fff640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b410c2f0 0x7f19b41014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1412421320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b410c2f0 msgr2=0x7f19b41014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b410c2f0 0x7f19b41014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1412421320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b4102df0 msgr2=0x7f19b4100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b4102df0 0x7f19b4100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1412421320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b41a6af0 con 0x7f19b41037a0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b2ffd640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c970 tx=0x7f19a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004220 con 0x7f19b41037a0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b41a6de0 con 0x7f19b41037a0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a80043c0 con 0x7f19b41037a0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004a00 con 0x7f19b41037a0 2024-09-10T11:41:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.096+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b41a7290 con 0x7f19b41037a0 2024-09-10T11:41:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.097+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b406a790 con 0x7f19b41037a0 2024-09-10T11:41:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.098+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f19a80079b0 con 0x7f19b41037a0 2024-09-10T11:41:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.099+0000 7f19b0ff9640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 0x7f199c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.099+0000 7f19b37fe640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 0x7f199c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.099+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f19a80cee60 con 0x7f19b41037a0 2024-09-10T11:41:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.100+0000 7f19b37fe640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 0x7f199c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009230 tx=0x7f19a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.103+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19a8014030 con 0x7f19b41037a0 2024-09-10T11:41:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 -- 172.21.15.17:0/531374329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4102570 msgr2=0x7f63a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/531374329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4102570 0x7f63a41029b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6398009900 tx=0x7f639802a480 comp rx=0 tx=0).stop 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 -- 172.21.15.17:0/531374329 shutdown_connections 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/531374329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102ef0 0x7f63a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/531374329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4102570 0x7f63a41029b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/531374329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4100e20 0x7f63a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 -- 172.21.15.17:0/531374329 >> 172.21.15.17:0/531374329 conn(0x7f63a40fc7d0 msgr2=0x7f63a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 -- 172.21.15.17:0/531374329 shutdown_connections 2024-09-10T11:41:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.278+0000 7f63a9a7d640 1 -- 172.21.15.17:0/531374329 wait complete. 2024-09-10T11:41:33.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 Processor -- start 2024-09-10T11:41:33.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 -- start start 2024-09-10T11:41:33.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102570 0x7f63a4199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 0x7f63a41a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63a4110f80 con 0x7f63a4100e20 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f63a4110e00 con 0x7f63a4102570 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a9a7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63a4111100 con 0x7f63a4102ef0 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53692/0 (socket says 172.21.15.17:53692) 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.279+0000 7f63a37fe640 1 -- 172.21.15.17:0/788343464 learned_addr learned my addr 172.21.15.17:0/788343464 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a2ffd640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102570 0x7f63a4199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a3fff640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 0x7f63a41a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 -- 172.21.15.17:0/788343464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 msgr2=0x7f63a41a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 0x7f63a41a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 -- 172.21.15.17:0/788343464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102570 msgr2=0x7f63a4199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102570 0x7f63a4199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 -- 172.21.15.17:0/788343464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a41a49a0 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a3fff640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 0x7f63a41a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a37fe640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9f0 tx=0x7f639400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639400cd80 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6394005500 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a41a4b70 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394010690 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.280+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a41a5030 con 0x7f63a4100e20 2024-09-10T11:41:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.281+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a4101200 con 0x7f63a4100e20 2024-09-10T11:41:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.284+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f63940046c0 con 0x7f63a4100e20 2024-09-10T11:41:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.284+0000 7f63a0ff9640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 0x7f638c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.284+0000 7f63a2ffd640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 0x7f638c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.284+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f63940cf820 con 0x7f63a4100e20 2024-09-10T11:41:33.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.285+0000 7f63a2ffd640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 0x7f638c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6398009230 tx=0x7f63980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.285+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f19b41072c0 con 0x7f19b41037a0 2024-09-10T11:41:33.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.287+0000 7f19b0ff9640 1 -- 172.21.15.17:0/1412421320 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f19a809bc10 con 0x7f19b41037a0 2024-09-10T11:41:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.287+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63940541b0 con 0x7f63a4100e20 2024-09-10T11:41:33.289 INFO:teuthology.orchestra.run.smithi017.stdout:249108103206 2024-09-10T11:41:33.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 msgr2=0x7f199c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 0x7f199c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009230 tx=0x7f19a40058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 msgr2=0x7f19b4100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c970 tx=0x7f19a800ce30 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 shutdown_connections 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f199c0a2c90 0x7f199c0a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b410c2f0 0x7f19b41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b41037a0 0x7f19b4100f90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 --2- 172.21.15.17:0/1412421320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19b4102df0 0x7f19b4100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 >> 172.21.15.17:0/1412421320 conn(0x7f19b40fc7d0 msgr2=0x7f19b40fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 shutdown_connections 2024-09-10T11:41:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.289+0000 7f19ba195640 1 -- 172.21.15.17:0/1412421320 wait complete. 2024-09-10T11:41:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.466+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f63a4109090 con 0x7f63a4100e20 2024-09-10T11:41:33.469 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:33 smithi017 ceph-mon[30817]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T11:41:33.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.467+0000 7f63a0ff9640 1 -- 172.21.15.17:0/788343464 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f639409c630 con 0x7f63a4100e20 2024-09-10T11:41:33.470 INFO:teuthology.orchestra.run.smithi017.stdout:279172874273 2024-09-10T11:41:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 msgr2=0x7f638c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 0x7f638c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6398009230 tx=0x7f63980058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 msgr2=0x7f63a41993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9f0 tx=0x7f639400edf0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 shutdown_connections 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f638c0a2c10 0x7f638c0a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63a4102ef0 0x7f63a41a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a4102570 0x7f63a4199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 --2- 172.21.15.17:0/788343464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a4100e20 0x7f63a41993e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 >> 172.21.15.17:0/788343464 conn(0x7f63a40fc7d0 msgr2=0x7f63a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 shutdown_connections 2024-09-10T11:41:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.469+0000 7f63a9a7d640 1 -- 172.21.15.17:0/788343464 wait complete. 2024-09-10T11:41:33.604 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:33 smithi081 ceph-mon[35059]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T11:41:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:33 smithi026 ceph-mon[34817]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T11:41:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 -- 172.21.15.17:0/1796566014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102ef0 msgr2=0x7f4cd010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 --2- 172.21.15.17:0/1796566014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102ef0 0x7f4cd010da40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009ca0 tx=0x7f4cc802a950 comp rx=0 tx=0).stop 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 -- 172.21.15.17:0/1796566014 shutdown_connections 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 --2- 172.21.15.17:0/1796566014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102ef0 0x7f4cd010da40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 --2- 172.21.15.17:0/1796566014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0102570 0x7f4cd01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 --2- 172.21.15.17:0/1796566014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0100e20 0x7f4cd0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 -- 172.21.15.17:0/1796566014 >> 172.21.15.17:0/1796566014 conn(0x7f4cd00fc7d0 msgr2=0x7f4cd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 -- 172.21.15.17:0/1796566014 shutdown_connections 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 -- 172.21.15.17:0/1796566014 wait complete. 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.848+0000 7f4cd5764640 1 Processor -- start 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 -- start start 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0100e20 0x7f4cd00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0102ef0 0x7f4cd00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0110f80 con 0x7f4cd0102570 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0110e00 con 0x7f4cd0100e20 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cd5764640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0111100 con 0x7f4cd0102ef0 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53716/0 (socket says 172.21.15.17:53716) 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cceffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0100e20 0x7f4cd00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 -- 172.21.15.17:0/3202940220 learned_addr learned my addr 172.21.15.17:0/3202940220 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4ccf7fe640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0102ef0 0x7f4cd00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 -- 172.21.15.17:0/3202940220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0102ef0 msgr2=0x7f4cd00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0102ef0 0x7f4cd00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 -- 172.21.15.17:0/3202940220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0100e20 msgr2=0x7f4cd00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0100e20 0x7f4cd00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.849+0000 7f4cce7fc640 1 -- 172.21.15.17:0/3202940220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01a6930 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cce7fc640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d950 tx=0x7f4cb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8017030 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb8004020 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01a6c20 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80047a0 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.850+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01a7160 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.851+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd0101200 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.852+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4cb80041d0 con 0x7f4cd0102570 2024-09-10T11:41:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.852+0000 7f4cc7fff640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 0x7f4cbc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.853+0000 7f4cceffd640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 0x7f4cbc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.853+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4cb80cea60 con 0x7f4cd0102570 2024-09-10T11:41:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.853+0000 7f4cceffd640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 0x7f4cbc0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000bbe0 tx=0x7f4cc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:33.857+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cb809b870 con 0x7f4cd0102570 2024-09-10T11:41:34.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.038+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4cd010a0a0 con 0x7f4cd0102570 2024-09-10T11:41:34.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.038+0000 7f4cc7fff640 1 -- 172.21.15.17:0/3202940220 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cb809b170 con 0x7f4cd0102570 2024-09-10T11:41:34.041 INFO:teuthology.orchestra.run.smithi017.stdout:77309411396 2024-09-10T11:41:34.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 msgr2=0x7f4cbc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 0x7f4cbc0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000bbe0 tx=0x7f4cc000b390 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 msgr2=0x7f4cd00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800d950 tx=0x7f4cb800de10 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 shutdown_connections 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f4cbc0a2c10 0x7f4cbc0a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd0102ef0 0x7f4cd00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cd0102570 0x7f4cd00fd1c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 --2- 172.21.15.17:0/3202940220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cd0100e20 0x7f4cd00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.040+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 >> 172.21.15.17:0/3202940220 conn(0x7f4cd00fc7d0 msgr2=0x7f4cd006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.041+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 shutdown_connections 2024-09-10T11:41:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:34.041+0000 7f4cd5764640 1 -- 172.21.15.17:0/3202940220 wait complete. 2024-09-10T11:41:34.285 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103205 got 249108103206 for osd.8 2024-09-10T11:41:34.286 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:34 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1412421320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:41:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:34 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/788343464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:41:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:34 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:41:34.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:34 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3202940220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:41:34.602 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:34 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1412421320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:41:34.602 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:34 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/788343464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:41:34.602 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:34 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:41:34.602 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:34 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3202940220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:41:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:34 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1412421320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T11:41:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:34 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/788343464' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T11:41:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:34 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:41:34.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:34 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3202940220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T11:41:35.050 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874271 got 279172874273 for osd.9 2024-09-10T11:41:35.051 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:35.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:35 smithi017 ceph-mon[30817]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:35.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:35 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:35.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449108 got 335007449110 for osd.11 2024-09-10T11:41:35.493 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:35 smithi081 ceph-mon[35059]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:35 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:35 smithi026 ceph-mon[34817]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:35 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:35.900 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:35.910 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495660 got 197568495663 for osd.6 2024-09-10T11:41:35.911 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:36.315 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2024-09-10T11:41:36.315 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:36.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 -- 172.21.15.17:0/4073588941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24102570 msgr2=0x7fcb241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:36.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/4073588941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24102570 0x7fcb241029b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009ca0 tx=0x7fcb0c02a950 comp rx=0 tx=0).stop 2024-09-10T11:41:36.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 -- 172.21.15.17:0/4073588941 shutdown_connections 2024-09-10T11:41:36.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/4073588941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102ef0 0x7fcb2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/4073588941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24102570 0x7fcb241029b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/4073588941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24100e20 0x7fcb24101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 -- 172.21.15.17:0/4073588941 >> 172.21.15.17:0/4073588941 conn(0x7fcb240fc7d0 msgr2=0x7fcb240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 -- 172.21.15.17:0/4073588941 shutdown_connections 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.876+0000 7fcb2ae51640 1 -- 172.21.15.17:0/4073588941 wait complete. 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 Processor -- start 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 -- start start 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102570 0x7fcb24198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24102ef0 0x7fcb2419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24110f80 con 0x7fcb24100e20 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24110e00 con 0x7fcb24102570 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb2ae51640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24111100 con 0x7fcb24102ef0 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb28bed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb28bed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53722/0 (socket says 172.21.15.17:53722) 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb28bed640 1 -- 172.21.15.17:0/353785154 learned_addr learned my addr 172.21.15.17:0/353785154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb293ee640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24102ef0 0x7fcb2419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.877+0000 7fcb23fff640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102570 0x7fcb24198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 -- 172.21.15.17:0/353785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24102ef0 msgr2=0x7fcb2419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24102ef0 0x7fcb2419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 -- 172.21.15.17:0/353785154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102570 msgr2=0x7fcb24198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102570 0x7fcb24198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 -- 172.21.15.17:0/353785154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2419d400 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb28bed640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400d770 tx=0x7fcb1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14017070 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2419d6f0 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb14005500 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14004e00 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.878+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb241a4fd0 con 0x7fcb24100e20 2024-09-10T11:41:36.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.879+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb24101200 con 0x7fcb24100e20 2024-09-10T11:41:36.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.880+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcb14004fa0 con 0x7fcb24100e20 2024-09-10T11:41:36.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.881+0000 7fcb21ffb640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 0x7fcb100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:36.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.881+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcb140ceb90 con 0x7fcb24100e20 2024-09-10T11:41:36.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.881+0000 7fcb23fff640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 0x7fcb100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:36.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.882+0000 7fcb23fff640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 0x7fcb100a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ff060 tx=0x7fcb0c004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:36.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:36.885+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb1409b350 con 0x7fcb24100e20 2024-09-10T11:41:37.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.064+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcb2410a0a0 con 0x7fcb24100e20 2024-09-10T11:41:37.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.064+0000 7fcb21ffb640 1 -- 172.21.15.17:0/353785154 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcb1409f650 con 0x7fcb24100e20 2024-09-10T11:41:37.066 INFO:teuthology.orchestra.run.smithi017.stdout:163208757302 2024-09-10T11:41:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 msgr2=0x7fcb100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 0x7fcb100a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ff060 tx=0x7fcb0c004a60 comp rx=0 tx=0).stop 2024-09-10T11:41:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 msgr2=0x7fcb24198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400d770 tx=0x7fcb1400dc30 comp rx=0 tx=0).stop 2024-09-10T11:41:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 shutdown_connections 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb100a2c10 0x7fcb100a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb24102ef0 0x7fcb2419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb24102570 0x7fcb24198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 --2- 172.21.15.17:0/353785154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb24100e20 0x7fcb24198450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 >> 172.21.15.17:0/353785154 conn(0x7fcb240fc7d0 msgr2=0x7fcb2406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 shutdown_connections 2024-09-10T11:41:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:37.066+0000 7fcb2ae51640 1 -- 172.21.15.17:0/353785154 wait complete. 2024-09-10T11:41:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:37 smithi017 ceph-mon[30817]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:37 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/353785154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:41:37.557 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:37 smithi026 ceph-mon[34817]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:37.557 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:37 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/353785154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:41:37.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757299 got 163208757302 for osd.5 2024-09-10T11:41:37.681 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:37 smithi081 ceph-mon[35059]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:37 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/353785154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T11:41:38.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 -- 172.21.15.17:0/3714504614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058106a80 msgr2=0x7f0058106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 --2- 172.21.15.17:0/3714504614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058106a80 0x7f0058106e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0048009930 tx=0x7f004802a420 comp rx=0 tx=0).stop 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 -- 172.21.15.17:0/3714504614 shutdown_connections 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 --2- 172.21.15.17:0/3714504614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 0x7f0058100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 --2- 172.21.15.17:0/3714504614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058101420 0x7f005810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 --2- 172.21.15.17:0/3714504614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058106a80 0x7f0058106e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 -- 172.21.15.17:0/3714504614 >> 172.21.15.17:0/3714504614 conn(0x7f00580fc7a0 msgr2=0x7f00580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 -- 172.21.15.17:0/3714504614 shutdown_connections 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.092+0000 7f005deb4640 1 -- 172.21.15.17:0/3714504614 wait complete. 2024-09-10T11:41:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 Processor -- start 2024-09-10T11:41:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 -- start start 2024-09-10T11:41:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 0x7f00581984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058106a80 0x7f005819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0058110e80 con 0x7f0058101420 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0058110d00 con 0x7f0058106a80 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f005deb4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0058111000 con 0x7f0058100a80 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f0056ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f0056ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53746/0 (socket says 172.21.15.17:53746) 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f0056ffd640 1 -- 172.21.15.17:0/692193465 learned_addr learned my addr 172.21.15.17:0/692193465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f00577fe640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 0x7f00581984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.093+0000 7f0057fff640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058106a80 0x7f005819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 -- 172.21.15.17:0/692193465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 msgr2=0x7f00581984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 0x7f00581984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 -- 172.21.15.17:0/692193465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058106a80 msgr2=0x7f005819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058106a80 0x7f005819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 -- 172.21.15.17:0/692193465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005819d450 con 0x7f0058101420 2024-09-10T11:41:38.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0056ffd640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d770 tx=0x7f004c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c017070 con 0x7f0058101420 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005819d740 con 0x7f0058101420 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c005500 con 0x7f0058101420 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004e00 con 0x7f0058101420 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.094+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581a5020 con 0x7f0058101420 2024-09-10T11:41:38.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.095+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0058100ee0 con 0x7f0058101420 2024-09-10T11:41:38.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.096+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f004c004fa0 con 0x7f0058101420 2024-09-10T11:41:38.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.097+0000 7f0054ff9640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 0x7f00400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:38.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.097+0000 7f00577fe640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 0x7f00400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:38.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.097+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f004c0cefc0 con 0x7f0058101420 2024-09-10T11:41:38.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.098+0000 7f00577fe640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 0x7f00400a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0048009900 tx=0x7f00480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:38.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.101+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f004c09b780 con 0x7f0058101420 2024-09-10T11:41:38.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.288+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0058199800 con 0x7f0058101420 2024-09-10T11:41:38.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.288+0000 7f0054ff9640 1 -- 172.21.15.17:0/692193465 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0058199800 con 0x7f0058101420 2024-09-10T11:41:38.290 INFO:teuthology.orchestra.run.smithi017.stdout:219043332140 2024-09-10T11:41:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 msgr2=0x7f00400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 0x7f00400a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0048009900 tx=0x7f00480058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 msgr2=0x7f00581989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d770 tx=0x7f004c00dc30 comp rx=0 tx=0).stop 2024-09-10T11:41:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 shutdown_connections 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f00400a2c10 0x7f00400a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0058106a80 0x7f005819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0058101420 0x7f00581989e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 --2- 172.21.15.17:0/692193465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0058100a80 0x7f00581984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 >> 172.21.15.17:0/692193465 conn(0x7f00580fc7a0 msgr2=0x7f005806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 shutdown_connections 2024-09-10T11:41:38.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:38.290+0000 7f005deb4640 1 -- 172.21.15.17:0/692193465 wait complete. 2024-09-10T11:41:39.076 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332136 got 219043332140 for osd.7 2024-09-10T11:41:39.076 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 -- 172.21.15.17:0/30849887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80101de0 msgr2=0x7f0b801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 --2- 172.21.15.17:0/30849887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80101de0 0x7f0b801021c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009900 tx=0x7f0b7802a410 comp rx=0 tx=0).stop 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 -- 172.21.15.17:0/30849887 shutdown_connections 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 --2- 172.21.15.17:0/30849887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 --2- 172.21.15.17:0/30849887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80102790 0x7f0b801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 --2- 172.21.15.17:0/30849887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80101de0 0x7f0b801021c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.249+0000 7f0b8825b640 1 -- 172.21.15.17:0/30849887 >> 172.21.15.17:0/30849887 conn(0x7f0b800fd880 msgr2=0x7f0b800ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 -- 172.21.15.17:0/30849887 shutdown_connections 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 -- 172.21.15.17:0/30849887 wait complete. 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 Processor -- start 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 -- start start 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80101de0 0x7f0b800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.250+0000 7f0b8825b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b80074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80111f90 con 0x7f0b80102790 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80111e10 con 0x7f0b80101de0 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80112110 con 0x7f0b80106f10 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53760/0 (socket says 172.21.15.17:53760) 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 -- 172.21.15.17:0/1878756497 learned_addr learned my addr 172.21.15.17:0/1878756497 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:39.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b85ff7640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80101de0 0x7f0b800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b867f8640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b80074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 -- 172.21.15.17:0/1878756497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 msgr2=0x7f0b80074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b80074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 -- 172.21.15.17:0/1878756497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80101de0 msgr2=0x7f0b800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80101de0 0x7f0b800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 -- 172.21.15.17:0/1878756497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b801a69b0 con 0x7f0b80102790 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b867f8640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b80074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b857f6640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c890 tx=0x7f0b7400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74004220 con 0x7f0b80102790 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b801a6ca0 con 0x7f0b80102790 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b740043c0 con 0x7f0b80102790 2024-09-10T11:41:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74004a00 con 0x7f0b80102790 2024-09-10T11:41:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.251+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801a71d0 con 0x7f0b80102790 2024-09-10T11:41:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.253+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b801021c0 con 0x7f0b80102790 2024-09-10T11:41:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.254+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0b740079b0 con 0x7f0b80102790 2024-09-10T11:41:39.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.254+0000 7f0b7effd640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 0x7f0b680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.254+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0b740ceec0 con 0x7f0b80102790 2024-09-10T11:41:39.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.254+0000 7f0b85ff7640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 0x7f0b680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.255+0000 7f0b85ff7640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 0x7f0b680a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b78000c00 tx=0x7f0b780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.259+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b74014030 con 0x7f0b80102790 2024-09-10T11:41:39.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:39 smithi017 ceph-mon[30817]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:39.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:39 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/692193465' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:41:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.438+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0b8010a0f0 con 0x7f0b80102790 2024-09-10T11:41:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.438+0000 7f0b7effd640 1 -- 172.21.15.17:0/1878756497 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0b7409bcd0 con 0x7f0b80102790 2024-09-10T11:41:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:304942678044 2024-09-10T11:41:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 msgr2=0x7f0b680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 0x7f0b680a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b78000c00 tx=0x7f0b780058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 msgr2=0x7f0b80074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c890 tx=0x7f0b7400cd50 comp rx=0 tx=0).stop 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 shutdown_connections 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0b680a2c10 0x7f0b680a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b80106f10 0x7f0b80074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80102790 0x7f0b80074a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 --2- 172.21.15.17:0/1878756497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b80101de0 0x7f0b800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 >> 172.21.15.17:0/1878756497 conn(0x7f0b800fd880 msgr2=0x7f0b800fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 shutdown_connections 2024-09-10T11:41:39.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.440+0000 7f0b8825b640 1 -- 172.21.15.17:0/1878756497 wait complete. 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/837783866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 msgr2=0x7ff8b8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/837783866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8103110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009930 tx=0x7ff8a002a420 comp rx=0 tx=0).stop 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/837783866 shutdown_connections 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/837783866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81036e0 0x7ff8b8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/837783866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81082a0 0x7ff8b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/837783866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8103110 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/837783866 >> 172.21.15.17:0/837783866 conn(0x7ff8b80fc7d0 msgr2=0x7ff8b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/837783866 shutdown_connections 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/837783866 wait complete. 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.476+0000 7ff8bd0a1640 1 Processor -- start 2024-09-10T11:41:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 -- start start 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81036e0 0x7ff8b8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 0x7ff8b8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b81120a0 con 0x7ff8b8102d30 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8111f20 con 0x7ff8b81036e0 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8bd0a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8112220 con 0x7ff8b81082a0 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53786/0 (socket says 172.21.15.17:53786) 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 -- 172.21.15.17:0/522107449 learned_addr learned my addr 172.21.15.17:0/522107449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b759e640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 0x7ff8b8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b659c640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81036e0 0x7ff8b8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 -- 172.21.15.17:0/522107449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 msgr2=0x7ff8b8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 0x7ff8b8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 -- 172.21.15.17:0/522107449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81036e0 msgr2=0x7ff8b8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81036e0 0x7ff8b8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b6d9d640 1 -- 172.21.15.17:0/522107449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b81a6a90 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.477+0000 7ff8b759e640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 0x7ff8b8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8b6d9d640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009230 tx=0x7ff8a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a003f030 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b81a6d20 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8a0003ad0 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0035070 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.478+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b81a71f0 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.479+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b8103110 con 0x7ff8b8102d30 2024-09-10T11:41:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.480+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff8a0042030 con 0x7ff8b8102d30 2024-09-10T11:41:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.481+0000 7ff8affff640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 0x7ff8a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.481+0000 7ff8b659c640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 0x7ff8a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.482+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff8a00ef910 con 0x7ff8b8102d30 2024-09-10T11:41:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.482+0000 7ff8b659c640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 0x7ff8a40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8102420 tx=0x7ff8a800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.485+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8a00bc6c0 con 0x7ff8b8102d30 2024-09-10T11:41:39.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.663+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff8b810a2b0 con 0x7ff8b8102d30 2024-09-10T11:41:39.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.663+0000 7ff8affff640 1 -- 172.21.15.17:0/522107449 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8a00bbfc0 con 0x7ff8b8102d30 2024-09-10T11:41:39.666 INFO:teuthology.orchestra.run.smithi017.stdout:34359738447 2024-09-10T11:41:39.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 msgr2=0x7ff8a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 0x7ff8a40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8102420 tx=0x7ff8a800b590 comp rx=0 tx=0).stop 2024-09-10T11:41:39.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 msgr2=0x7ff8b8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009230 tx=0x7ff8a0004270 comp rx=0 tx=0).stop 2024-09-10T11:41:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 shutdown_connections 2024-09-10T11:41:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff8a40a2c10 0x7ff8a40a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b81082a0 0x7ff8b8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff8b81036e0 0x7ff8b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 --2- 172.21.15.17:0/522107449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b8102d30 0x7ff8b8100990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 >> 172.21.15.17:0/522107449 conn(0x7ff8b80fc7d0 msgr2=0x7ff8b8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 shutdown_connections 2024-09-10T11:41:39.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.665+0000 7ff8bd0a1640 1 -- 172.21.15.17:0/522107449 wait complete. 2024-09-10T11:41:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:39 smithi081 ceph-mon[35059]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:39 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/692193465' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:41:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:39 smithi026 ceph-mon[34817]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:39 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/692193465' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.732+0000 7ff6219ae640 1 -- 172.21.15.17:0/4168448286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1082a0 msgr2=0x7ff61c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.732+0000 7ff6219ae640 1 --2- 172.21.15.17:0/4168448286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1082a0 0x7ff61c10ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff614009930 tx=0x7ff61402a420 comp rx=0 tx=0).stop 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 -- 172.21.15.17:0/4168448286 shutdown_connections 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 --2- 172.21.15.17:0/4168448286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1036e0 0x7ff61c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 --2- 172.21.15.17:0/4168448286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1082a0 0x7ff61c10ec40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 --2- 172.21.15.17:0/4168448286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 -- 172.21.15.17:0/4168448286 >> 172.21.15.17:0/4168448286 conn(0x7ff61c0fc7d0 msgr2=0x7ff61c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 -- 172.21.15.17:0/4168448286 shutdown_connections 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 -- 172.21.15.17:0/4168448286 wait complete. 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 Processor -- start 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.733+0000 7ff6219ae640 1 -- start start 2024-09-10T11:41:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1082a0 0x7ff61c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c112100 con 0x7ff61c1036e0 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c111f80 con 0x7ff61c102d30 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c112280 con 0x7ff61c1082a0 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53808/0 (socket says 172.21.15.17:53808) 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 -- 172.21.15.17:0/325389808 learned_addr learned my addr 172.21.15.17:0/325389808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61affd640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61b7fe640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1082a0 0x7ff61c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 -- 172.21.15.17:0/325389808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1082a0 msgr2=0x7ff61c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1082a0 0x7ff61c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 -- 172.21.15.17:0/325389808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 msgr2=0x7ff61c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 -- 172.21.15.17:0/325389808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c1a6a00 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61affd640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff61a7fc640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c8c0 tx=0x7ff61000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610007bb0 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff610007d50 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610018830 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.734+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1a6cf0 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.735+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c1a7220 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.735+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c103110 con 0x7ff61c1036e0 2024-09-10T11:41:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.737+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff610018a10 con 0x7ff61c1036e0 2024-09-10T11:41:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.737+0000 7ff6209ac640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 0x7ff6040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.738+0000 7ff61affd640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 0x7ff6040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.738+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff6100cf300 con 0x7ff61c1036e0 2024-09-10T11:41:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.738+0000 7ff61affd640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 0x7ff6040a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009fa0 tx=0x7ff60c009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.742+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff610014030 con 0x7ff61c1036e0 2024-09-10T11:41:39.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.920+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff61c1a74b0 con 0x7ff61c1036e0 2024-09-10T11:41:39.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.920+0000 7ff6209ac640 1 -- 172.21.15.17:0/325389808 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff61001f300 con 0x7ff61c1036e0 2024-09-10T11:41:39.923 INFO:teuthology.orchestra.run.smithi017.stdout:141733920827 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 msgr2=0x7ff6040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 0x7ff6040a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009fa0 tx=0x7ff60c009570 comp rx=0 tx=0).stop 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 msgr2=0x7ff61c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c8c0 tx=0x7ff61000cd80 comp rx=0 tx=0).stop 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 shutdown_connections 2024-09-10T11:41:39.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff6040a2c90 0x7ff6040a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff61c1082a0 0x7ff61c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff61c1036e0 0x7ff61c100ed0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 --2- 172.21.15.17:0/325389808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff61c102d30 0x7ff61c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 >> 172.21.15.17:0/325389808 conn(0x7ff61c0fc7d0 msgr2=0x7ff61c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 shutdown_connections 2024-09-10T11:41:39.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:39.923+0000 7ff6219ae640 1 -- 172.21.15.17:0/325389808 wait complete. 2024-09-10T11:41:40.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:40 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1878756497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:41:40.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:40 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/522107449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:41:40.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:40 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/325389808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:41:40.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920824 got 141733920827 for osd.4 2024-09-10T11:41:40.586 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:40 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1878756497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:41:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:40 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/522107449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:41:40.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:40 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/325389808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:41:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:40 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1878756497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T11:41:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:40 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/522107449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T11:41:40.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:40 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/325389808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T11:41:41.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678042 got 304942678044 for osd.10 2024-09-10T11:41:41.253 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:41.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:41 smithi017 ceph-mon[30817]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:41.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2024-09-10T11:41:41.663 DEBUG:teuthology.parallel:result is None 2024-09-10T11:41:41.664 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T11:41:41.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:41:41.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:41 smithi081 ceph-mon[35059]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:41 smithi026 ceph-mon[34817]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 -- 172.21.15.17:0/515247090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe614102d30 msgr2=0x7fe614103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 --2- 172.21.15.17:0/515247090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe614102d30 0x7fe614103110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe604009cd0 tx=0x7fe60402a8f0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 -- 172.21.15.17:0/515247090 shutdown_connections 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 --2- 172.21.15.17:0/515247090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141036e0 0x7fe614107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 --2- 172.21.15.17:0/515247090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6141082a0 0x7fe61410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 --2- 172.21.15.17:0/515247090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe614102d30 0x7fe614103110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 -- 172.21.15.17:0/515247090 >> 172.21.15.17:0/515247090 conn(0x7fe6140fc7d0 msgr2=0x7fe6140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 -- 172.21.15.17:0/515247090 shutdown_connections 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 -- 172.21.15.17:0/515247090 wait complete. 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.849+0000 7fe6193a2640 1 Processor -- start 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 -- start start 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 0x7fe614100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 0x7fe614101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6141120a0 con 0x7fe6141036e0 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe614111f20 con 0x7fe614102d30 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6193a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe614112220 con 0x7fe6141082a0 2024-09-10T11:41:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53010/0 (socket says 172.21.15.17:53010) 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 -- 172.21.15.17:0/4162451755 learned_addr learned my addr 172.21.15.17:0/4162451755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe612ffd640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 0x7fe614100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6137fe640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 0x7fe614101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 -- 172.21.15.17:0/4162451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 msgr2=0x7fe614101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 0x7fe614101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 -- 172.21.15.17:0/4162451755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 msgr2=0x7fe614100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 0x7fe614100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6127fc640 1 -- 172.21.15.17:0/4162451755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6141a6a10 con 0x7fe6141036e0 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe6137fe640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 0x7fe614101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.850+0000 7fe612ffd640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 0x7fe614100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe6127fc640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c8c0 tx=0x7fe60800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608007bb0 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe608007d50 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6141a6d00 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608018830 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.851+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6141a71e0 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.852+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61406a850 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.853+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe6080189f0 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.854+0000 7fe5fbfff640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 0x7fe5fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.854+0000 7fe612ffd640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 0x7fe5fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.854+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fe6080cf620 con 0x7fe6141036e0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.854+0000 7fe612ffd640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 0x7fe5fc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe604006010 tx=0x7fe6040093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:42.857+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe608014030 con 0x7fe6141036e0 2024-09-10T11:41:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.036+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe61410a320 con 0x7fe5fc0a2c10 2024-09-10T11:41:43.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.043+0000 7fe5fbfff640 1 -- 172.21.15.17:0/4162451755 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258760 (secure 0 0 0) 0x7fe604036050 con 0x7fe5fc0a2c10 2024-09-10T11:41:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:43.049 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 msgr2=0x7fe5fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 0x7fe5fc0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe604006010 tx=0x7fe6040093f0 comp rx=0 tx=0).stop 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 msgr2=0x7fe614100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c8c0 tx=0x7fe60800cd80 comp rx=0 tx=0).stop 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 shutdown_connections 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fe5fc0a2c10 0x7fe5fc0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6141082a0 0x7fe614101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6141036e0 0x7fe614100ed0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 --2- 172.21.15.17:0/4162451755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe614102d30 0x7fe614100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 >> 172.21.15.17:0/4162451755 conn(0x7fe6140fc7d0 msgr2=0x7fe614105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 shutdown_connections 2024-09-10T11:41:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:43.046+0000 7fe6193a2640 1 -- 172.21.15.17:0/4162451755 wait complete. 2024-09-10T11:41:43.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:43 smithi017 ceph-mon[30817]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:43.667 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-10T11:41:41.423797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660120,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":645,"num_read_kb":447,"num_write":428,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391572,"kb_used_data":13176,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550252,"statfs":{"total":1151940427776,"available":1151539458048,"internally_reserved":0,"allocated":13492224,"data_stored":7414284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003234"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550175+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:40:54.550175+0000","last_peered":"2024-09-10T11:40:54.550175+0000","last_clean":"2024-09-10T11:40:54.550175+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:40:54.550175+0000","last_undegraded":"2024-09-10T11:40:54.550175+0000","last_fullsized":"2024-09-10T11:40:54.550175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549686+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:40:54.549686+0000","last_peered":"2024-09-10T11:40:54.549686+0000","last_clean":"2024-09-10T11:40:54.549686+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:40:54.549686+0000","last_undegraded":"2024-09-10T11:40:54.549686+0000","last_fullsized":"2024-09-10T11:40:54.549686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549555+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:40:54.549555+0000","last_peered":"2024-09-10T11:40:54.549555+0000","last_clean":"2024-09-10T11:40:54.549555+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:40:54.549555+0000","last_undegraded":"2024-09-10T11:40:54.549555+0000","last_fullsized":"2024-09-10T11:40:54.549555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546920+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:40:54.546920+0000","last_peered":"2024-09-10T11:40:54.546920+0000","last_clean":"2024-09-10T11:40:54.546920+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:40:54.546920+0000","last_undegraded":"2024-09-10T11:40:54.546920+0000","last_fullsized":"2024-09-10T11:40:54.546920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549293+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:40:54.549293+0000","last_peered":"2024-09-10T11:40:54.549293+0000","last_clean":"2024-09-10T11:40:54.549293+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:40:54.549293+0000","last_undegraded":"2024-09-10T11:40:54.549293+0000","last_fullsized":"2024-09-10T11:40:54.549293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561390+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:40:54.561390+0000","last_peered":"2024-09-10T11:40:54.561390+0000","last_clean":"2024-09-10T11:40:54.561390+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:40:54.561390+0000","last_undegraded":"2024-09-10T11:40:54.561390+0000","last_fullsized":"2024-09-10T11:40:54.561390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558483+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:40:54.558483+0000","last_peered":"2024-09-10T11:40:54.558483+0000","last_clean":"2024-09-10T11:40:54.558483+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:40:54.558483+0000","last_undegraded":"2024-09-10T11:40:54.558483+0000","last_fullsized":"2024-09-10T11:40:54.558483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545752+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:40:54.545752+0000","last_peered":"2024-09-10T11:40:54.545752+0000","last_clean":"2024-09-10T11:40:54.545752+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:40:54.545752+0000","last_undegraded":"2024-09-10T11:40:54.545752+0000","last_fullsized":"2024-09-10T11:40:54.545752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550045+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:40:54.550045+0000","last_peered":"2024-09-10T11:40:54.550045+0000","last_clean":"2024-09-10T11:40:54.550045+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:40:54.550045+0000","last_undegraded":"2024-09-10T11:40:54.550045+0000","last_fullsized":"2024-09-10T11:40:54.550045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561787+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:40:54.561787+0000","last_peered":"2024-09-10T11:40:54.561787+0000","last_clean":"2024-09-10T11:40:54.561787+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:40:54.561787+0000","last_undegraded":"2024-09-10T11:40:54.561787+0000","last_fullsized":"2024-09-10T11:40:54.561787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558760+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:40:54.558760+0000","last_peered":"2024-09-10T11:40:54.558760+0000","last_clean":"2024-09-10T11:40:54.558760+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:40:54.558760+0000","last_undegraded":"2024-09-10T11:40:54.558760+0000","last_fullsized":"2024-09-10T11:40:54.558760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546930+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:40:54.546930+0000","last_peered":"2024-09-10T11:40:54.546930+0000","last_clean":"2024-09-10T11:40:54.546930+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:40:54.546930+0000","last_undegraded":"2024-09-10T11:40:54.546930+0000","last_fullsized":"2024-09-10T11:40:54.546930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548998+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:40:54.548998+0000","last_peered":"2024-09-10T11:40:54.548998+0000","last_clean":"2024-09-10T11:40:54.548998+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:40:54.548998+0000","last_undegraded":"2024-09-10T11:40:54.548998+0000","last_fullsized":"2024-09-10T11:40:54.548998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548369+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:40:54.548369+0000","last_peered":"2024-09-10T11:40:54.548369+0000","last_clean":"2024-09-10T11:40:54.548369+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:40:54.548369+0000","last_undegraded":"2024-09-10T11:40:54.548369+0000","last_fullsized":"2024-09-10T11:40:54.548369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549094+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:40:54.549094+0000","last_peered":"2024-09-10T11:40:54.549094+0000","last_clean":"2024-09-10T11:40:54.549094+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:40:54.549094+0000","last_undegraded":"2024-09-10T11:40:54.549094+0000","last_fullsized":"2024-09-10T11:40:54.549094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549375+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:40:54.549375+0000","last_peered":"2024-09-10T11:40:54.549375+0000","last_clean":"2024-09-10T11:40:54.549375+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:40:54.549375+0000","last_undegraded":"2024-09-10T11:40:54.549375+0000","last_fullsized":"2024-09-10T11:40:54.549375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550286+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:40:54.550286+0000","last_peered":"2024-09-10T11:40:54.550286+0000","last_clean":"2024-09-10T11:40:54.550286+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:40:54.550286+0000","last_undegraded":"2024-09-10T11:40:54.550286+0000","last_fullsized":"2024-09-10T11:40:54.550286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547974+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:40:54.547974+0000","last_peered":"2024-09-10T11:40:54.547974+0000","last_clean":"2024-09-10T11:40:54.547974+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:40:54.547974+0000","last_undegraded":"2024-09-10T11:40:54.547974+0000","last_fullsized":"2024-09-10T11:40:54.547974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548565+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:40:54.548565+0000","last_peered":"2024-09-10T11:40:54.548565+0000","last_clean":"2024-09-10T11:40:54.548565+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:40:54.548565+0000","last_undegraded":"2024-09-10T11:40:54.548565+0000","last_fullsized":"2024-09-10T11:40:54.548565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548540+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:40:54.548540+0000","last_peered":"2024-09-10T11:40:54.548540+0000","last_clean":"2024-09-10T11:40:54.548540+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:40:54.548540+0000","last_undegraded":"2024-09-10T11:40:54.548540+0000","last_fullsized":"2024-09-10T11:40:54.548540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549070+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:40:54.549070+0000","last_peered":"2024-09-10T11:40:54.549070+0000","last_clean":"2024-09-10T11:40:54.549070+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:40:54.549070+0000","last_undegraded":"2024-09-10T11:40:54.549070+0000","last_fullsized":"2024-09-10T11:40:54.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549519+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:40:54.549519+0000","last_peered":"2024-09-10T11:40:54.549519+0000","last_clean":"2024-09-10T11:40:54.549519+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:40:54.549519+0000","last_undegraded":"2024-09-10T11:40:54.549519+0000","last_fullsized":"2024-09-10T11:40:54.549519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545811+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:40:54.545811+0000","last_peered":"2024-09-10T11:40:54.545811+0000","last_clean":"2024-09-10T11:40:54.545811+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:40:54.545811+0000","last_undegraded":"2024-09-10T11:40:54.545811+0000","last_fullsized":"2024-09-10T11:40:54.545811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547441+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:40:54.547441+0000","last_peered":"2024-09-10T11:40:54.547441+0000","last_clean":"2024-09-10T11:40:54.547441+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:40:54.547441+0000","last_undegraded":"2024-09-10T11:40:54.547441+0000","last_fullsized":"2024-09-10T11:40:54.547441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546325+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:40:54.546325+0000","last_peered":"2024-09-10T11:40:54.546325+0000","last_clean":"2024-09-10T11:40:54.546325+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:40:54.546325+0000","last_undegraded":"2024-09-10T11:40:54.546325+0000","last_fullsized":"2024-09-10T11:40:54.546325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548943+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:40:54.548943+0000","last_peered":"2024-09-10T11:40:54.548943+0000","last_clean":"2024-09-10T11:40:54.548943+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:40:54.548943+0000","last_undegraded":"2024-09-10T11:40:54.548943+0000","last_fullsized":"2024-09-10T11:40:54.548943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549068+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:40:54.549068+0000","last_peered":"2024-09-10T11:40:54.549068+0000","last_clean":"2024-09-10T11:40:54.549068+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:40:54.549068+0000","last_undegraded":"2024-09-10T11:40:54.549068+0000","last_fullsized":"2024-09-10T11:40:54.549068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553544+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:40:54.553544+0000","last_peered":"2024-09-10T11:40:54.553544+0000","last_clean":"2024-09-10T11:40:54.553544+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:40:54.553544+0000","last_undegraded":"2024-09-10T11:40:54.553544+0000","last_fullsized":"2024-09-10T11:40:54.553544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559961+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:40:54.559961+0000","last_peered":"2024-09-10T11:40:54.559961+0000","last_clean":"2024-09-10T11:40:54.559961+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:40:54.559961+0000","last_undegraded":"2024-09-10T11:40:54.559961+0000","last_fullsized":"2024-09-10T11:40:54.559961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553618+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:40:54.553618+0000","last_peered":"2024-09-10T11:40:54.553618+0000","last_clean":"2024-09-10T11:40:54.553618+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:40:54.553618+0000","last_undegraded":"2024-09-10T11:40:54.553618+0000","last_fullsized":"2024-09-10T11:40:54.553618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548342+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:40:54.548342+0000","last_peered":"2024-09-10T11:40:54.548342+0000","last_clean":"2024-09-10T11:40:54.548342+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:40:54.548342+0000","last_undegraded":"2024-09-10T11:40:54.548342+0000","last_fullsized":"2024-09-10T11:40:54.548342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548335+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:40:54.548335+0000","last_peered":"2024-09-10T11:40:54.548335+0000","last_clean":"2024-09-10T11:40:54.548335+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:40:54.548335+0000","last_undegraded":"2024-09-10T11:40:54.548335+0000","last_fullsized":"2024-09-10T11:40:54.548335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.555100+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:40:54.555100+0000","last_peered":"2024-09-10T11:40:54.555100+0000","last_clean":"2024-09-10T11:40:54.555100+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:40:54.555100+0000","last_undegraded":"2024-09-10T11:40:54.555100+0000","last_fullsized":"2024-09-10T11:40:54.555100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":76,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:36.617671+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:41:36.617671+0000","last_peered":"2024-09-10T11:41:36.617671+0000","last_clean":"2024-09-10T11:41:36.617671+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:41:36.617671+0000","last_undegraded":"2024-09-10T11:41:36.617671+0000","last_fullsized":"2024-09-10T11:41:36.617671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547340+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:40:54.547340+0000","last_peered":"2024-09-10T11:40:54.547340+0000","last_clean":"2024-09-10T11:40:54.547340+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:40:54.547340+0000","last_undegraded":"2024-09-10T11:40:54.547340+0000","last_fullsized":"2024-09-10T11:40:54.547340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545822+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:40:54.545822+0000","last_peered":"2024-09-10T11:40:54.545822+0000","last_clean":"2024-09-10T11:40:54.545822+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:40:54.545822+0000","last_undegraded":"2024-09-10T11:40:54.545822+0000","last_fullsized":"2024-09-10T11:40:54.545822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547572+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:40:54.547572+0000","last_peered":"2024-09-10T11:40:54.547572+0000","last_clean":"2024-09-10T11:40:54.547572+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:40:54.547572+0000","last_undegraded":"2024-09-10T11:40:54.547572+0000","last_fullsized":"2024-09-10T11:40:54.547572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:40.622276+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:41:40.622276+0000","last_peered":"2024-09-10T11:41:40.622276+0000","last_clean":"2024-09-10T11:41:40.622276+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:41:40.622276+0000","last_undegraded":"2024-09-10T11:41:40.622276+0000","last_fullsized":"2024-09-10T11:41:40.622276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549910+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:40:54.549910+0000","last_peered":"2024-09-10T11:40:54.549910+0000","last_clean":"2024-09-10T11:40:54.549910+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:40:54.549910+0000","last_undegraded":"2024-09-10T11:40:54.549910+0000","last_fullsized":"2024-09-10T11:40:54.549910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549932+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:40:54.549932+0000","last_peered":"2024-09-10T11:40:54.549932+0000","last_clean":"2024-09-10T11:40:54.549932+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:40:54.549932+0000","last_undegraded":"2024-09-10T11:40:54.549932+0000","last_fullsized":"2024-09-10T11:40:54.549932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549629+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:40:54.549629+0000","last_peered":"2024-09-10T11:40:54.549629+0000","last_clean":"2024-09-10T11:40:54.549629+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:40:54.549629+0000","last_undegraded":"2024-09-10T11:40:54.549629+0000","last_fullsized":"2024-09-10T11:40:54.549629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'33","reported_seq":164,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:40.622088+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:41:40.622088+0000","last_peered":"2024-09-10T11:41:40.622088+0000","last_clean":"2024-09-10T11:41:40.622088+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:41:40.622088+0000","last_undegraded":"2024-09-10T11:41:40.622088+0000","last_fullsized":"2024-09-10T11:41:40.622088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550738+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:40:54.550738+0000","last_peered":"2024-09-10T11:40:54.550738+0000","last_clean":"2024-09-10T11:40:54.550738+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:40:54.550738+0000","last_undegraded":"2024-09-10T11:40:54.550738+0000","last_fullsized":"2024-09-10T11:40:54.550738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548714+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:40:54.548714+0000","last_peered":"2024-09-10T11:40:54.548714+0000","last_clean":"2024-09-10T11:40:54.548714+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:40:54.548714+0000","last_undegraded":"2024-09-10T11:40:54.548714+0000","last_fullsized":"2024-09-10T11:40:54.548714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558658+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:40:54.558658+0000","last_peered":"2024-09-10T11:40:54.558658+0000","last_clean":"2024-09-10T11:40:54.558658+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:40:54.558658+0000","last_undegraded":"2024-09-10T11:40:54.558658+0000","last_fullsized":"2024-09-10T11:40:54.558658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":78,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:36.610877+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:41:36.610877+0000","last_peered":"2024-09-10T11:41:36.610877+0000","last_clean":"2024-09-10T11:41:36.610877+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:41:36.610877+0000","last_undegraded":"2024-09-10T11:41:36.610877+0000","last_fullsized":"2024-09-10T11:41:36.610877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558371+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:40:54.558371+0000","last_peered":"2024-09-10T11:40:54.558371+0000","last_clean":"2024-09-10T11:40:54.558371+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:40:54.558371+0000","last_undegraded":"2024-09-10T11:40:54.558371+0000","last_fullsized":"2024-09-10T11:40:54.558371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.554828+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:40:54.554828+0000","last_peered":"2024-09-10T11:40:54.554828+0000","last_clean":"2024-09-10T11:40:54.554828+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:40:54.554828+0000","last_undegraded":"2024-09-10T11:40:54.554828+0000","last_fullsized":"2024-09-10T11:40:54.554828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558930+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:40:54.558930+0000","last_peered":"2024-09-10T11:40:54.558930+0000","last_clean":"2024-09-10T11:40:54.558930+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:40:54.558930+0000","last_undegraded":"2024-09-10T11:40:54.558930+0000","last_fullsized":"2024-09-10T11:40:54.558930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558885+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:40:54.558885+0000","last_peered":"2024-09-10T11:40:54.558885+0000","last_clean":"2024-09-10T11:40:54.558885+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:40:54.558885+0000","last_undegraded":"2024-09-10T11:40:54.558885+0000","last_fullsized":"2024-09-10T11:40:54.558885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":76,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:36.617745+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:41:36.617745+0000","last_peered":"2024-09-10T11:41:36.617745+0000","last_clean":"2024-09-10T11:41:36.617745+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:41:36.617745+0000","last_undegraded":"2024-09-10T11:41:36.617745+0000","last_fullsized":"2024-09-10T11:41:36.617745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558790+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:40:54.558790+0000","last_peered":"2024-09-10T11:40:54.558790+0000","last_clean":"2024-09-10T11:40:54.558790+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:40:54.558790+0000","last_undegraded":"2024-09-10T11:40:54.558790+0000","last_fullsized":"2024-09-10T11:40:54.558790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558543+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558543+0000","last_peered":"2024-09-10T11:40:54.558543+0000","last_clean":"2024-09-10T11:40:54.558543+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558543+0000","last_undegraded":"2024-09-10T11:40:54.558543+0000","last_fullsized":"2024-09-10T11:40:54.558543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546077+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:40:54.546077+0000","last_peered":"2024-09-10T11:40:54.546077+0000","last_clean":"2024-09-10T11:40:54.546077+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:40:54.546077+0000","last_undegraded":"2024-09-10T11:40:54.546077+0000","last_fullsized":"2024-09-10T11:40:54.546077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550138+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:40:54.550138+0000","last_peered":"2024-09-10T11:40:54.550138+0000","last_clean":"2024-09-10T11:40:54.550138+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:40:54.550138+0000","last_undegraded":"2024-09-10T11:40:54.550138+0000","last_fullsized":"2024-09-10T11:40:54.550138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:36.610165+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:41:36.610165+0000","last_peered":"2024-09-10T11:41:36.610165+0000","last_clean":"2024-09-10T11:41:36.610165+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:41:36.610165+0000","last_undegraded":"2024-09-10T11:41:36.610165+0000","last_fullsized":"2024-09-10T11:41:36.610165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'6","reported_seq":76,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:35.609315+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:41:35.609315+0000","last_peered":"2024-09-10T11:41:35.609315+0000","last_clean":"2024-09-10T11:41:35.609315+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:41:35.609315+0000","last_undegraded":"2024-09-10T11:41:35.609315+0000","last_fullsized":"2024-09-10T11:41:35.609315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561567+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:40:54.561567+0000","last_peered":"2024-09-10T11:40:54.561567+0000","last_clean":"2024-09-10T11:40:54.561567+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:40:54.561567+0000","last_undegraded":"2024-09-10T11:40:54.561567+0000","last_fullsized":"2024-09-10T11:40:54.561567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561648+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:40:54.561648+0000","last_peered":"2024-09-10T11:40:54.561648+0000","last_clean":"2024-09-10T11:40:54.561648+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:40:54.561648+0000","last_undegraded":"2024-09-10T11:40:54.561648+0000","last_fullsized":"2024-09-10T11:40:54.561648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549049+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:40:54.549049+0000","last_peered":"2024-09-10T11:40:54.549049+0000","last_clean":"2024-09-10T11:40:54.549049+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:40:54.549049+0000","last_undegraded":"2024-09-10T11:40:54.549049+0000","last_fullsized":"2024-09-10T11:40:54.549049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'14","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:03.497549+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:41:03.497549+0000","last_peered":"2024-09-10T11:41:03.497549+0000","last_clean":"2024-09-10T11:41:03.497549+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:41:03.497549+0000","last_undegraded":"2024-09-10T11:41:03.497549+0000","last_fullsized":"2024-09-10T11:41:03.497549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546358+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:40:54.546358+0000","last_peered":"2024-09-10T11:40:54.546358+0000","last_clean":"2024-09-10T11:40:54.546358+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:40:54.546358+0000","last_undegraded":"2024-09-10T11:40:54.546358+0000","last_fullsized":"2024-09-10T11:40:54.546358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549754+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:40:54.549754+0000","last_peered":"2024-09-10T11:40:54.549754+0000","last_clean":"2024-09-10T11:40:54.549754+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:40:54.549754+0000","last_undegraded":"2024-09-10T11:40:54.549754+0000","last_fullsized":"2024-09-10T11:40:54.549754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549394+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:40:54.549394+0000","last_peered":"2024-09-10T11:40:54.549394+0000","last_clean":"2024-09-10T11:40:54.549394+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:40:54.549394+0000","last_undegraded":"2024-09-10T11:40:54.549394+0000","last_fullsized":"2024-09-10T11:40:54.549394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548720+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:40:54.548720+0000","last_peered":"2024-09-10T11:40:54.548720+0000","last_clean":"2024-09-10T11:40:54.548720+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:40:54.548720+0000","last_undegraded":"2024-09-10T11:40:54.548720+0000","last_fullsized":"2024-09-10T11:40:54.548720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548418+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548418+0000","last_peered":"2024-09-10T11:40:54.548418+0000","last_clean":"2024-09-10T11:40:54.548418+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548418+0000","last_undegraded":"2024-09-10T11:40:54.548418+0000","last_fullsized":"2024-09-10T11:40:54.548418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546136+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:40:54.546136+0000","last_peered":"2024-09-10T11:40:54.546136+0000","last_clean":"2024-09-10T11:40:54.546136+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:40:54.546136+0000","last_undegraded":"2024-09-10T11:40:54.546136+0000","last_fullsized":"2024-09-10T11:40:54.546136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558570+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:40:54.558570+0000","last_peered":"2024-09-10T11:40:54.558570+0000","last_clean":"2024-09-10T11:40:54.558570+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:40:54.558570+0000","last_undegraded":"2024-09-10T11:40:54.558570+0000","last_fullsized":"2024-09-10T11:40:54.558570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547105+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:40:54.547105+0000","last_peered":"2024-09-10T11:40:54.547105+0000","last_clean":"2024-09-10T11:40:54.547105+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:40:54.547105+0000","last_undegraded":"2024-09-10T11:40:54.547105+0000","last_fullsized":"2024-09-10T11:40:54.547105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549522+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:40:54.549522+0000","last_peered":"2024-09-10T11:40:54.549522+0000","last_clean":"2024-09-10T11:40:54.549522+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:40:54.549522+0000","last_undegraded":"2024-09-10T11:40:54.549522+0000","last_fullsized":"2024-09-10T11:40:54.549522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549911+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:40:54.549911+0000","last_peered":"2024-09-10T11:40:54.549911+0000","last_clean":"2024-09-10T11:40:54.549911+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:40:54.549911+0000","last_undegraded":"2024-09-10T11:40:54.549911+0000","last_fullsized":"2024-09-10T11:40:54.549911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553494+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:40:54.553494+0000","last_peered":"2024-09-10T11:40:54.553494+0000","last_clean":"2024-09-10T11:40:54.553494+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:40:54.553494+0000","last_undegraded":"2024-09-10T11:40:54.553494+0000","last_fullsized":"2024-09-10T11:40:54.553494+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.607545+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:41:34.607545+0000","last_peered":"2024-09-10T11:41:34.607545+0000","last_clean":"2024-09-10T11:41:34.607545+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:41:34.607545+0000","last_undegraded":"2024-09-10T11:41:34.607545+0000","last_fullsized":"2024-09-10T11:41:34.607545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69518,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":519,"num_read_kb":338,"num_write":245,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678045,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1107751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874275,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103208,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332140,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495665,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":454059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920828,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":453920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":517109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:41:43.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T11:41:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:43 smithi081 ceph-mon[35059]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:43.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:43 smithi026 ceph-mon[34817]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:43.946 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:44.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:44 smithi017 ceph-mon[30817]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:44.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:44.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.423+0000 7f6221a70640 1 -- 172.21.15.17:0/2064423132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 msgr2=0x7f621c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 --2- 172.21.15.17:0/2064423132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c107b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6210009930 tx=0x7f621002a420 comp rx=0 tx=0).stop 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 -- 172.21.15.17:0/2064423132 shutdown_connections 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 --2- 172.21.15.17:0/2064423132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 --2- 172.21.15.17:0/2064423132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c107b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 --2- 172.21.15.17:0/2064423132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 0x7f621c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 -- 172.21.15.17:0/2064423132 >> 172.21.15.17:0/2064423132 conn(0x7f621c0fc7d0 msgr2=0x7f621c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 -- 172.21.15.17:0/2064423132 shutdown_connections 2024-09-10T11:41:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 -- 172.21.15.17:0/2064423132 wait complete. 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.424+0000 7f6221a70640 1 Processor -- start 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 -- start start 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 0x7f621c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1120e0 con 0x7f621c1036e0 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f621c111f60 con 0x7f621c1082a0 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f6221a70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f621c112260 con 0x7f621c102d30 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53026/0 (socket says 172.21.15.17:53026) 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 -- 172.21.15.17:0/1148739786 learned_addr learned my addr 172.21.15.17:0/1148739786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621b7fe640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 0x7f621c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621bfff640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 -- 172.21.15.17:0/1148739786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 msgr2=0x7f621c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 0x7f621c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 -- 172.21.15.17:0/1148739786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 msgr2=0x7f621c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 -- 172.21.15.17:0/1148739786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c1a6b00 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621bfff640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.425+0000 7f621affd640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6210005940 tx=0x7f62100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.426+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621003f030 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.426+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c1a6d90 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.426+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6210003ce0 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.426+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210035070 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.426+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1a7210 con 0x7f621c1036e0 2024-09-10T11:41:44.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.427+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c103110 con 0x7f621c1036e0 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.428+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6210042030 con 0x7f621c1036e0 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.429+0000 7f6218ff9640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 0x7f62040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.429+0000 7f621b7fe640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 0x7f62040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.429+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f62100ef680 con 0x7f621c1036e0 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.429+0000 7f621b7fe640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 0x7f62040a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f620c005fd0 tx=0x7f620c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:44.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.433+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62100bc430 con 0x7f621c1036e0 2024-09-10T11:41:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.606+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f621c10a320 con 0x7f62040a2c10 2024-09-10T11:41:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.613+0000 7f6218ff9640 1 -- 172.21.15.17:0/1148739786 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258760 (secure 0 0 0) 0x7f620c003890 con 0x7f62040a2c10 2024-09-10T11:41:44.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:41:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 msgr2=0x7f62040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 0x7f62040a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f620c005fd0 tx=0x7f620c00b390 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 msgr2=0x7f621c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6210005940 tx=0x7f62100042f0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 shutdown_connections 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f62040a2c10 0x7f62040a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c1082a0 0x7f621c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c1036e0 0x7f621c100ed0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 --2- 172.21.15.17:0/1148739786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102d30 0x7f621c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 >> 172.21.15.17:0/1148739786 conn(0x7f621c0fc7d0 msgr2=0x7f621c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 shutdown_connections 2024-09-10T11:41:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:44.616+0000 7f6221a70640 1 -- 172.21.15.17:0/1148739786 wait complete. 2024-09-10T11:41:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:44 smithi081 ceph-mon[35059]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:44.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:44 smithi026 ceph-mon[34817]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:44.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:45.291 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-10T11:41:43.424237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660120,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":457,"num_write":428,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391572,"kb_used_data":13176,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550252,"statfs":{"total":1151940427776,"available":1151539458048,"internally_reserved":0,"allocated":13492224,"data_stored":7414284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003096"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550175+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:40:54.550175+0000","last_peered":"2024-09-10T11:40:54.550175+0000","last_clean":"2024-09-10T11:40:54.550175+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:40:54.550175+0000","last_undegraded":"2024-09-10T11:40:54.550175+0000","last_fullsized":"2024-09-10T11:40:54.550175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549686+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:40:54.549686+0000","last_peered":"2024-09-10T11:40:54.549686+0000","last_clean":"2024-09-10T11:40:54.549686+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:40:54.549686+0000","last_undegraded":"2024-09-10T11:40:54.549686+0000","last_fullsized":"2024-09-10T11:40:54.549686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549555+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:40:54.549555+0000","last_peered":"2024-09-10T11:40:54.549555+0000","last_clean":"2024-09-10T11:40:54.549555+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:40:54.549555+0000","last_undegraded":"2024-09-10T11:40:54.549555+0000","last_fullsized":"2024-09-10T11:40:54.549555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546920+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:40:54.546920+0000","last_peered":"2024-09-10T11:40:54.546920+0000","last_clean":"2024-09-10T11:40:54.546920+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:40:54.546920+0000","last_undegraded":"2024-09-10T11:40:54.546920+0000","last_fullsized":"2024-09-10T11:40:54.546920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549293+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:40:54.549293+0000","last_peered":"2024-09-10T11:40:54.549293+0000","last_clean":"2024-09-10T11:40:54.549293+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:40:54.549293+0000","last_undegraded":"2024-09-10T11:40:54.549293+0000","last_fullsized":"2024-09-10T11:40:54.549293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561390+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:40:54.561390+0000","last_peered":"2024-09-10T11:40:54.561390+0000","last_clean":"2024-09-10T11:40:54.561390+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:40:54.561390+0000","last_undegraded":"2024-09-10T11:40:54.561390+0000","last_fullsized":"2024-09-10T11:40:54.561390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558483+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:40:54.558483+0000","last_peered":"2024-09-10T11:40:54.558483+0000","last_clean":"2024-09-10T11:40:54.558483+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:40:54.558483+0000","last_undegraded":"2024-09-10T11:40:54.558483+0000","last_fullsized":"2024-09-10T11:40:54.558483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545752+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:40:54.545752+0000","last_peered":"2024-09-10T11:40:54.545752+0000","last_clean":"2024-09-10T11:40:54.545752+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:40:54.545752+0000","last_undegraded":"2024-09-10T11:40:54.545752+0000","last_fullsized":"2024-09-10T11:40:54.545752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550045+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:40:54.550045+0000","last_peered":"2024-09-10T11:40:54.550045+0000","last_clean":"2024-09-10T11:40:54.550045+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:40:54.550045+0000","last_undegraded":"2024-09-10T11:40:54.550045+0000","last_fullsized":"2024-09-10T11:40:54.550045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561787+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:40:54.561787+0000","last_peered":"2024-09-10T11:40:54.561787+0000","last_clean":"2024-09-10T11:40:54.561787+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:40:54.561787+0000","last_undegraded":"2024-09-10T11:40:54.561787+0000","last_fullsized":"2024-09-10T11:40:54.561787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558760+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:40:54.558760+0000","last_peered":"2024-09-10T11:40:54.558760+0000","last_clean":"2024-09-10T11:40:54.558760+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:40:54.558760+0000","last_undegraded":"2024-09-10T11:40:54.558760+0000","last_fullsized":"2024-09-10T11:40:54.558760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546930+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:40:54.546930+0000","last_peered":"2024-09-10T11:40:54.546930+0000","last_clean":"2024-09-10T11:40:54.546930+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:40:54.546930+0000","last_undegraded":"2024-09-10T11:40:54.546930+0000","last_fullsized":"2024-09-10T11:40:54.546930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548998+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:40:54.548998+0000","last_peered":"2024-09-10T11:40:54.548998+0000","last_clean":"2024-09-10T11:40:54.548998+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:40:54.548998+0000","last_undegraded":"2024-09-10T11:40:54.548998+0000","last_fullsized":"2024-09-10T11:40:54.548998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548369+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:40:54.548369+0000","last_peered":"2024-09-10T11:40:54.548369+0000","last_clean":"2024-09-10T11:40:54.548369+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:40:54.548369+0000","last_undegraded":"2024-09-10T11:40:54.548369+0000","last_fullsized":"2024-09-10T11:40:54.548369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549094+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:40:54.549094+0000","last_peered":"2024-09-10T11:40:54.549094+0000","last_clean":"2024-09-10T11:40:54.549094+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:40:54.549094+0000","last_undegraded":"2024-09-10T11:40:54.549094+0000","last_fullsized":"2024-09-10T11:40:54.549094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549375+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:40:54.549375+0000","last_peered":"2024-09-10T11:40:54.549375+0000","last_clean":"2024-09-10T11:40:54.549375+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:40:54.549375+0000","last_undegraded":"2024-09-10T11:40:54.549375+0000","last_fullsized":"2024-09-10T11:40:54.549375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550286+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:40:54.550286+0000","last_peered":"2024-09-10T11:40:54.550286+0000","last_clean":"2024-09-10T11:40:54.550286+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:40:54.550286+0000","last_undegraded":"2024-09-10T11:40:54.550286+0000","last_fullsized":"2024-09-10T11:40:54.550286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547974+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:40:54.547974+0000","last_peered":"2024-09-10T11:40:54.547974+0000","last_clean":"2024-09-10T11:40:54.547974+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:40:54.547974+0000","last_undegraded":"2024-09-10T11:40:54.547974+0000","last_fullsized":"2024-09-10T11:40:54.547974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548565+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:40:54.548565+0000","last_peered":"2024-09-10T11:40:54.548565+0000","last_clean":"2024-09-10T11:40:54.548565+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:40:54.548565+0000","last_undegraded":"2024-09-10T11:40:54.548565+0000","last_fullsized":"2024-09-10T11:40:54.548565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548540+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:40:54.548540+0000","last_peered":"2024-09-10T11:40:54.548540+0000","last_clean":"2024-09-10T11:40:54.548540+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:40:54.548540+0000","last_undegraded":"2024-09-10T11:40:54.548540+0000","last_fullsized":"2024-09-10T11:40:54.548540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549070+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:40:54.549070+0000","last_peered":"2024-09-10T11:40:54.549070+0000","last_clean":"2024-09-10T11:40:54.549070+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:40:54.549070+0000","last_undegraded":"2024-09-10T11:40:54.549070+0000","last_fullsized":"2024-09-10T11:40:54.549070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549519+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:40:54.549519+0000","last_peered":"2024-09-10T11:40:54.549519+0000","last_clean":"2024-09-10T11:40:54.549519+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:40:54.549519+0000","last_undegraded":"2024-09-10T11:40:54.549519+0000","last_fullsized":"2024-09-10T11:40:54.549519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545811+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:40:54.545811+0000","last_peered":"2024-09-10T11:40:54.545811+0000","last_clean":"2024-09-10T11:40:54.545811+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:40:54.545811+0000","last_undegraded":"2024-09-10T11:40:54.545811+0000","last_fullsized":"2024-09-10T11:40:54.545811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547441+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:40:54.547441+0000","last_peered":"2024-09-10T11:40:54.547441+0000","last_clean":"2024-09-10T11:40:54.547441+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:40:54.547441+0000","last_undegraded":"2024-09-10T11:40:54.547441+0000","last_fullsized":"2024-09-10T11:40:54.547441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546325+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:40:54.546325+0000","last_peered":"2024-09-10T11:40:54.546325+0000","last_clean":"2024-09-10T11:40:54.546325+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:40:54.546325+0000","last_undegraded":"2024-09-10T11:40:54.546325+0000","last_fullsized":"2024-09-10T11:40:54.546325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548943+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:40:54.548943+0000","last_peered":"2024-09-10T11:40:54.548943+0000","last_clean":"2024-09-10T11:40:54.548943+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:40:54.548943+0000","last_undegraded":"2024-09-10T11:40:54.548943+0000","last_fullsized":"2024-09-10T11:40:54.548943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549068+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:40:54.549068+0000","last_peered":"2024-09-10T11:40:54.549068+0000","last_clean":"2024-09-10T11:40:54.549068+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:40:54.549068+0000","last_undegraded":"2024-09-10T11:40:54.549068+0000","last_fullsized":"2024-09-10T11:40:54.549068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553544+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:40:54.553544+0000","last_peered":"2024-09-10T11:40:54.553544+0000","last_clean":"2024-09-10T11:40:54.553544+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:40:54.553544+0000","last_undegraded":"2024-09-10T11:40:54.553544+0000","last_fullsized":"2024-09-10T11:40:54.553544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559961+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:40:54.559961+0000","last_peered":"2024-09-10T11:40:54.559961+0000","last_clean":"2024-09-10T11:40:54.559961+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:40:54.559961+0000","last_undegraded":"2024-09-10T11:40:54.559961+0000","last_fullsized":"2024-09-10T11:40:54.559961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553618+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:40:54.553618+0000","last_peered":"2024-09-10T11:40:54.553618+0000","last_clean":"2024-09-10T11:40:54.553618+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:40:54.553618+0000","last_undegraded":"2024-09-10T11:40:54.553618+0000","last_fullsized":"2024-09-10T11:40:54.553618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548342+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:40:54.548342+0000","last_peered":"2024-09-10T11:40:54.548342+0000","last_clean":"2024-09-10T11:40:54.548342+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:40:54.548342+0000","last_undegraded":"2024-09-10T11:40:54.548342+0000","last_fullsized":"2024-09-10T11:40:54.548342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548335+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:40:54.548335+0000","last_peered":"2024-09-10T11:40:54.548335+0000","last_clean":"2024-09-10T11:40:54.548335+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:40:54.548335+0000","last_undegraded":"2024-09-10T11:40:54.548335+0000","last_fullsized":"2024-09-10T11:40:54.548335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.555100+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:40:54.555100+0000","last_peered":"2024-09-10T11:40:54.555100+0000","last_clean":"2024-09-10T11:40:54.555100+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:40:54.555100+0000","last_undegraded":"2024-09-10T11:40:54.555100+0000","last_fullsized":"2024-09-10T11:40:54.555100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:41.624266+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:41:41.624266+0000","last_peered":"2024-09-10T11:41:41.624266+0000","last_clean":"2024-09-10T11:41:41.624266+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:41:41.624266+0000","last_undegraded":"2024-09-10T11:41:41.624266+0000","last_fullsized":"2024-09-10T11:41:41.624266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547340+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:40:54.547340+0000","last_peered":"2024-09-10T11:40:54.547340+0000","last_clean":"2024-09-10T11:40:54.547340+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:40:54.547340+0000","last_undegraded":"2024-09-10T11:40:54.547340+0000","last_fullsized":"2024-09-10T11:40:54.547340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545822+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:40:54.545822+0000","last_peered":"2024-09-10T11:40:54.545822+0000","last_clean":"2024-09-10T11:40:54.545822+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:40:54.545822+0000","last_undegraded":"2024-09-10T11:40:54.545822+0000","last_fullsized":"2024-09-10T11:40:54.545822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547572+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:40:54.547572+0000","last_peered":"2024-09-10T11:40:54.547572+0000","last_clean":"2024-09-10T11:40:54.547572+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:40:54.547572+0000","last_undegraded":"2024-09-10T11:40:54.547572+0000","last_fullsized":"2024-09-10T11:40:54.547572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:40.622276+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:41:40.622276+0000","last_peered":"2024-09-10T11:41:40.622276+0000","last_clean":"2024-09-10T11:41:40.622276+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:41:40.622276+0000","last_undegraded":"2024-09-10T11:41:40.622276+0000","last_fullsized":"2024-09-10T11:41:40.622276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549910+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:40:54.549910+0000","last_peered":"2024-09-10T11:40:54.549910+0000","last_clean":"2024-09-10T11:40:54.549910+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:40:54.549910+0000","last_undegraded":"2024-09-10T11:40:54.549910+0000","last_fullsized":"2024-09-10T11:40:54.549910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549932+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:40:54.549932+0000","last_peered":"2024-09-10T11:40:54.549932+0000","last_clean":"2024-09-10T11:40:54.549932+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:40:54.549932+0000","last_undegraded":"2024-09-10T11:40:54.549932+0000","last_fullsized":"2024-09-10T11:40:54.549932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549629+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:40:54.549629+0000","last_peered":"2024-09-10T11:40:54.549629+0000","last_clean":"2024-09-10T11:40:54.549629+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:40:54.549629+0000","last_undegraded":"2024-09-10T11:40:54.549629+0000","last_fullsized":"2024-09-10T11:40:54.549629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'33","reported_seq":164,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:40.622088+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:41:40.622088+0000","last_peered":"2024-09-10T11:41:40.622088+0000","last_clean":"2024-09-10T11:41:40.622088+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:41:40.622088+0000","last_undegraded":"2024-09-10T11:41:40.622088+0000","last_fullsized":"2024-09-10T11:41:40.622088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550738+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:40:54.550738+0000","last_peered":"2024-09-10T11:40:54.550738+0000","last_clean":"2024-09-10T11:40:54.550738+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:40:54.550738+0000","last_undegraded":"2024-09-10T11:40:54.550738+0000","last_fullsized":"2024-09-10T11:40:54.550738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548714+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:40:54.548714+0000","last_peered":"2024-09-10T11:40:54.548714+0000","last_clean":"2024-09-10T11:40:54.548714+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:40:54.548714+0000","last_undegraded":"2024-09-10T11:40:54.548714+0000","last_fullsized":"2024-09-10T11:40:54.548714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558658+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:40:54.558658+0000","last_peered":"2024-09-10T11:40:54.558658+0000","last_clean":"2024-09-10T11:40:54.558658+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:40:54.558658+0000","last_undegraded":"2024-09-10T11:40:54.558658+0000","last_fullsized":"2024-09-10T11:40:54.558658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:41.617319+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:41:41.617319+0000","last_peered":"2024-09-10T11:41:41.617319+0000","last_clean":"2024-09-10T11:41:41.617319+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:41:41.617319+0000","last_undegraded":"2024-09-10T11:41:41.617319+0000","last_fullsized":"2024-09-10T11:41:41.617319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558371+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:40:54.558371+0000","last_peered":"2024-09-10T11:40:54.558371+0000","last_clean":"2024-09-10T11:40:54.558371+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:40:54.558371+0000","last_undegraded":"2024-09-10T11:40:54.558371+0000","last_fullsized":"2024-09-10T11:40:54.558371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.554828+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:40:54.554828+0000","last_peered":"2024-09-10T11:40:54.554828+0000","last_clean":"2024-09-10T11:40:54.554828+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:40:54.554828+0000","last_undegraded":"2024-09-10T11:40:54.554828+0000","last_fullsized":"2024-09-10T11:40:54.554828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558930+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:40:54.558930+0000","last_peered":"2024-09-10T11:40:54.558930+0000","last_clean":"2024-09-10T11:40:54.558930+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:40:54.558930+0000","last_undegraded":"2024-09-10T11:40:54.558930+0000","last_fullsized":"2024-09-10T11:40:54.558930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558885+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:40:54.558885+0000","last_peered":"2024-09-10T11:40:54.558885+0000","last_clean":"2024-09-10T11:40:54.558885+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:40:54.558885+0000","last_undegraded":"2024-09-10T11:40:54.558885+0000","last_fullsized":"2024-09-10T11:40:54.558885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":76,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:36.617745+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:41:36.617745+0000","last_peered":"2024-09-10T11:41:36.617745+0000","last_clean":"2024-09-10T11:41:36.617745+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:41:36.617745+0000","last_undegraded":"2024-09-10T11:41:36.617745+0000","last_fullsized":"2024-09-10T11:41:36.617745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558790+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:40:54.558790+0000","last_peered":"2024-09-10T11:40:54.558790+0000","last_clean":"2024-09-10T11:40:54.558790+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:40:54.558790+0000","last_undegraded":"2024-09-10T11:40:54.558790+0000","last_fullsized":"2024-09-10T11:40:54.558790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558543+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558543+0000","last_peered":"2024-09-10T11:40:54.558543+0000","last_clean":"2024-09-10T11:40:54.558543+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558543+0000","last_undegraded":"2024-09-10T11:40:54.558543+0000","last_fullsized":"2024-09-10T11:40:54.558543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546077+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:40:54.546077+0000","last_peered":"2024-09-10T11:40:54.546077+0000","last_clean":"2024-09-10T11:40:54.546077+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:40:54.546077+0000","last_undegraded":"2024-09-10T11:40:54.546077+0000","last_fullsized":"2024-09-10T11:40:54.546077+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550138+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:40:54.550138+0000","last_peered":"2024-09-10T11:40:54.550138+0000","last_clean":"2024-09-10T11:40:54.550138+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:40:54.550138+0000","last_undegraded":"2024-09-10T11:40:54.550138+0000","last_fullsized":"2024-09-10T11:40:54.550138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":80,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:41.616824+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:41:41.616824+0000","last_peered":"2024-09-10T11:41:41.616824+0000","last_clean":"2024-09-10T11:41:41.616824+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:41:41.616824+0000","last_undegraded":"2024-09-10T11:41:41.616824+0000","last_fullsized":"2024-09-10T11:41:41.616824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546752+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:40:54.546752+0000","last_peered":"2024-09-10T11:40:54.546752+0000","last_clean":"2024-09-10T11:40:54.546752+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:40:54.546752+0000","last_undegraded":"2024-09-10T11:40:54.546752+0000","last_fullsized":"2024-09-10T11:40:54.546752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'6","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:40.615788+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:41:40.615788+0000","last_peered":"2024-09-10T11:41:40.615788+0000","last_clean":"2024-09-10T11:41:40.615788+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:41:40.615788+0000","last_undegraded":"2024-09-10T11:41:40.615788+0000","last_fullsized":"2024-09-10T11:41:40.615788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561567+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:40:54.561567+0000","last_peered":"2024-09-10T11:40:54.561567+0000","last_clean":"2024-09-10T11:40:54.561567+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:40:54.561567+0000","last_undegraded":"2024-09-10T11:40:54.561567+0000","last_fullsized":"2024-09-10T11:40:54.561567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561648+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:40:54.561648+0000","last_peered":"2024-09-10T11:40:54.561648+0000","last_clean":"2024-09-10T11:40:54.561648+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:40:54.561648+0000","last_undegraded":"2024-09-10T11:40:54.561648+0000","last_fullsized":"2024-09-10T11:40:54.561648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549049+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:40:54.549049+0000","last_peered":"2024-09-10T11:40:54.549049+0000","last_clean":"2024-09-10T11:40:54.549049+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:40:54.549049+0000","last_undegraded":"2024-09-10T11:40:54.549049+0000","last_fullsized":"2024-09-10T11:40:54.549049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'14","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:03.497549+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:41:03.497549+0000","last_peered":"2024-09-10T11:41:03.497549+0000","last_clean":"2024-09-10T11:41:03.497549+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:41:03.497549+0000","last_undegraded":"2024-09-10T11:41:03.497549+0000","last_fullsized":"2024-09-10T11:41:03.497549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546358+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:40:54.546358+0000","last_peered":"2024-09-10T11:40:54.546358+0000","last_clean":"2024-09-10T11:40:54.546358+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:40:54.546358+0000","last_undegraded":"2024-09-10T11:40:54.546358+0000","last_fullsized":"2024-09-10T11:40:54.546358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549754+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:40:54.549754+0000","last_peered":"2024-09-10T11:40:54.549754+0000","last_clean":"2024-09-10T11:40:54.549754+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:40:54.549754+0000","last_undegraded":"2024-09-10T11:40:54.549754+0000","last_fullsized":"2024-09-10T11:40:54.549754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549394+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:40:54.549394+0000","last_peered":"2024-09-10T11:40:54.549394+0000","last_clean":"2024-09-10T11:40:54.549394+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:40:54.549394+0000","last_undegraded":"2024-09-10T11:40:54.549394+0000","last_fullsized":"2024-09-10T11:40:54.549394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548720+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:40:54.548720+0000","last_peered":"2024-09-10T11:40:54.548720+0000","last_clean":"2024-09-10T11:40:54.548720+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:40:54.548720+0000","last_undegraded":"2024-09-10T11:40:54.548720+0000","last_fullsized":"2024-09-10T11:40:54.548720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548418+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548418+0000","last_peered":"2024-09-10T11:40:54.548418+0000","last_clean":"2024-09-10T11:40:54.548418+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548418+0000","last_undegraded":"2024-09-10T11:40:54.548418+0000","last_fullsized":"2024-09-10T11:40:54.548418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546136+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:40:54.546136+0000","last_peered":"2024-09-10T11:40:54.546136+0000","last_clean":"2024-09-10T11:40:54.546136+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:40:54.546136+0000","last_undegraded":"2024-09-10T11:40:54.546136+0000","last_fullsized":"2024-09-10T11:40:54.546136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558570+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:40:54.558570+0000","last_peered":"2024-09-10T11:40:54.558570+0000","last_clean":"2024-09-10T11:40:54.558570+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:40:54.558570+0000","last_undegraded":"2024-09-10T11:40:54.558570+0000","last_fullsized":"2024-09-10T11:40:54.558570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547105+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:40:54.547105+0000","last_peered":"2024-09-10T11:40:54.547105+0000","last_clean":"2024-09-10T11:40:54.547105+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:40:54.547105+0000","last_undegraded":"2024-09-10T11:40:54.547105+0000","last_fullsized":"2024-09-10T11:40:54.547105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549522+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:40:54.549522+0000","last_peered":"2024-09-10T11:40:54.549522+0000","last_clean":"2024-09-10T11:40:54.549522+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:40:54.549522+0000","last_undegraded":"2024-09-10T11:40:54.549522+0000","last_fullsized":"2024-09-10T11:40:54.549522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549911+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:40:54.549911+0000","last_peered":"2024-09-10T11:40:54.549911+0000","last_clean":"2024-09-10T11:40:54.549911+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:40:54.549911+0000","last_undegraded":"2024-09-10T11:40:54.549911+0000","last_fullsized":"2024-09-10T11:40:54.549911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.553494+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:40:54.553494+0000","last_peered":"2024-09-10T11:40:54.553494+0000","last_clean":"2024-09-10T11:40:54.553494+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:40:54.553494+0000","last_undegraded":"2024-09-10T11:40:54.553494+0000","last_fullsized":"2024-09-10T11:40:54.553494+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":86,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:39.613933+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:41:39.613933+0000","last_peered":"2024-09-10T11:41:39.613933+0000","last_clean":"2024-09-10T11:41:39.613933+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:41:39.613933+0000","last_undegraded":"2024-09-10T11:41:39.613933+0000","last_fullsized":"2024-09-10T11:41:39.613933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69518,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":544,"num_read_kb":348,"num_write":245,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678045,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1107751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":454059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920829,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":453920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":517109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:41:45.295 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T11:41:45.295 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T11:41:45.295 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T11:41:45.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T11:41:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:45 smithi017 ceph-mon[30817]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:41:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:41:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:45 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:45.551 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:45 smithi081 ceph-mon[35059]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:41:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:41:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:45 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:45 smithi026 ceph-mon[34817]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:41:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:41:45.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:45 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:41:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 -- 172.21.15.17:0/3200061696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 msgr2=0x7fb8d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/3200061696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d410ea90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009ca0 tx=0x7fb8cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 -- 172.21.15.17:0/3200061696 shutdown_connections 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/3200061696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 0x7fb8d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/3200061696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d410ea90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/3200061696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 0x7fb8d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 -- 172.21.15.17:0/3200061696 >> 172.21.15.17:0/3200061696 conn(0x7fb8d40fd8c0 msgr2=0x7fb8d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 -- 172.21.15.17:0/3200061696 shutdown_connections 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.007+0000 7fb8dbc67640 1 -- 172.21.15.17:0/3200061696 wait complete. 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 Processor -- start 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 -- start start 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 0x7fb8d41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 0x7fb8d41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111fc0 con 0x7fb8d4106f10 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111e40 con 0x7fb8d4101de0 2024-09-10T11:41:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8dbc67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4112140 con 0x7fb8d4102790 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53042/0 (socket says 172.21.15.17:53042) 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 -- 172.21.15.17:0/2598162576 learned_addr learned my addr 172.21.15.17:0/2598162576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8d9a03640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 0x7fb8d41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8d9202640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 0x7fb8d41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 -- 172.21.15.17:0/2598162576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 msgr2=0x7fb8d41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 0x7fb8d41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 -- 172.21.15.17:0/2598162576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 msgr2=0x7fb8d41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 0x7fb8d41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 -- 172.21.15.17:0/2598162576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d419d350 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.008+0000 7fb8da204640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005e30 tx=0x7fb8cc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.009+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc031650 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.009+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8cc0317f0 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.009+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d419d5e0 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.009+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc02f9d0 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.009+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d41a4f20 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.010+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d41021c0 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.011+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8cc02fbf0 con 0x7fb8d4106f10 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.012+0000 7fb8caffd640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.012+0000 7fb8d9a03640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.012+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fb8cc0f04b0 con 0x7fb8d4106f10 2024-09-10T11:41:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.012+0000 7fb8d9a03640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009bd0 tx=0x7fb8d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.016+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8cc0bd490 con 0x7fb8d4106f10 2024-09-10T11:41:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.232+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb8d410a150 con 0x7fb8d4106f10 2024-09-10T11:41:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.232+0000 7fb8caffd640 1 -- 172.21.15.17:0/2598162576 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb8cc0bcd90 con 0x7fb8d4106f10 2024-09-10T11:41:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:46.234 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 msgr2=0x7fb8c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009bd0 tx=0x7fb8d0005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 msgr2=0x7fb8d419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005e30 tx=0x7fb8cc003d00 comp rx=0 tx=0).stop 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 shutdown_connections 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d4102790 0x7fb8d41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d4106f10 0x7fb8d419cc70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 --2- 172.21.15.17:0/2598162576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d4101de0 0x7fb8d41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 >> 172.21.15.17:0/2598162576 conn(0x7fb8d40fd8c0 msgr2=0x7fb8d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 shutdown_connections 2024-09-10T11:41:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:46.234+0000 7fb8dbc67640 1 -- 172.21.15.17:0/2598162576 wait complete. 2024-09-10T11:41:46.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:46 smithi017 ceph-mon[30817]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:46 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2598162576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:41:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:46 smithi081 ceph-mon[35059]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:46 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2598162576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:41:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:46 smithi026 ceph-mon[34817]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:41:46.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:46 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2598162576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T11:41:46.853 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T11:41:46.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:41:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:47 smithi017 ceph-mon[30817]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:47.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 -- 172.21.15.17:0/3238668679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24102790 msgr2=0x7f8d241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/3238668679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24102790 0x7f8d241067e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009900 tx=0x7f8d0c02a410 comp rx=0 tx=0).stop 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 -- 172.21.15.17:0/3238668679 shutdown_connections 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/3238668679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24106f10 0x7f8d2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/3238668679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24102790 0x7f8d241067e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/3238668679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24101de0 0x7f8d241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.605+0000 7f8d28c5e640 1 -- 172.21.15.17:0/3238668679 >> 172.21.15.17:0/3238668679 conn(0x7f8d240fd8e0 msgr2=0x7f8d240ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- 172.21.15.17:0/3238668679 shutdown_connections 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- 172.21.15.17:0/3238668679 wait complete. 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 Processor -- start 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- start start 2024-09-10T11:41:47.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24102790 0x7f8d24198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24106f10 0x7f8d2419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24111f70 con 0x7f8d24101de0 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24111df0 con 0x7f8d24106f10 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.606+0000 7f8d28c5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d241120f0 con 0x7f8d24102790 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53060/0 (socket says 172.21.15.17:53060) 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 -- 172.21.15.17:0/884638018 learned_addr learned my addr 172.21.15.17:0/884638018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d1bfff640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24102790 0x7f8d24198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d22d9d640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24106f10 0x7f8d2419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 -- 172.21.15.17:0/884638018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24102790 msgr2=0x7f8d24198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24102790 0x7f8d24198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 -- 172.21.15.17:0/884638018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24106f10 msgr2=0x7f8d2419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24106f10 0x7f8d2419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 -- 172.21.15.17:0/884638018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2419d3e0 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d2259c640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400e9f0 tx=0x7f8d1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1400cd80 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d14010910 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2419d6d0 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14018990 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.607+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d241a4fb0 con 0x7f8d24101de0 2024-09-10T11:41:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.608+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d241021c0 con 0x7f8d24101de0 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.610+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8d14010ac0 con 0x7f8d24101de0 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.611+0000 7f8d1b7fe640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 0x7f8d100a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.611+0000 7f8d1bfff640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 0x7f8d100a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.611+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8d140cf820 con 0x7f8d24101de0 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.611+0000 7f8d1bfff640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 0x7f8d100a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009230 tx=0x7f8d0c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.614+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d1409bfe0 con 0x7f8d24101de0 2024-09-10T11:41:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:47 smithi081 ceph-mon[35059]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:47 smithi026 ceph-mon[34817]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:47.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.825+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d2410a120 con 0x7f8d24101de0 2024-09-10T11:41:47.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.826+0000 7f8d1b7fe640 1 -- 172.21.15.17:0/884638018 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f8d140a02e0 con 0x7f8d24101de0 2024-09-10T11:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:41:47.828 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 msgr2=0x7f8d100a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 0x7f8d100a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009230 tx=0x7f8d0c0058d0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 msgr2=0x7f8d24198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400e9f0 tx=0x7f8d1400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 shutdown_connections 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8d100a2c90 0x7f8d100a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d24102790 0x7f8d24198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d24106f10 0x7f8d2419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 --2- 172.21.15.17:0/884638018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d24101de0 0x7f8d24198430 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 >> 172.21.15.17:0/884638018 conn(0x7f8d240fd8e0 msgr2=0x7f8d240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 shutdown_connections 2024-09-10T11:41:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:47.828+0000 7f8d28c5e640 1 -- 172.21.15.17:0/884638018 wait complete. 2024-09-10T11:41:48.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:41:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:48 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/884638018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:48 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/884638018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:48.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:48 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/884638018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 -- 172.21.15.17:0/3085477923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 msgr2=0x7ff1c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 --2- 172.21.15.17:0/3085477923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c41021c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a410 comp rx=0 tx=0).stop 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 -- 172.21.15.17:0/3085477923 shutdown_connections 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 --2- 172.21.15.17:0/3085477923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4102790 0x7ff1c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 --2- 172.21.15.17:0/3085477923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4106f10 0x7ff1c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 --2- 172.21.15.17:0/3085477923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c41021c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 -- 172.21.15.17:0/3085477923 >> 172.21.15.17:0/3085477923 conn(0x7ff1c40fd8c0 msgr2=0x7ff1c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 -- 172.21.15.17:0/3085477923 shutdown_connections 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.131+0000 7ff1cade6640 1 -- 172.21.15.17:0/3085477923 wait complete. 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 Processor -- start 2024-09-10T11:41:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 -- start start 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4112010 con 0x7ff1c4101de0 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4111e90 con 0x7ff1c4102790 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1cade6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4112190 con 0x7ff1c4106f10 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1c8b82640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1c8b82640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53074/0 (socket says 172.21.15.17:53074) 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1c8b82640 1 -- 172.21.15.17:0/1193147099 learned_addr learned my addr 172.21.15.17:0/1193147099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.132+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:39978/0 (socket says 172.21.15.17:39978) 2024-09-10T11:41:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c9383640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 -- 172.21.15.17:0/1193147099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4106f10 msgr2=0x7ff1c4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 -- 172.21.15.17:0/1193147099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 msgr2=0x7ff1c4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 -- 172.21.15.17:0/1193147099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c41a6a70 con 0x7ff1c4101de0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c8b82640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005ab0 tx=0x7ff1b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b403f030 con 0x7ff1c4101de0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b4003ce0 con 0x7ff1c4101de0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4035070 con 0x7ff1c4101de0 2024-09-10T11:41:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.133+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c41a6d00 con 0x7ff1c4101de0 2024-09-10T11:41:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.134+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c41a70d0 con 0x7ff1c4101de0 2024-09-10T11:41:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.135+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c4102240 con 0x7ff1c4101de0 2024-09-10T11:41:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.136+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff1b4042030 con 0x7ff1c4101de0 2024-09-10T11:41:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.137+0000 7ff1c1ffb640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 0x7ff1ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.137+0000 7ff1c3fff640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 0x7ff1ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.137+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff1b40efc90 con 0x7ff1c4101de0 2024-09-10T11:41:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.138+0000 7ff1c3fff640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 0x7ff1ac0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4075f80 tx=0x7ff1b8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:49.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.141+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1b40bcaa0 con 0x7ff1c4101de0 2024-09-10T11:41:49.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.356+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1c4075a20 con 0x7ff1c4101de0 2024-09-10T11:41:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.357+0000 7ff1c1ffb640 1 -- 172.21.15.17:0/1193147099 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7ff1b40bc3a0 con 0x7ff1c4101de0 2024-09-10T11:41:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:49.359 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:41:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:41:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 msgr2=0x7ff1ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 0x7ff1ac0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4075f80 tx=0x7ff1b8009110 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 msgr2=0x7ff1c40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005ab0 tx=0x7ff1b40042f0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 shutdown_connections 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff1ac0a2c90 0x7ff1ac0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 --2- 172.21.15.17:0/1193147099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.359+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 >> 172.21.15.17:0/1193147099 conn(0x7ff1c40fd8c0 msgr2=0x7ff1c40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.360+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 shutdown_connections 2024-09-10T11:41:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:49.360+0000 7ff1cade6640 1 -- 172.21.15.17:0/1193147099 wait complete. 2024-09-10T11:41:49.408 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:49 smithi017 ceph-mon[30817]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:49 smithi081 ceph-mon[35059]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:49.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:49 smithi026 ceph-mon[34817]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:49.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:41:50.264 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:50.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:50 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1193147099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:50.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:50 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1193147099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 -- 172.21.15.17:0/4082581470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384100e20 msgr2=0x7fd384101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 --2- 172.21.15.17:0/4082581470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384100e20 0x7fd384101200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd380009900 tx=0x7fd38002a480 comp rx=0 tx=0).stop 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 -- 172.21.15.17:0/4082581470 shutdown_connections 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 --2- 172.21.15.17:0/4082581470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384102570 0x7fd3841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 --2- 172.21.15.17:0/4082581470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 0x7fd38410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 --2- 172.21.15.17:0/4082581470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384100e20 0x7fd384101200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 -- 172.21.15.17:0/4082581470 >> 172.21.15.17:0/4082581470 conn(0x7fd3840fc7d0 msgr2=0x7fd3840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 -- 172.21.15.17:0/4082581470 shutdown_connections 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.716+0000 7fd38c142640 1 -- 172.21.15.17:0/4082581470 wait complete. 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 Processor -- start 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 -- start start 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 0x7fd3840738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 0x7fd38406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd384110fa0 con 0x7fd384102570 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd384110e20 con 0x7fd384102ef0 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38c142640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd384111120 con 0x7fd384100e20 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53090/0 (socket says 172.21.15.17:53090) 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 -- 172.21.15.17:0/1632101350 learned_addr learned my addr 172.21.15.17:0/1632101350 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd389ede640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 0x7fd3840738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd38a6df640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 0x7fd38406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 -- 172.21.15.17:0/1632101350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 msgr2=0x7fd3840738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 0x7fd3840738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 -- 172.21.15.17:0/1632101350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 msgr2=0x7fd38406ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 0x7fd38406ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd3896dd640 1 -- 172.21.15.17:0/1632101350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38406d350 con 0x7fd384102570 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.717+0000 7fd389ede640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 0x7fd3840738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd3896dd640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c920 tx=0x7fd37400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374007c70 con 0x7fd384102570 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd374007e10 con 0x7fd384102570 2024-09-10T11:41:50.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38406d640 con 0x7fd384102570 2024-09-10T11:41:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374018890 con 0x7fd384102570 2024-09-10T11:41:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.718+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd384071630 con 0x7fd384102570 2024-09-10T11:41:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.719+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3841021b0 con 0x7fd384102570 2024-09-10T11:41:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.720+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd374018a70 con 0x7fd384102570 2024-09-10T11:41:50.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.721+0000 7fd37affd640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 0x7fd3700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:50.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.721+0000 7fd389ede640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 0x7fd3700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:50.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.721+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd3740cf420 con 0x7fd384102570 2024-09-10T11:41:50.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.721+0000 7fd389ede640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 0x7fd3700a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd380005ab0 tx=0x7fd380005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:50.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.725+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd374014030 con 0x7fd384102570 2024-09-10T11:41:50.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:50 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1193147099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:50.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.902+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3840718f0 con 0x7fd384102570 2024-09-10T11:41:50.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.903+0000 7fd37affd640 1 -- 172.21.15.17:0/1632101350 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7fd37400de20 con 0x7fd384102570 2024-09-10T11:41:50.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:50.906 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 msgr2=0x7fd3700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 0x7fd3700a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd380005ab0 tx=0x7fd380005a20 comp rx=0 tx=0).stop 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 msgr2=0x7fd384073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c920 tx=0x7fd37400cde0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 shutdown_connections 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd3700a2c90 0x7fd3700a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd384102ef0 0x7fd38406ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd384102570 0x7fd384073e20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 --2- 172.21.15.17:0/1632101350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384100e20 0x7fd3840738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 >> 172.21.15.17:0/1632101350 conn(0x7fd3840fc7d0 msgr2=0x7fd384106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 shutdown_connections 2024-09-10T11:41:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:50.906+0000 7fd38c142640 1 -- 172.21.15.17:0/1632101350 wait complete. 2024-09-10T11:41:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:51 smithi017 ceph-mon[30817]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:51 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1632101350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:51.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:41:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:51 smithi081 ceph-mon[35059]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:51 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1632101350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:51 smithi026 ceph-mon[34817]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:41:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:51 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1632101350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:41:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:52.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 -- 172.21.15.17:0/4104102723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 msgr2=0x7f77e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 --2- 172.21.15.17:0/4104102723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e810da40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009900 tx=0x7f77e002a480 comp rx=0 tx=0).stop 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 -- 172.21.15.17:0/4104102723 shutdown_connections 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 --2- 172.21.15.17:0/4104102723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8102570 0x7f77e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 --2- 172.21.15.17:0/4104102723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e810da40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 --2- 172.21.15.17:0/4104102723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8100e20 0x7f77e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 -- 172.21.15.17:0/4104102723 >> 172.21.15.17:0/4104102723 conn(0x7f77e80fc7d0 msgr2=0x7f77e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 -- 172.21.15.17:0/4104102723 shutdown_connections 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.336+0000 7f77ed645640 1 -- 172.21.15.17:0/4104102723 wait complete. 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 Processor -- start 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 -- start start 2024-09-10T11:41:52.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8100e20 0x7f77e81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8102570 0x7f77e8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8110f80 con 0x7f77e8102ef0 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8110e00 con 0x7f77e8102570 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77ed645640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8111100 con 0x7f77e8100e20 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47168/0 (socket says 172.21.15.17:47168) 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77e77fe640 1 -- 172.21.15.17:0/2243456740 learned_addr learned my addr 172.21.15.17:0/2243456740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77e67fc640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8102570 0x7f77e8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.337+0000 7f77e6ffd640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8100e20 0x7f77e81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 -- 172.21.15.17:0/2243456740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8100e20 msgr2=0x7f77e81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:52.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8100e20 0x7f77e81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 -- 172.21.15.17:0/2243456740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8102570 msgr2=0x7f77e8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8102570 0x7f77e8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 -- 172.21.15.17:0/2243456740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e819d3a0 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77e77fe640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77e0004770 tx=0x7f77e0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e003f070 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e819d630 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e0031c30 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0035030 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.338+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81a4f70 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.339+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8101200 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.340+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f77e0042070 con 0x7f77e8102ef0 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.341+0000 7f77cffff640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 0x7f77d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:52.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.341+0000 7f77e6ffd640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 0x7f77d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:52.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.341+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f77e00ef9d0 con 0x7f77e8102ef0 2024-09-10T11:41:52.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.341+0000 7f77e6ffd640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 0x7f77d00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77d8007ec0 tx=0x7f77d80075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:52.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.345+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77e00bc130 con 0x7f77e8102ef0 2024-09-10T11:41:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.554+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e810a0a0 con 0x7f77e8102ef0 2024-09-10T11:41:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.555+0000 7f77cffff640 1 -- 172.21.15.17:0/2243456740 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f77e00c0430 con 0x7f77e8102ef0 2024-09-10T11:41:52.556 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:41:52.557 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:41:52.557 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 msgr2=0x7f77d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 0x7f77d00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77d8007ec0 tx=0x7f77d80075b0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 msgr2=0x7f77e819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77e0004770 tx=0x7f77e0003c10 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 shutdown_connections 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.557+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77d00a2c10 0x7f77d00a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102ef0 0x7f77e819ccc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e8102570 0x7f77e8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 --2- 172.21.15.17:0/2243456740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77e8100e20 0x7f77e81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 >> 172.21.15.17:0/2243456740 conn(0x7f77e80fc7d0 msgr2=0x7f77e806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:52.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 shutdown_connections 2024-09-10T11:41:52.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:52.558+0000 7f77ed645640 1 -- 172.21.15.17:0/2243456740 wait complete. 2024-09-10T11:41:53.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T11:40:40.061818+0000', 'modified': '2024-09-10T11:40:51.538239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24523, 'mds_1': 24512, 'mds_2': 24508, 'mds_3': 24496, 'mds_4': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/2696186701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2696186701}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2696186701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6841/1429826923', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 1429826923}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 1429826923}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.26:6833/3177397418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 3177397418}, {'type': 'v1', 'addr': '172.21.15.26:6833', 'nonce': 3177397418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/230246363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 230246363}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 230246363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.26:6835/3091242502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 3091242502}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3091242502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.26:6837/2783390333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 2783390333}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 2783390333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.81:6835/997801833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 997801833}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 997801833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.81:6837/4227780996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 4227780996}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 4227780996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.26:6839/1530868796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6838', 'nonce': 1530868796}, {'type': 'v1', 'addr': '172.21.15.26:6839', 'nonce': 1530868796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.81:6839/193630272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 193630272}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 193630272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24523, 'qdb_cluster': [24523, 24512, 24508, 24496, 24485]} 2024-09-10T11:41:53.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T11:41:53.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T11:41:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:53.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:53 smithi017 ceph-mon[30817]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:53.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:53 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2243456740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:53 smithi081 ceph-mon[35059]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:53 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2243456740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:53 smithi026 ceph-mon[34817]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:41:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:53 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2243456740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 -- 172.21.15.17:0/3951637296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c106f10 msgr2=0x7f903c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 --2- 172.21.15.17:0/3951637296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c106f10 0x7f903c10ea90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9034009ca0 tx=0x7f903402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 -- 172.21.15.17:0/3951637296 shutdown_connections 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 --2- 172.21.15.17:0/3951637296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c106f10 0x7f903c10ea90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 --2- 172.21.15.17:0/3951637296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c102790 0x7f903c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 --2- 172.21.15.17:0/3951637296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 0x7f903c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.966+0000 7f9042d44640 1 -- 172.21.15.17:0/3951637296 >> 172.21.15.17:0/3951637296 conn(0x7f903c0fd8c0 msgr2=0x7f903c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- 172.21.15.17:0/3951637296 shutdown_connections 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- 172.21.15.17:0/3951637296 wait complete. 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 Processor -- start 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- start start 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 0x7f903c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 0x7f903c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f903c111f90 con 0x7f903c102790 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f903c111e10 con 0x7f903c106f10 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f9042d44640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f903c112110 con 0x7f903c101de0 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.967+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47192/0 (socket says 172.21.15.17:47192) 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 -- 172.21.15.17:0/1997871358 learned_addr learned my addr 172.21.15.17:0/1997871358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9040ae0640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 0x7f903c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f90412e1640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 0x7f903c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 -- 172.21.15.17:0/1997871358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 msgr2=0x7f903c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:53.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 0x7f903c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 -- 172.21.15.17:0/1997871358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 msgr2=0x7f903c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 0x7f903c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 -- 172.21.15.17:0/1997871358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c19d420 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f90412e1640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 0x7f903c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f903bfff640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f902800b4a0 tx=0x7f902800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9039ffb640 1 -- 172.21.15.17:0/1997871358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028014070 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c19d710 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9039ffb640 1 -- 172.21.15.17:0/1997871358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9028010af0 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9039ffb640 1 -- 172.21.15.17:0/1997871358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028017d10 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.968+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c1a4ff0 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.970+0000 7f9039ffb640 1 -- 172.21.15.17:0/1997871358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9028017070 con 0x7f903c102790 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 Processor -- start 2024-09-10T11:41:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 -- start start 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c52db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 0x55a019c5d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a019bb9090 con 0x55a019c5dbb0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a019b60a70 con 0x55a019c529d0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f904511d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a019bb5050 con 0x55a019c532f0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f9039ffb640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 0x7f902c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f90412e1640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 0x7f902c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f90412e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47206/0 (socket says 172.21.15.17:47206) 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f903bfff640 1 -- 172.21.15.17:0/4164040089 learned_addr learned my addr 172.21.15.17:0/4164040089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.971+0000 7f9039ffb640 1 -- 172.21.15.17:0/1997871358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f90280ce420 con 0x7f903c102790 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f9040ae0640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 0x55a019c5d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 -- 172.21.15.17:0/4164040089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 msgr2=0x55a019c5d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 0x55a019c5d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 -- 172.21.15.17:0/4164040089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 msgr2=0x55a019c52db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c52db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 -- 172.21.15.17:0/4164040089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a019b6d130 con 0x55a019c5dbb0 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f90412e1640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c52db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f9040ae0640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 0x55a019c5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f903bfff640 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9028097610 tx=0x7f9028090120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc5216eef19d61a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f90412e1640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 0x7f902c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9034009a60 tx=0x7f903402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f9026ffd640 1 -- 172.21.15.17:0/4164040089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280035f0 con 0x55a019c5dbb0 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f9026ffd640 1 -- 172.21.15.17:0/4164040089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902809b340 con 0x55a019c5dbb0 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.972+0000 7f9026ffd640 1 -- 172.21.15.17:0/4164040089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280cc030 con 0x55a019c5dbb0 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- 172.21.15.17:0/4164040089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 msgr2=0x55a019c5ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9028097610 tx=0x7f9028090120 comp rx=0 tx=0).stop 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- 172.21.15.17:0/4164040089 shutdown_connections 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c532f0 0x55a019c5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c5dbb0 0x55a019c5ffa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 --2- 172.21.15.17:0/4164040089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c52db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- 172.21.15.17:0/4164040089 >> 172.21.15.17:0/4164040089 conn(0x55a019c4ef60 msgr2=0x55a019c4f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- 172.21.15.17:0/4164040089 shutdown_connections 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- 172.21.15.17:0/4164040089 wait complete. 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 -- start start 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.973+0000 7f904511d740 1 Processor -- start 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c5d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c5ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a019c60780 con 0x55a019c532f0 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a019b73f20 con 0x55a019c529d0 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a019c60900 con 0x55a019c5dbb0 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f904511d740 10 client.0 _ll_register_callbacks cb 0x55a019b3d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47210/0 (socket says 172.21.15.17:47210) 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 -- 172.21.15.17:0/3801521289 learned_addr learned my addr 172.21.15.17:0/3801521289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f90412e1640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c5ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c5d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 -- 172.21.15.17:0/3801521289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 msgr2=0x55a019c5ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c5ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 -- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 msgr2=0x55a019c5d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c5d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 -- 172.21.15.17:0/3801521289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01992a2b0 con 0x55a019c532f0 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f90412e1640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c5ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c5d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f903bfff640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90280970a0 tx=0x7f90280047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea774be0d259baa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.974+0000 7f901bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902801e030 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f90280ce110 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f902809b340 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9028096ee0 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 10 client.14973 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a019c6c0d0 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902809b340 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f90280aa9c0 con 0x55a019c532f0 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 10 client.14973 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 10 client.14973 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 20 client.14973 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019c6e1d0 0x55a019c6f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 4 client.14973 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a019bc6600 con 0x55a019c6e1d0 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.975+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019c6e1d0 0x55a019c6f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.976+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019c6e1d0 0x55a019c6f640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6712db9871fdc0a server_cookie=65e1d43e82e50651 in_seq=0 out_seq=0 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.976+0000 7f901bfff640 10 client.14973 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f901bfff640 1 -- 172.21.15.17:0/3801521289 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a019bc6600 con 0x55a019c6e1d0 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f901bfff640 10 client.14973 handle_command_reply: tid=0 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 client.14973 shutdown 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 msgr2=0x55a019c5a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f90280970a0 tx=0x7f90280047d0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 shutdown_connections 2024-09-10T11:41:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019c6e1d0 0x55a019c6f640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c5ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c5a7d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 --2- 172.21.15.17:0/3801521289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c5d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 >> 172.21.15.17:0/3801521289 conn(0x55a019c4ef60 msgr2=0x55a019c54c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f901bfff640 0 client.14973 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 shutdown_connections 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 1 -- 172.21.15.17:0/3801521289 wait complete. 2024-09-10T11:41:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.977+0000 7f904511d740 20 client.14973 trim_cache size 0 max 16384 2024-09-10T11:41:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 Processor -- start 2024-09-10T11:41:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 -- start start 2024-09-10T11:41:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 0x55a019c6e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c6db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6d980 con 0x55a019c529d0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6e050 con 0x55a019c532f0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.995+0000 7f904511d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6e720 con 0x55a019c5dbb0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47220/0 (socket says 172.21.15.17:47220) 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 -- 172.21.15.17:0/679545148 learned_addr learned my addr 172.21.15.17:0/679545148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f90412e1640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c6db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f903bfff640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 0x55a019c6e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 -- 172.21.15.17:0/679545148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 msgr2=0x55a019c6db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c6db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 -- 172.21.15.17:0/679545148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 msgr2=0x55a019c6e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 0x55a019c6e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 -- 172.21.15.17:0/679545148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a019c58d20 con 0x55a019c529d0 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f903bfff640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 0x55a019c6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f9040ae0640 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9030004700 tx=0x7f903000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636869b82a496566 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f90267fc640 1 -- 172.21.15.17:0/679545148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030022070 con 0x55a019c529d0 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f90267fc640 1 -- 172.21.15.17:0/679545148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9030003e70 con 0x55a019c529d0 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.996+0000 7f90267fc640 1 -- 172.21.15.17:0/679545148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030015070 con 0x55a019c529d0 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- 172.21.15.17:0/679545148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 msgr2=0x55a019c6ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9030004700 tx=0x7f903000bde0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- 172.21.15.17:0/679545148 shutdown_connections 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019c6db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c532f0 0x55a019c6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 --2- 172.21.15.17:0/679545148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c529d0 0x55a019c6ef70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- 172.21.15.17:0/679545148 >> 172.21.15.17:0/679545148 conn(0x55a019c4ef60 msgr2=0x55a019c555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- 172.21.15.17:0/679545148 shutdown_connections 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- 172.21.15.17:0/679545148 wait complete. 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.997+0000 7f904511d740 1 -- start start 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 Processor -- start 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c70e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019cd68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6f4c0 con 0x55a019c532f0 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6edf0 con 0x55a019c529d0 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a019c6fb90 con 0x55a019c5dbb0 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f904511d740 10 client.0 _ll_register_callbacks cb 0x7f9034009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47224/0 (socket says 172.21.15.17:47224) 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 -- 172.21.15.17:0/3747372319 learned_addr learned my addr 172.21.15.17:0/3747372319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f90412e1640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019cd68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c70e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 -- 172.21.15.17:0/3747372319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 msgr2=0x55a019cd68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019cd68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 -- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 msgr2=0x55a019c70e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c70e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f903bfff640 1 -- 172.21.15.17:0/3747372319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a019cd6e10 con 0x55a019c532f0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.998+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f903bfff640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9028097610 tx=0x7f9028017f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36e20f8b8b8bed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280a7030 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9028085070 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9030003e70 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f902801e070 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 10 client.14979 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a019cd8000 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9030003e70 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f90280aa970 con 0x55a019c532f0 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 10 client.14979 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 10 client.14979 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 20 client.14979 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019cdc960 0x55a019cdb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 4 client.14979 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:41:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:53.999+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "status"}) -- 0x55a019bc0b10 con 0x55a019cdc960 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019cdc960 0x55a019cdb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f9040ae0640 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019cdc960 0x55a019cdb670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=79f961e35f2f7b9f server_cookie=be7b28b61571f8d5 in_seq=0 out_seq=0 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f901bfff640 10 client.14979 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f901bfff640 1 -- 172.21.15.17:0/3747372319 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55a019bc0b10 con 0x55a019cdc960 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f901bfff640 10 client.14979 handle_command_reply: tid=0 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 client.14979 shutdown 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 msgr2=0x55a019c71370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9028097610 tx=0x7f9028017f30 comp rx=0 tx=0).stop 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 shutdown_connections 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55a019cdc960 0x55a019cdb670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a019c5dbb0 0x55a019cd68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a019c532f0 0x55a019c71370 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f901bfff640 0 client.14979 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 --2- 172.21.15.17:0/3747372319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a019c529d0 0x55a019c70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.000+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 >> 172.21.15.17:0/3747372319 conn(0x55a019c4ef60 msgr2=0x55a019c55de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 shutdown_connections 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f904511d740 1 -- 172.21.15.17:0/3747372319 wait complete. 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f904511d740 20 client.14979 trim_cache size 0 max 16384 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-09-10T11:41:54.017 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24485, 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 63.471806762, 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 96.340439930000002 2024-09-10T11:41:54.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 msgr2=0x7f902c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 0x7f902c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9034009a60 tx=0x7f903402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 msgr2=0x7f903c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f902800b4a0 tx=0x7f902800b960 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 shutdown_connections 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f902c0a2c10 0x7f902c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f903c106f10 0x7f903c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c102790 0x7f903c1989b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 --2- 172.21.15.17:0/1997871358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f903c101de0 0x7f903c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 >> 172.21.15.17:0/1997871358 conn(0x7f903c0fd8c0 msgr2=0x7f903c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 shutdown_connections 2024-09-10T11:41:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:54.001+0000 7f9042d44640 1 -- 172.21.15.17:0/1997871358 wait complete. 2024-09-10T11:41:54.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T11:41:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:55.376 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:55 smithi017 ceph-mon[30817]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 -- 172.21.15.17:0/2586425458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264103720 msgr2=0x7f8264107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 --2- 172.21.15.17:0/2586425458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264103720 0x7f8264107b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8254009930 tx=0x7f825402a420 comp rx=0 tx=0).stop 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 -- 172.21.15.17:0/2586425458 shutdown_connections 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 --2- 172.21.15.17:0/2586425458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82641082a0 0x7f826410ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 --2- 172.21.15.17:0/2586425458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264103720 0x7f8264107b60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 --2- 172.21.15.17:0/2586425458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8264102d70 0x7f8264103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 -- 172.21.15.17:0/2586425458 >> 172.21.15.17:0/2586425458 conn(0x7f82640fc7d0 msgr2=0x7f82640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 -- 172.21.15.17:0/2586425458 shutdown_connections 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.457+0000 7f826b407640 1 -- 172.21.15.17:0/2586425458 wait complete. 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 Processor -- start 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 -- start start 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8264103720 0x7f8264100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82641082a0 0x7f8264101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112040 con 0x7f8264102d70 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8264111ec0 con 0x7f8264103720 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f826b407640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82641121c0 con 0x7f82641082a0 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47242/0 (socket says 172.21.15.17:47242) 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.458+0000 7f82691a3640 1 -- 172.21.15.17:0/2130077114 learned_addr learned my addr 172.21.15.17:0/2130077114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82689a2640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8264103720 0x7f8264100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82699a4640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82641082a0 0x7f8264101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 -- 172.21.15.17:0/2130077114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82641082a0 msgr2=0x7f8264101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82641082a0 0x7f8264101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 -- 172.21.15.17:0/2130077114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8264103720 msgr2=0x7f8264100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8264103720 0x7f8264100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 -- 172.21.15.17:0/2130077114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82641a6a20 con 0x7f8264102d70 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f82691a3640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f826000c920 tx=0x7f826000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f825a7fc640 1 -- 172.21.15.17:0/2130077114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260007c70 con 0x7f8264102d70 2024-09-10T11:41:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f825a7fc640 1 -- 172.21.15.17:0/2130077114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8260007e10 con 0x7f8264102d70 2024-09-10T11:41:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82641a6d10 con 0x7f8264102d70 2024-09-10T11:41:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f825a7fc640 1 -- 172.21.15.17:0/2130077114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260018890 con 0x7f8264102d70 2024-09-10T11:41:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.459+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82641a71c0 con 0x7f8264102d70 2024-09-10T11:41:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.462+0000 7f825a7fc640 1 -- 172.21.15.17:0/2130077114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8260018a70 con 0x7f8264102d70 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.462+0000 7f826d7e0740 1 Processor -- start 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.462+0000 7f826d7e0740 1 -- start start 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.462+0000 7f825a7fc640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 0x7f82500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 0x55c84986edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f825a7fc640 1 -- 172.21.15.17:0/2130077114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f82600cf310 con 0x7f8264102d70 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82699a4640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 0x7f82500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c84987bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c8497d5090 con 0x55c84986f2f0 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c84977ca70 con 0x55c84986e9d0 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f826d7e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8497d1050 con 0x55c849879bb0 2024-09-10T11:41:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47250/0 (socket says 172.21.15.17:47250) 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 -- 172.21.15.17:0/2647854373 learned_addr learned my addr 172.21.15.17:0/2647854373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82699a4640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c84987bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82691a3640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 0x55c84986edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 -- 172.21.15.17:0/2647854373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 msgr2=0x55c84987bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c84987bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 -- 172.21.15.17:0/2647854373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 msgr2=0x55c84986edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 0x55c84986edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 -- 172.21.15.17:0/2647854373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c849789130 con 0x55c84986f2f0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82691a3640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 0x55c84986edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82699a4640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 0x7f82500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f825c005c40 tx=0x7f825c013970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f82689a2640 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8254009900 tx=0x7f8254032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4bd1d3184db9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.463+0000 7f824f7fe640 1 -- 172.21.15.17:0/2647854373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254040070 con 0x55c84986f2f0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f824f7fe640 1 -- 172.21.15.17:0/2647854373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82540317b0 con 0x55c84986f2f0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f824f7fe640 1 -- 172.21.15.17:0/2647854373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254035040 con 0x55c84986f2f0 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 -- 172.21.15.17:0/2647854373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 msgr2=0x55c849879670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8254009900 tx=0x7f8254032cb0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 -- 172.21.15.17:0/2647854373 shutdown_connections 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c84987bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986f2f0 0x55c849879670 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 --2- 172.21.15.17:0/2647854373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986e9d0 0x55c84986edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 -- 172.21.15.17:0/2647854373 >> 172.21.15.17:0/2647854373 conn(0x55c84986af60 msgr2=0x55c84986b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 -- 172.21.15.17:0/2647854373 shutdown_connections 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.464+0000 7f826d7e0740 1 -- 172.21.15.17:0/2647854373 wait complete. 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 -- start start 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 Processor -- start 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986f2f0 0x55c8498766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 0x55c849876c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c84987c780 con 0x55c84986e9d0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c84978ff20 con 0x55c849879bb0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c84987c900 con 0x55c84986f2f0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f826d7e0740 10 client.0 _ll_register_callbacks cb 0x55c849759030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47256/0 (socket says 172.21.15.17:47256) 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f82691a3640 1 -- 172.21.15.17:0/268396907 learned_addr learned my addr 172.21.15.17:0/268396907 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f82699a4640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 0x55c849876c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.465+0000 7f82689a2640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986f2f0 0x55c8498766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 -- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986f2f0 msgr2=0x55c8498766c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986f2f0 0x55c8498766c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 -- 172.21.15.17:0/268396907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 msgr2=0x55c849876c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 0x55c849876c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 -- 172.21.15.17:0/268396907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8495462b0 con 0x55c84986e9d0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82699a4640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 0x55c849876c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f82691a3640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8260097e80 tx=0x7f826009bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405ba491ffb590d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f824cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600b3070 con 0x55c84986e9d0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f826000fb30 con 0x55c84986e9d0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82540317b0 con 0x55c84986e9d0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f82600a4200 con 0x55c84986e9d0 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f826d7e0740 10 client.14991 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c849887fe0 con 0x55c84986e9d0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.466+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82540317b0 con 0x55c84986e9d0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f826009af00 con 0x55c84986e9d0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 10 client.14991 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 10 client.14991 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 20 client.14991 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c84988ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 4 client.14991 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8497e2600 con 0x55c84988a5c0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f82689a2640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c84988ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f82689a2640 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c84988ba30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bb48e1746e729679 server_cookie=e79336b945923c26 in_seq=0 out_seq=0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.467+0000 7f824cff9640 10 client.14991 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f824cff9640 1 -- 172.21.15.17:0/268396907 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8497e2600 con 0x55c84988a5c0 2024-09-10T11:41:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f824cff9640 10 client.14991 handle_command_reply: tid=0 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 client.14991 shutdown 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 msgr2=0x55c849879370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8260097e80 tx=0x7f826009bae0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 shutdown_connections 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c84988ba30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f824cff9640 0 client.14991 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986f2f0 0x55c8498766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c849879bb0 0x55c849876c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 --2- 172.21.15.17:0/268396907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c849879370 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.468+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 >> 172.21.15.17:0/268396907 conn(0x55c84986af60 msgr2=0x55c849870c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.469+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 shutdown_connections 2024-09-10T11:41:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.469+0000 7f826d7e0740 1 -- 172.21.15.17:0/268396907 wait complete. 2024-09-10T11:41:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.469+0000 7f826d7e0740 20 client.14991 trim_cache size 0 max 16384 2024-09-10T11:41:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.486+0000 7f826d7e0740 1 Processor -- start 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.486+0000 7f826d7e0740 1 -- start start 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849874f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c8498754d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c849889d70 con 0x55c84986e9d0 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c84988a440 con 0x55c84986f2f0 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f826d7e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c84988ab10 con 0x55c849879bb0 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47258/0 (socket says 172.21.15.17:47258) 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 -- 172.21.15.17:0/3413290984 learned_addr learned my addr 172.21.15.17:0/3413290984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82689a2640 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849874f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 -- 172.21.15.17:0/3413290984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 msgr2=0x55c8498754d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c8498754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 -- 172.21.15.17:0/3413290984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 msgr2=0x55c849874f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849874f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 -- 172.21.15.17:0/3413290984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8498796e0 con 0x55c84986e9d0 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f82691a3640 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f826000c8f0 tx=0x7f826000ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcb3a62cfa14489 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f824effd640 1 -- 172.21.15.17:0/3413290984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600b3050 con 0x55c84986e9d0 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.487+0000 7f824effd640 1 -- 172.21.15.17:0/3413290984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826000fb30 con 0x55c84986e9d0 2024-09-10T11:41:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f824effd640 1 -- 172.21.15.17:0/3413290984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82600ba2b0 con 0x55c84986e9d0 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 -- 172.21.15.17:0/3413290984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 msgr2=0x55c84988ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f826000c8f0 tx=0x7f826000ff30 comp rx=0 tx=0).stop 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 -- 172.21.15.17:0/3413290984 shutdown_connections 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c849879bb0 0x55c8498754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849874f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3413290984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c84986e9d0 0x55c84988ba30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 -- 172.21.15.17:0/3413290984 >> 172.21.15.17:0/3413290984 conn(0x55c84986af60 msgr2=0x55c849875c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 -- 172.21.15.17:0/3413290984 shutdown_connections 2024-09-10T11:41:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.488+0000 7f826d7e0740 1 -- 172.21.15.17:0/3413290984 wait complete. 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 -- start start 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 Processor -- start 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986e9d0 0x55c8498730d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849873610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c84988b8b0 con 0x55c849879bb0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c84988b1e0 con 0x55c84986f2f0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c84988bf80 con 0x55c84986e9d0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f826d7e0740 10 client.0 _ll_register_callbacks cb 0x7f826009c190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f82699a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f82689a2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849873610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f82699a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47270/0 (socket says 172.21.15.17:47270) 2024-09-10T11:41:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.489+0000 7f82699a4640 1 -- 172.21.15.17:0/3004465903 learned_addr learned my addr 172.21.15.17:0/3004465903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82691a3640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986e9d0 0x55c8498730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 -- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986e9d0 msgr2=0x55c8498730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986e9d0 0x55c8498730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 -- 172.21.15.17:0/3004465903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 msgr2=0x55c849892cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 -- 172.21.15.17:0/3004465903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c849893330 con 0x55c84986f2f0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82699a4640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f82689a2640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849873610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f825402a940 tx=0x7f8254005310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5bbfde85b5238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f824cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254035040 con 0x55c84986f2f0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f826000fb30 con 0x55c84986f2f0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f825404d3a0 con 0x55c84986f2f0 2024-09-10T11:41:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8254040040 con 0x55c84986f2f0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f826d7e0740 10 client.24767 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.490+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c849894610 con 0x55c84986f2f0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826000fb30 con 0x55c84986f2f0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8254004970 con 0x55c84986f2f0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 10 client.24767 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 10 client.24767 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 20 client.24767 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c8498f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 4 client.24767 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "status"}) -- 0x55c8497dcb10 con 0x55c84988a5c0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f82691a3640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c8498f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f82691a3640 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c8498f7bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f75b7fa652c8e97e server_cookie=b5b99bb40256e5a0 in_seq=0 out_seq=0 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.491+0000 7f824cff9640 10 client.24767 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f824cff9640 1 -- 172.21.15.17:0/3004465903 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c8497dcb10 con 0x55c84988a5c0 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f824cff9640 10 client.24767 handle_command_reply: tid=0 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 client.24767 shutdown 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 msgr2=0x55c849873610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849873610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f825402a940 tx=0x7f8254005310 comp rx=0 tx=0).stop 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 shutdown_connections 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55c84988a5c0 0x55c8498f7bc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c849879bb0 0x55c849892cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c84986f2f0 0x55c849873610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f824cff9640 0 client.24767 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 --2- 172.21.15.17:0/3004465903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c84986e9d0 0x55c8498730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 >> 172.21.15.17:0/3004465903 conn(0x55c84986af60 msgr2=0x55c849876680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 shutdown_connections 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 1 -- 172.21.15.17:0/3004465903 wait complete. 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.492+0000 7f826d7e0740 20 client.24767 trim_cache size 0 max 16384 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24496, 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:41:55.499 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 65.970239739999997, 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 102.907807189 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:41:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 msgr2=0x7f82500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 0x7f82500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f825c005c40 tx=0x7f825c013970 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 msgr2=0x7f82641009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f826000c920 tx=0x7f826000cde0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 shutdown_connections 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82500a2c10 0x7f82500a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82641082a0 0x7f8264101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8264103720 0x7f8264100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 --2- 172.21.15.17:0/2130077114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8264102d70 0x7f82641009d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 >> 172.21.15.17:0/2130077114 conn(0x7f82640fc7d0 msgr2=0x7f8264105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 shutdown_connections 2024-09-10T11:41:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:55.493+0000 7f826b407640 1 -- 172.21.15.17:0/2130077114 wait complete. 2024-09-10T11:41:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:55 smithi081 ceph-mon[35059]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:55.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:55 smithi026 ceph-mon[34817]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:41:56.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T11:41:56.461 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 -- 172.21.15.17:0/1272530989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 msgr2=0x7f8eb010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 --2- 172.21.15.17:0/1272530989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb010ec70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009cd0 tx=0x7f8ea802a8d0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 -- 172.21.15.17:0/1272530989 shutdown_connections 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 --2- 172.21.15.17:0/1272530989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb010ec70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 --2- 172.21.15.17:0/1272530989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 --2- 172.21.15.17:0/1272530989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 0x7f8eb01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 -- 172.21.15.17:0/1272530989 >> 172.21.15.17:0/1272530989 conn(0x7f8eb00fc7d0 msgr2=0x7f8eb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 -- 172.21.15.17:0/1272530989 shutdown_connections 2024-09-10T11:41:56.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 -- 172.21.15.17:0/1272530989 wait complete. 2024-09-10T11:41:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.915+0000 7f8eb487a640 1 Processor -- start 2024-09-10T11:41:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 -- start start 2024-09-10T11:41:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 0x7f8eb01a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb01a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01120d0 con 0x7f8eb0108300 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0111f50 con 0x7f8eb0103780 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eb487a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0112250 con 0x7f8eb0102dd0 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47294/0 (socket says 172.21.15.17:47294) 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 -- 172.21.15.17:0/313664435 learned_addr learned my addr 172.21.15.17:0/313664435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eae59c640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 0x7f8eb01a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb01a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 -- 172.21.15.17:0/313664435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 msgr2=0x7f8eb01a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 0x7f8eb01a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 -- 172.21.15.17:0/313664435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 msgr2=0x7f8eb01a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb01a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 -- 172.21.15.17:0/313664435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb019acd0 con 0x7f8eb0108300 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb01a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.916+0000 7f8eaed9d640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009ca0 tx=0x7f8ea802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.917+0000 7f8e9f7fe640 1 -- 172.21.15.17:0/313664435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8031860 con 0x7f8eb0108300 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.917+0000 7f8e9f7fe640 1 -- 172.21.15.17:0/313664435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea8003e50 con 0x7f8eb0108300 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.917+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb019af60 con 0x7f8eb0108300 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.917+0000 7f8e9f7fe640 1 -- 172.21.15.17:0/313664435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea80307f0 con 0x7f8eb0108300 2024-09-10T11:41:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.917+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb01a72b0 con 0x7f8eb0108300 2024-09-10T11:41:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.919+0000 7f8e9f7fe640 1 -- 172.21.15.17:0/313664435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ea80041d0 con 0x7f8eb0108300 2024-09-10T11:41:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.919+0000 7f8eb6c53740 1 Processor -- start 2024-09-10T11:41:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 -- start start 2024-09-10T11:41:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ccedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ed1c35090 con 0x557ed1cd9bb0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557ed1bdca70 con 0x557ed1ccf2f0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ed1c31050 con 0x557ed1cce9d0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47306/0 (socket says 172.21.15.17:47306) 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3495286855 learned_addr learned my addr 172.21.15.17:0/3495286855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8e9f7fe640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 0x7f8e980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ccedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eae59c640 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.920+0000 7f8eaed9d640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 0x7f8e980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8e9f7fe640 1 -- 172.21.15.17:0/313664435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8ea80f0100 con 0x7f8eb0108300 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3495286855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 msgr2=0x557ed1ccedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ccedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3495286855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 msgr2=0x557ed1cd9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3495286855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed1be9130 con 0x557ed1cd9bb0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4013830 tx=0x7f8ea400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbdb48ec03cc724 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8e9cff9640 1 -- 172.21.15.17:0/3495286855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400b860 con 0x557ed1cd9bb0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8eaed9d640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 0x7f8e980a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b8d20 tx=0x7f8ea808e9f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8e9cff9640 1 -- 172.21.15.17:0/3495286855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea40103d0 con 0x557ed1cd9bb0 2024-09-10T11:41:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.921+0000 7f8e9cff9640 1 -- 172.21.15.17:0/3495286855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011640 con 0x557ed1cd9bb0 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3495286855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 msgr2=0x557ed1cdbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4013830 tx=0x7f8ea400ef90 comp rx=0 tx=0).stop 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3495286855 shutdown_connections 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1cdbfa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3495286855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ccedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3495286855 >> 172.21.15.17:0/3495286855 conn(0x557ed1ccaf60 msgr2=0x557ed1ccb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3495286855 shutdown_connections 2024-09-10T11:41:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3495286855 wait complete. 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 -- start start 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.922+0000 7f8eb6c53740 1 Processor -- start 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1cd6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ed1cdc780 con 0x557ed1cce9d0 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557ed1beff20 con 0x557ed1cd9bb0 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ed1cdc900 con 0x557ed1ccf2f0 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eb6c53740 10 client.0 _ll_register_callbacks cb 0x557ed1bb9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47318/0 (socket says 172.21.15.17:47318) 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3513035905 learned_addr learned my addr 172.21.15.17:0/3513035905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eae59c640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1cd6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1ccf2f0 msgr2=0x557ed1cd6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3513035905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 msgr2=0x557ed1cd6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1cd6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 -- 172.21.15.17:0/3513035905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed19a62b0 con 0x557ed1cce9d0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005f30 tx=0x7f8ea4010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4552b50d5c8fcdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.923+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4013050 con 0x557ed1cce9d0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8ea40131f0 con 0x557ed1cce9d0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea40103d0 con 0x557ed1cce9d0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ea40133f0 con 0x557ed1cce9d0 2024-09-10T11:41:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 10 client.15009 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed1ce8150 con 0x557ed1cce9d0 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea40103d0 con 0x557ed1cce9d0 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8ea402a060 con 0x557ed1cce9d0 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 10 client.15009 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 10 client.15009 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 20 client.15009 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1cea410 0x557ed1ceb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 4 client.15009 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.924+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ed1c42600 con 0x557ed1cea410 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.925+0000 7f8eae59c640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1cea410 0x557ed1ceb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.925+0000 7f8eae59c640 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1cea410 0x557ed1ceb880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5ea8d759c32cc41 server_cookie=d15eff04a1f86c0d in_seq=0 out_seq=0 2024-09-10T11:41:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.925+0000 7f8e95ffb640 10 client.15009 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8e95ffb640 1 -- 172.21.15.17:0/3513035905 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ed1c42600 con 0x557ed1cea410 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8e95ffb640 10 client.15009 handle_command_reply: tid=0 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 client.15009 shutdown 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 msgr2=0x557ed1cd9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005f30 tx=0x7f8ea4010e50 comp rx=0 tx=0).stop 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 shutdown_connections 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1cea410 0x557ed1ceb880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1cd6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/3513035905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cce9d0 0x557ed1cd9500 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8e95ffb640 0 client.15009 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 >> 172.21.15.17:0/3513035905 conn(0x557ed1ccaf60 msgr2=0x557ed1cd0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 shutdown_connections 2024-09-10T11:41:56.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 1 -- 172.21.15.17:0/3513035905 wait complete. 2024-09-10T11:41:56.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.926+0000 7f8eb6c53740 20 client.15009 trim_cache size 0 max 16384 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 Processor -- start 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 -- start start 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ed1ce9bc0 con 0x557ed1cd9bb0 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557ed1cea290 con 0x557ed1ccf2f0 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ed1cea960 con 0x557ed1cce9d0 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eadd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47332/0 (socket says 172.21.15.17:47332) 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eadd9b640 1 -- 172.21.15.17:0/1794013352 learned_addr learned my addr 172.21.15.17:0/1794013352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.944+0000 7f8eae59c640 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 -- 172.21.15.17:0/1794013352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 msgr2=0x557ed1ceb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 -- 172.21.15.17:0/1794013352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 msgr2=0x557ed1cd6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 -- 172.21.15.17:0/1794013352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed1ce99e0 con 0x557ed1cd9bb0 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ec00 tx=0x7f8ea4010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a45ae232042987e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8e97fff640 1 -- 172.21.15.17:0/1794013352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40103d0 con 0x557ed1cd9bb0 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8e97fff640 1 -- 172.21.15.17:0/1794013352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea402c480 con 0x557ed1cd9bb0 2024-09-10T11:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.945+0000 7f8e97fff640 1 -- 172.21.15.17:0/1794013352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea402ce70 con 0x557ed1cd9bb0 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1794013352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 msgr2=0x557ed1ce94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400ec00 tx=0x7f8ea4010c50 comp rx=0 tx=0).stop 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1794013352 shutdown_connections 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1cd9bb0 0x557ed1ce94a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1ccf2f0 0x557ed1cd6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1794013352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1794013352 >> 172.21.15.17:0/1794013352 conn(0x557ed1ccaf60 msgr2=0x557ed1ccb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1794013352 shutdown_connections 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1794013352 wait complete. 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- start start 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 Processor -- start 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1ced4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ed1ceb700 con 0x557ed1ccf2f0 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557ed1ceb030 con 0x557ed1cd9bb0 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557ed1cebdd0 con 0x557ed1cce9d0 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eb6c53740 10 client.0 _ll_register_callbacks cb 0x7f8ea0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47348/0 (socket says 172.21.15.17:47348) 2024-09-10T11:41:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.946+0000 7f8eae59c640 1 -- 172.21.15.17:0/1177879780 learned_addr learned my addr 172.21.15.17:0/1177879780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1ced4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 -- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 msgr2=0x557ed1ceca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 -- 172.21.15.17:0/1177879780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 msgr2=0x557ed1ced4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1ced4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 -- 172.21.15.17:0/1177879780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed1d52cc0 con 0x557ed1ccf2f0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eae59c640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557ed1ccbdc0 tx=0x7f8ea00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e660acc81062572 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011640 con 0x557ed1ccf2f0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8ea00117e0 con 0x557ed1ccf2f0 2024-09-10T11:41:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ed1c3cb10 con 0x557ed1ccf2f0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ea00119e0 con 0x557ed1ccf2f0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eb6c53740 10 client.15015 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.947+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed1d54050 con 0x557ed1ccf2f0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557ed1c3cb10 con 0x557ed1ccf2f0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8ea001d3f0 con 0x557ed1ccf2f0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 10 client.15015 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 10 client.15015 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 20 client.15015 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1d58c10 0x557ed1d57920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 4 client.15015 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "status"}) -- 0x557ed1bb90e0 con 0x557ed1d58c10 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.948+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1d58c10 0x557ed1d57920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8e95ffb640 10 client.15015 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eadd9b640 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1d58c10 0x557ed1d57920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85ea7cc333a22e46 server_cookie=adec0e0a116ef32 in_seq=0 out_seq=0 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8e95ffb640 1 -- 172.21.15.17:0/1177879780 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557ed1bb90e0 con 0x557ed1d58c10 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8e95ffb640 10 client.15015 handle_command_reply: tid=0 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 client.15015 shutdown 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 msgr2=0x557ed1cecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557ed1ccbdc0 tx=0x7f8ea00039c0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 shutdown_connections 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557ed1d58c10 0x557ed1d57920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557ed1cd9bb0 0x557ed1ced4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ed1ccf2f0 0x557ed1cecfb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 --2- 172.21.15.17:0/1177879780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ed1cce9d0 0x557ed1ceca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 >> 172.21.15.17:0/1177879780 conn(0x557ed1ccaf60 msgr2=0x557ed1cd5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8e95ffb640 0 client.15015 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 shutdown_connections 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 1 -- 172.21.15.17:0/1177879780 wait complete. 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.949+0000 7f8eb6c53740 20 client.15015 trim_cache size 0 max 16384 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24508, 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:41:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 68.436154211000002, 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 101.920985738 2024-09-10T11:41:56.957 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 msgr2=0x7f8e980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 0x7f8e980a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b8d20 tx=0x7f8ea808e9f0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 msgr2=0x7f8eb019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009ca0 tx=0x7f8ea802f420 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 shutdown_connections 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8e980a2c10 0x7f8e980a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8eb0108300 0x7f8eb019a5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8eb0103780 0x7f8eb01a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 --2- 172.21.15.17:0/313664435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8eb0102dd0 0x7f8eb01a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 >> 172.21.15.17:0/313664435 conn(0x7f8eb00fc7d0 msgr2=0x7f8eb01014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:56.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 shutdown_connections 2024-09-10T11:41:56.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:56.950+0000 7f8eb487a640 1 -- 172.21.15.17:0/313664435 wait complete. 2024-09-10T11:41:57.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:57 smithi017 ceph-mon[30817]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:57.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:57 smithi081 ceph-mon[35059]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:57.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T11:41:57.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:57 smithi026 ceph-mon[34817]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:41:57.971 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 -- 172.21.15.17:0/583355461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a010c170 msgr2=0x7f35a010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 --2- 172.21.15.17:0/583355461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a010c170 0x7f35a010e610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3598009ca0 tx=0x7f359802a950 comp rx=0 tx=0).stop 2024-09-10T11:41:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 -- 172.21.15.17:0/583355461 shutdown_connections 2024-09-10T11:41:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 --2- 172.21.15.17:0/583355461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a0103660 0x7f35a010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 --2- 172.21.15.17:0/583355461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a010c170 0x7f35a010e610 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 --2- 172.21.15.17:0/583355461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0102d40 0x7f35a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 -- 172.21.15.17:0/583355461 >> 172.21.15.17:0/583355461 conn(0x7f35a00fc7a0 msgr2=0x7f35a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 -- 172.21.15.17:0/583355461 shutdown_connections 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.472+0000 7f35a4825640 1 -- 172.21.15.17:0/583355461 wait complete. 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 Processor -- start 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 -- start start 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 0x7f35a0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a010c170 0x7f35a019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f35a0111f50 con 0x7f35a0102d40 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35a0111dd0 con 0x7f35a0103660 2024-09-10T11:41:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f35a4825640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35a01120d0 con 0x7f35a010c170 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.473+0000 7f359e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47360/0 (socket says 172.21.15.17:47360) 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 -- 172.21.15.17:0/612270204 learned_addr learned my addr 172.21.15.17:0/612270204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359ed9d640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a010c170 0x7f35a019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f3597fff640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 0x7f35a0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 -- 172.21.15.17:0/612270204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a010c170 msgr2=0x7f35a019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a010c170 0x7f35a019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 -- 172.21.15.17:0/612270204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 msgr2=0x7f35a0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 0x7f35a0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 -- 172.21.15.17:0/612270204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a019d3b0 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f3597fff640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 0x7f35a0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f359e59c640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f359000e9f0 tx=0x7f359000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f35977fe640 1 -- 172.21.15.17:0/612270204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359000cd80 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a019d6a0 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f35977fe640 1 -- 172.21.15.17:0/612270204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3590010910 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f35977fe640 1 -- 172.21.15.17:0/612270204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900188f0 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.474+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a01a4f80 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.476+0000 7f35977fe640 1 -- 172.21.15.17:0/612270204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3590010ac0 con 0x7f35a0102d40 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 Processor -- start 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 -- start start 2024-09-10T11:41:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35977fe640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 0x7f358c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09330ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f0933203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f093275090 con 0x55f09330f1d0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f09321ca70 con 0x55f09330e8b0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f093271050 con 0x55f09331dfc0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f359ed9d640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 0x7f358c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f35977fe640 1 -- 172.21.15.17:0/612270204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f35900cf660 con 0x7f35a0102d40 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47372/0 (socket says 172.21.15.17:47372) 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f3597fff640 1 -- 172.21.15.17:0/2337384065 learned_addr learned my addr 172.21.15.17:0/2337384065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.477+0000 7f359e59c640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09330ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359ed9d640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f0933203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 -- 172.21.15.17:0/2337384065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 msgr2=0x55f0933203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f0933203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 -- 172.21.15.17:0/2337384065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 msgr2=0x55f09331da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 -- 172.21.15.17:0/2337384065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f093229130 con 0x55f09330e8b0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f3597fff640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359ed9d640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 0x7f358c0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3598005e30 tx=0x7f359802fa20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f359e59c640 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09330ec90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35900ccfc0 tx=0x7f359009c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=752436a5e4707e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f3594ff9640 1 -- 172.21.15.17:0/2337384065 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900a4980 con 0x55f09330e8b0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f3594ff9640 1 -- 172.21.15.17:0/2337384065 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f359009a010 con 0x55f09330e8b0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.478+0000 7f3594ff9640 1 -- 172.21.15.17:0/2337384065 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359009b160 con 0x55f09330e8b0 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2337384065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 msgr2=0x55f09330ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09330ec90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35900ccfc0 tx=0x7f359009c4d0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2337384065 shutdown_connections 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f0933203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2337384065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09330ec90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2337384065 >> 172.21.15.17:0/2337384065 conn(0x55f09330af60 msgr2=0x55f09330b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2337384065 shutdown_connections 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.479+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2337384065 wait complete. 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 -- start start 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 Processor -- start 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09331d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f09331b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f093320b30 con 0x55f09330f1d0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f09322ff20 con 0x55f09330e8b0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f093320cb0 con 0x55f09331dfc0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f35a6bfe740 10 client.0 _ll_register_callbacks cb 0x55f0931f9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47382/0 (socket says 172.21.15.17:47382) 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 -- 172.21.15.17:0/2086942364 learned_addr learned my addr 172.21.15.17:0/2086942364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f359e59c640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09331d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f359ed9d640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f09331b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 -- 172.21.15.17:0/2086942364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 msgr2=0x55f09331b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f09331b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 -- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 msgr2=0x55f09331d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09331d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f3597fff640 1 -- 172.21.15.17:0/2086942364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f092fe62b0 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.480+0000 7f359ed9d640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f09331b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3597fff640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35880136e0 tx=0x7f3588013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38c5556963faa0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588011c20 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3588011dc0 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f359009a010 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f358801b3f0 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 10 client.15027 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f09332c540 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f359009a010 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f358801a030 con 0x55f09330f1d0 2024-09-10T11:41:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 10 client.15027 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 10 client.15027 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.481+0000 7f35a6bfe740 20 client.15027 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f0933300b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f35a6bfe740 4 client.15027 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f093282600 con 0x55f09332ec40 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f359e59c640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f0933300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f359e59c640 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f0933300b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a6f6281439c31b5 server_cookie=8b89c7c6d710ef33 in_seq=0 out_seq=0 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.482+0000 7f3585ffb640 10 client.15027 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f3585ffb640 1 -- 172.21.15.17:0/2086942364 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f093282600 con 0x55f09332ec40 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f3585ffb640 10 client.15027 handle_command_reply: tid=0 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 client.15027 shutdown 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 msgr2=0x55f09331ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f35880136e0 tx=0x7f3588013ba0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 shutdown_connections 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f0933300b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09331dfc0 0x55f09331b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f09331ac00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f3585ffb640 0 client.15027 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/2086942364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09330e8b0 0x55f09331d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 >> 172.21.15.17:0/2086942364 conn(0x55f09330af60 msgr2=0x55f093310cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 shutdown_connections 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 1 -- 172.21.15.17:0/2086942364 wait complete. 2024-09-10T11:41:58.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.483+0000 7f35a6bfe740 20 client.15027 trim_cache size 0 max 16384 2024-09-10T11:41:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 Processor -- start 2024-09-10T11:41:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 -- start start 2024-09-10T11:41:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093317e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f0933194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f09332e3f0 con 0x55f09330f1d0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f09332eac0 con 0x55f09331dfc0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f09332f190 con 0x55f09330e8b0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47384/0 (socket says 172.21.15.17:47384) 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 -- 172.21.15.17:0/3672408044 learned_addr learned my addr 172.21.15.17:0/3672408044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f359e59c640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093317e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 -- 172.21.15.17:0/3672408044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 msgr2=0x55f093317e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093317e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 -- 172.21.15.17:0/3672408044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 msgr2=0x55f0933194d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f359ed9d640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f0933194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f0933194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 -- 172.21.15.17:0/3672408044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f09330f000 con 0x55f09330f1d0 2024-09-10T11:41:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f359e59c640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093317e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.502+0000 7f3597fff640 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3588010960 tx=0x7f3588010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2b2776c5adc77e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f3587fff640 1 -- 172.21.15.17:0/3672408044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588033070 con 0x55f09330f1d0 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f3587fff640 1 -- 172.21.15.17:0/3672408044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35880103d0 con 0x55f09330f1d0 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f3587fff640 1 -- 172.21.15.17:0/3672408044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358802a040 con 0x55f09330f1d0 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 -- 172.21.15.17:0/3672408044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 msgr2=0x55f0933183a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3588010960 tx=0x7f3588010fd0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 -- 172.21.15.17:0/3672408044 shutdown_connections 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f0933194d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f0933183a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/3672408044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093317e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 -- 172.21.15.17:0/3672408044 >> 172.21.15.17:0/3672408044 conn(0x55f09330af60 msgr2=0x55f093316240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 -- 172.21.15.17:0/3672408044 shutdown_connections 2024-09-10T11:41:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.503+0000 7f35a6bfe740 1 -- 172.21.15.17:0/3672408044 wait complete. 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 -- start start 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 Processor -- start 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093331850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f093397340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f09332ff30 con 0x55f09330f1d0 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f09332f860 con 0x55f09331dfc0 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f093330600 con 0x55f09330e8b0 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f35a6bfe740 10 client.0 _ll_register_callbacks cb 0x7f3588009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f3597fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47386/0 (socket says 172.21.15.17:47386) 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f3597fff640 1 -- 172.21.15.17:0/559633011 learned_addr learned my addr 172.21.15.17:0/559633011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f359ed9d640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f093397340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.504+0000 7f359e59c640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093331850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 -- 172.21.15.17:0/559633011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 msgr2=0x55f093331850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093331850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 -- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 msgr2=0x55f093397340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f093397340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 -- 172.21.15.17:0/559633011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f093397880 con 0x55f09330f1d0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3597fff640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3588031040 tx=0x7f358801b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64e7708f99b5f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3585ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588033040 con 0x55f09330f1d0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3588011c20 con 0x55f09330f1d0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35880103d0 con 0x55f09330f1d0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f358801b710 con 0x55f09330f1d0 2024-09-10T11:41:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f35a6bfe740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f093398a90 con 0x55f09330f1d0 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.505+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35880103d0 con 0x55f09330f1d0 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f358801a070 con 0x55f09330f1d0 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 10 client.15033 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 20 client.15033 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f09339be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 4 client.15033 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "status"}) -- 0x55f09327cb10 con 0x55f09332ec40 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f359e59c640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f09339be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f359e59c640 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f09339be90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c94c02671536c5be server_cookie=453779e6656b3c14 in_seq=0 out_seq=0 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f3585ffb640 10 client.15033 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f3585ffb640 1 -- 172.21.15.17:0/559633011 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f09327cb10 con 0x55f09332ec40 2024-09-10T11:41:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f3585ffb640 10 client.15033 handle_command_reply: tid=0 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.506+0000 7f35a6bfe740 1 client.15033 shutdown 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 msgr2=0x55f093331d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3588031040 tx=0x7f358801b590 comp rx=0 tx=0).stop 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 shutdown_connections 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55f09332ec40 0x55f09339be90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f09331dfc0 0x55f093397340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f09330f1d0 0x55f093331d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 --2- 172.21.15.17:0/559633011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f09330e8b0 0x55f093331850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 >> 172.21.15.17:0/559633011 conn(0x55f09330af60 msgr2=0x55f0933103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f3585ffb640 0 client.15033 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 shutdown_connections 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 1 -- 172.21.15.17:0/559633011 wait complete. 2024-09-10T11:41:58.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a6bfe740 20 client.15033 trim_cache size 0 max 16384 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24512, 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 70.998342128000004, 2024-09-10T11:41:58.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:41:58.517 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:41:58.517 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:41:58.517 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 89.534800278000006 2024-09-10T11:41:58.517 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 msgr2=0x7f358c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 0x7f358c0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3598005e30 tx=0x7f359802fa20 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 msgr2=0x7f35a0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f359000e9f0 tx=0x7f359000eeb0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 shutdown_connections 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f358c0a2c10 0x7f358c0a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a010c170 0x7f35a019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a0103660 0x7f35a0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 --2- 172.21.15.17:0/612270204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a0102d40 0x7f35a0198400 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.507+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 >> 172.21.15.17:0/612270204 conn(0x7f35a00fc7a0 msgr2=0x7f35a00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.508+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 shutdown_connections 2024-09-10T11:41:58.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:58.508+0000 7f35a4825640 1 -- 172.21.15.17:0/612270204 wait complete. 2024-09-10T11:41:58.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:41:58 smithi081 ceph-mon[35059]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:58.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:41:58 smithi026 ceph-mon[34817]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:58.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:41:58 smithi017 ceph-mon[30817]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:41:59.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T11:41:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.871+0000 7f5d66e47640 1 -- 172.21.15.17:0/272093589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102ef0 msgr2=0x7f5d6010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.871+0000 7f5d66e47640 1 --2- 172.21.15.17:0/272093589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102ef0 0x7f5d6010da40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009900 tx=0x7f5d5802a480 comp rx=0 tx=0).stop 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 -- 172.21.15.17:0/272093589 shutdown_connections 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 --2- 172.21.15.17:0/272093589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102ef0 0x7f5d6010da40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 --2- 172.21.15.17:0/272093589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102570 0x7f5d601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 --2- 172.21.15.17:0/272093589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 0x7f5d60101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 -- 172.21.15.17:0/272093589 >> 172.21.15.17:0/272093589 conn(0x7f5d600fc7d0 msgr2=0x7f5d600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 -- 172.21.15.17:0/272093589 shutdown_connections 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 -- 172.21.15.17:0/272093589 wait complete. 2024-09-10T11:41:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.872+0000 7f5d66e47640 1 Processor -- start 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 -- start start 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 0x7f5d60199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102ef0 0x7f5d601a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60110ff0 con 0x7f5d60102570 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60110e70 con 0x7f5d60102ef0 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d66e47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60111170 con 0x7f5d60100e20 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47404/0 (socket says 172.21.15.17:47404) 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2636986721 learned_addr learned my addr 172.21.15.17:0/2636986721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d64be3640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 0x7f5d60199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d653e4640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102ef0 0x7f5d601a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2636986721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 msgr2=0x7f5d60199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 0x7f5d60199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2636986721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102ef0 msgr2=0x7f5d601a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102ef0 0x7f5d601a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.873+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2636986721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d601a4920 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000cce0 tx=0x7f5d5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d5dffb640 1 -- 172.21.15.17:0/2636986721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50004b20 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d601a4af0 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d5dffb640 1 -- 172.21.15.17:0/2636986721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d50004cc0 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d5dffb640 1 -- 172.21.15.17:0/2636986721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000f7d0 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.874+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d601a5000 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.876+0000 7f5d5dffb640 1 -- 172.21.15.17:0/2636986721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5d5000f970 con 0x7f5d60102570 2024-09-10T11:41:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 Processor -- start 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 -- start start 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fd3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a34f2f090 con 0x559a34fc89d0 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a34ed6a70 con 0x559a34fd3bb0 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d69220740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a34f2b050 con 0x559a34fc92f0 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d5dffb640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 0x7f5d4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d653e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d653e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47406/0 (socket says 172.21.15.17:47406) 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.877+0000 7f5d653e4640 1 -- 172.21.15.17:0/272951816 learned_addr learned my addr 172.21.15.17:0/272951816 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d64be3640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fd3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 0x7f5d4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d5dffb640 1 -- 172.21.15.17:0/2636986721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5d500cf380 con 0x7f5d60102570 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 -- 172.21.15.17:0/272951816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 msgr2=0x559a34fd3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fd3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 -- 172.21.15.17:0/272951816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 msgr2=0x559a34fd5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 -- 172.21.15.17:0/272951816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a34ee3130 con 0x559a34fc89d0 2024-09-10T11:41:59.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d64be3640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fd3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009900 tx=0x7f5d58003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be642f56cd3204a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d653e4640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 0x7f5d4c0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5d58033000 tx=0x7f5d58047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d56ffd640 1 -- 172.21.15.17:0/272951816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58035070 con 0x559a34fc89d0 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d56ffd640 1 -- 172.21.15.17:0/272951816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d58031a20 con 0x559a34fc89d0 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.878+0000 7f5d56ffd640 1 -- 172.21.15.17:0/272951816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5803aa80 con 0x559a34fc89d0 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 -- 172.21.15.17:0/272951816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 msgr2=0x559a34fc8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009900 tx=0x7f5d58003670 comp rx=0 tx=0).stop 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 -- 172.21.15.17:0/272951816 shutdown_connections 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fd3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 --2- 172.21.15.17:0/272951816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc89d0 0x559a34fc8db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 -- 172.21.15.17:0/272951816 >> 172.21.15.17:0/272951816 conn(0x559a34fc4f60 msgr2=0x559a34fc5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 -- 172.21.15.17:0/272951816 shutdown_connections 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.879+0000 7f5d69220740 1 -- 172.21.15.17:0/272951816 wait complete. 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 -- start start 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 Processor -- start 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fd3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a34fd6720 con 0x559a34fd3bb0 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a34ee9f20 con 0x559a34fc92f0 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a34fd68a0 con 0x559a34fc89d0 2024-09-10T11:41:59.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d69220740 10 client.0 _ll_register_callbacks cb 0x559a34eb3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.880+0000 7f5d653e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:40182/0 (socket says 172.21.15.17:40182) 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2776950925 learned_addr learned my addr 172.21.15.17:0/2776950925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d64be3640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fd3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 msgr2=0x559a34fd3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fd3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2776950925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 msgr2=0x559a34fd0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 -- 172.21.15.17:0/2776950925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a34ca02b0 con 0x559a34fc92f0 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d653e4640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:59.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ab20 tx=0x7f5d5001d3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ea3feb8a6dac55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000fe60 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5d500a4210 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d58031a20 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d5009ba30 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d69220740 10 client.24806 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.881+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a34fe20a0 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d58031a20 con 0x559a34fc92f0 2024-09-10T11:41:59.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5d500ce040 con 0x559a34fc92f0 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 10 client.24806 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 10 client.24806 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 20 client.24806 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a34fe4660 0x559a34fe5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 4 client.24806 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a34f3c600 con 0x559a34fe4660 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.882+0000 7f5d64be3640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a34fe4660 0x559a34fe5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.883+0000 7f5d64be3640 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a34fe4660 0x559a34fe5ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c81f4b9bdcc4aa9 server_cookie=78dacaeae516ad24 in_seq=0 out_seq=0 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.883+0000 7f5d3ffff640 10 client.24806 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:41:59.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d3ffff640 1 -- 172.21.15.17:0/2776950925 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a34f3c600 con 0x559a34fe4660 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d3ffff640 10 client.24806 handle_command_reply: tid=0 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 client.24806 shutdown 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 msgr2=0x559a34fd07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ab20 tx=0x7f5d5001d3f0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 shutdown_connections 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a34fe4660 0x559a34fe5ad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc92f0 0x559a34fd07b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d3ffff640 0 client.24806 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 --2- 172.21.15.17:0/2776950925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fd3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 >> 172.21.15.17:0/2776950925 conn(0x559a34fc4f60 msgr2=0x559a34fcac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 shutdown_connections 2024-09-10T11:41:59.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 1 -- 172.21.15.17:0/2776950925 wait complete. 2024-09-10T11:41:59.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.884+0000 7f5d69220740 20 client.24806 trim_cache size 0 max 16384 2024-09-10T11:41:59.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.903+0000 7f5d69220740 1 Processor -- start 2024-09-10T11:41:59.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.903+0000 7f5d69220740 1 -- start start 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fe5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe3e10 con 0x559a34fc92f0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe44e0 con 0x559a34fd3bb0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d69220740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe4bb0 con 0x559a34fc89d0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47434/0 (socket says 172.21.15.17:47434) 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 -- 172.21.15.17:0/4065637317 learned_addr learned my addr 172.21.15.17:0/4065637317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d653e4640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d64be3640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fe5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 -- 172.21.15.17:0/4065637317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 msgr2=0x559a34fe5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fe5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 -- 172.21.15.17:0/4065637317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 msgr2=0x559a34fd0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 -- 172.21.15.17:0/4065637317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a34fc9120 con 0x559a34fc92f0 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d653e4640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d64be3640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fe5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d50097e90 tx=0x7f5d5009c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1f435e9e8595a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d567fc640 1 -- 172.21.15.17:0/4065637317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d500b9070 con 0x559a34fc92f0 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d567fc640 1 -- 172.21.15.17:0/4065637317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d5009fde0 con 0x559a34fc92f0 2024-09-10T11:41:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.904+0000 7f5d567fc640 1 -- 172.21.15.17:0/4065637317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d500a4210 con 0x559a34fc92f0 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 -- 172.21.15.17:0/4065637317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 msgr2=0x559a34fd0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d50097e90 tx=0x7f5d5009c250 comp rx=0 tx=0).stop 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 -- 172.21.15.17:0/4065637317 shutdown_connections 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fd3bb0 0x559a34fd0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fc92f0 0x559a34fd0770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 --2- 172.21.15.17:0/4065637317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc89d0 0x559a34fe5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 -- 172.21.15.17:0/4065637317 >> 172.21.15.17:0/4065637317 conn(0x559a34fc4f60 msgr2=0x559a34fbfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 -- 172.21.15.17:0/4065637317 shutdown_connections 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.905+0000 7f5d69220740 1 -- 172.21.15.17:0/4065637317 wait complete. 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 -- start start 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 Processor -- start 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe5950 con 0x559a34fd3bb0 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe5280 con 0x559a34fc89d0 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a34fe6020 con 0x559a34fc92f0 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d69220740 10 client.0 _ll_register_callbacks cb 0x7f5d50007850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:41:59.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d653e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d64be3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d64be3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:40200/0 (socket says 172.21.15.17:40200) 2024-09-10T11:41:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d64be3640 1 -- 172.21.15.17:0/1230764708 learned_addr learned my addr 172.21.15.17:0/1230764708 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:41:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d653e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47444/0 (socket says 172.21.15.17:47444) 2024-09-10T11:41:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.906+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 -- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 msgr2=0x559a34fec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fec140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 -- 172.21.15.17:0/1230764708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 msgr2=0x559a34fe72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 -- 172.21.15.17:0/1230764708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a34fe79a0 con 0x559a34fc89d0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d653e4640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d64be3640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d50099ce0 tx=0x7f5d4801bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588af70b3497ad3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4801abe0 con 0x559a34fc89d0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5d4801ad80 con 0x559a34fc89d0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d5009fde0 con 0x559a34fc89d0 2024-09-10T11:41:59.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d48026480 con 0x559a34fc89d0 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d69220740 10 client.24812 fetch_fsmap learned FSMap version 27 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559a34feb350 con 0x559a34fc89d0 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.907+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d5009fde0 con 0x559a34fc89d0 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5d48031780 con 0x559a34fc89d0 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 10 client.24812 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 10 client.24812 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 20 client.24812 populate_metadata read hostname 'smithi017' 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a35053340 0x559a35052050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 4 client.24812 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "status"}) -- 0x559a34f36b10 con 0x559a35053340 2024-09-10T11:41:59.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.908+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a35053340 0x559a35052050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d3ffff640 10 client.24812 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d5ffff640 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a35053340 0x559a35052050 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12828a362675ea3f server_cookie=ace5997ff7ed9d8a in_seq=0 out_seq=0 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d3ffff640 1 -- 172.21.15.17:0/1230764708 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559a34f36b10 con 0x559a35053340 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d3ffff640 10 client.24812 handle_command_reply: tid=0 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 client.24812 shutdown 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 msgr2=0x559a34febc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d50099ce0 tx=0x7f5d4801bbf0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 shutdown_connections 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a35053340 0x559a35052050 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a34fc92f0 0x559a34fec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a34fd3bb0 0x559a34fe72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 --2- 172.21.15.17:0/1230764708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a34fc89d0 0x559a34febc00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 >> 172.21.15.17:0/1230764708 conn(0x559a34fc4f60 msgr2=0x559a34fd0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d3ffff640 0 client.24812 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 shutdown_connections 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 1 -- 172.21.15.17:0/1230764708 wait complete. 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.909+0000 7f5d69220740 20 client.24812 trim_cache size 0 max 16384 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24523, 2024-09-10T11:41:59.917 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 79.420470042999995, 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 99.909497852000001 2024-09-10T11:41:59.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 msgr2=0x7f5d4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 0x7f5d4c0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5d58033000 tx=0x7f5d58047000 comp rx=0 tx=0).stop 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 msgr2=0x7f5d601998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000cce0 tx=0x7f5d5000a620 comp rx=0 tx=0).stop 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 shutdown_connections 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5d4c0a2c10 0x7f5d4c0a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d60102ef0 0x7f5d601a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d60102570 0x7f5d601998a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 --2- 172.21.15.17:0/2636986721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d60100e20 0x7f5d60199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 >> 172.21.15.17:0/2636986721 conn(0x7f5d600fc7d0 msgr2=0x7f5d60106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 shutdown_connections 2024-09-10T11:41:59.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:41:59.910+0000 7f5d66e47640 1 -- 172.21.15.17:0/2636986721 wait complete. 2024-09-10T11:42:00.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:00 smithi017 ceph-mon[30817]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:00.673 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T11:42:00.674 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T11:42:00.682 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:42:00.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T11:42:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:00 smithi026 ceph-mon[34817]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:00 smithi081 ceph-mon[35059]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 -- 172.21.15.17:0/1902386182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728102e00 msgr2=0x7f0728103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 --2- 172.21.15.17:0/1902386182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728102e00 0x7f0728103280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f071c009900 tx=0x7f071c02a410 comp rx=0 tx=0).stop 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 -- 172.21.15.17:0/1902386182 shutdown_connections 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 --2- 172.21.15.17:0/1902386182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07281037c0 0x7f072810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 --2- 172.21.15.17:0/1902386182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728102e00 0x7f0728103280 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 --2- 172.21.15.17:0/1902386182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728101c00 0x7f0728102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 -- 172.21.15.17:0/1902386182 >> 172.21.15.17:0/1902386182 conn(0x7f07280fd390 msgr2=0x7f07280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 -- 172.21.15.17:0/1902386182 shutdown_connections 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.446+0000 7f072cd4d640 1 -- 172.21.15.17:0/1902386182 wait complete. 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 Processor -- start 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 -- start start 2024-09-10T11:42:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 0x7f07281983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07281037c0 0x7f072819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f072810d860 con 0x7f0728101c00 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f072810d6e0 con 0x7f0728102e00 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072cd4d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f072810d9e0 con 0x7f07281037c0 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.447+0000 7f072659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47972/0 (socket says 172.21.15.17:47972) 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 -- 172.21.15.17:0/2893845439 learned_addr learned my addr 172.21.15.17:0/2893845439 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f0725d9b640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 0x7f07281983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f0726d9d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07281037c0 0x7f072819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 -- 172.21.15.17:0/2893845439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07281037c0 msgr2=0x7f072819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07281037c0 0x7f072819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 -- 172.21.15.17:0/2893845439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 msgr2=0x7f07281983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 0x7f07281983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 -- 172.21.15.17:0/2893845439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072819fae0 con 0x7f0728101c00 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f0725d9b640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 0x7f07281983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072659c640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f071800d770 tx=0x7f071800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f0728101c00 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0718009c30 con 0x7f0728101c00 2024-09-10T11:42:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072819fdd0 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718003dd0 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.448+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07281a0220 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.449+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0728109050 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.451+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0718004000 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.452+0000 7f07177fe640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 0x7f07100a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.452+0000 7f0725d9b640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 0x7f07100a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.452+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f07180cee80 con 0x7f0728101c00 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.453+0000 7f0725d9b640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 0x7f07100a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f071c0314e0 tx=0x7f071c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.456+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0718009de0 con 0x7f0728101c00 2024-09-10T11:42:01.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.648+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f0728062630 con 0x7f07100a2c40 2024-09-10T11:42:01.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.649+0000 7f07177fe640 1 -- 172.21.15.17:0/2893845439 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0728062630 con 0x7f07100a2c40 2024-09-10T11:42:01.650 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-09-10T11:42:01.651 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-09-10T11:42:01.651 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 msgr2=0x7f07100a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 0x7f07100a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f071c0314e0 tx=0x7f071c000bc0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 msgr2=0x7f0728197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f071800d770 tx=0x7f071800dc30 comp rx=0 tx=0).stop 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 shutdown_connections 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f07100a2c40 0x7f07100a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07281037c0 0x7f072819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0728102e00 0x7f07281983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 --2- 172.21.15.17:0/2893845439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728101c00 0x7f0728197eb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.651+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 >> 172.21.15.17:0/2893845439 conn(0x7f07280fd390 msgr2=0x7f0728106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.652+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 shutdown_connections 2024-09-10T11:42:01.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:01.652+0000 7f072cd4d640 1 -- 172.21.15.17:0/2893845439 wait complete. 2024-09-10T11:42:02.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T11:42:02.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:02 smithi017 ceph-mon[30817]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:02.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:02 smithi017 ceph-mon[30817]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:02.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:02 smithi026 ceph-mon[34817]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:02.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:02 smithi026 ceph-mon[34817]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:02 smithi081 ceph-mon[35059]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:02 smithi081 ceph-mon[35059]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 -- 172.21.15.17:0/2595816967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c104f60 msgr2=0x7fda7c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 --2- 172.21.15.17:0/2595816967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c104f60 0x7fda7c1053e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda64009900 tx=0x7fda6402a410 comp rx=0 tx=0).stop 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 -- 172.21.15.17:0/2595816967 shutdown_connections 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 --2- 172.21.15.17:0/2595816967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c105920 0x7fda7c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 --2- 172.21.15.17:0/2595816967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c104f60 0x7fda7c1053e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 --2- 172.21.15.17:0/2595816967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c103e00 0x7fda7c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 -- 172.21.15.17:0/2595816967 >> 172.21.15.17:0/2595816967 conn(0x7fda7c0ff5b0 msgr2=0x7fda7c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 -- 172.21.15.17:0/2595816967 shutdown_connections 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.027+0000 7fda81f70640 1 -- 172.21.15.17:0/2595816967 wait complete. 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.028+0000 7fda81f70640 1 Processor -- start 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.028+0000 7fda81f70640 1 -- start start 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c104f60 0x7fda7c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 0x7fda7c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c10fae0 con 0x7fda7c103e00 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c10f960 con 0x7fda7c104f60 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c10fc60 con 0x7fda7c105920 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47982/0 (socket says 172.21.15.17:47982) 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 -- 172.21.15.17:0/854076570 learned_addr learned my addr 172.21.15.17:0/854076570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7bfff640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 0x7fda7c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7affd640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c104f60 0x7fda7c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 -- 172.21.15.17:0/854076570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 msgr2=0x7fda7c1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 0x7fda7c1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 -- 172.21.15.17:0/854076570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c104f60 msgr2=0x7fda7c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:03.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c104f60 0x7fda7c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 -- 172.21.15.17:0/854076570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c1a1cd0 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7bfff640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 0x7fda7c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda7b7fe640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c920 tx=0x7fda6c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c007c70 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda6c007e10 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c1a1fc0 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.029+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c018890 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.030+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c1a2410 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.031+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c10b120 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.032+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fda6c018a30 con 0x7fda7c103e00 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.032+0000 7fda78ff9640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 0x7fda680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.033+0000 7fda7affd640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 0x7fda680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.033+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fda6c0cf390 con 0x7fda7c103e00 2024-09-10T11:42:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.033+0000 7fda7affd640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 0x7fda680a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda64031610 tx=0x7fda64005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.036+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda6c014030 con 0x7fda7c103e00 2024-09-10T11:42:03.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.221+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fda7c062630 con 0x7fda680a2c40 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.233+0000 7fda78ff9640 1 -- 172.21.15.17:0/854076570 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fda7c062630 con 0x7fda680a2c40 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (97s) 19s ago 96s 18.3M - 19.1.1-305-g1cf819b7 41d671128357 62990aef26ba 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi026 running (94s) 28s ago 94s 18.1M - 19.1.1-305-g1cf819b7 41d671128357 f5e781d48427 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi081 running (108s) 28s ago 108s 17.8M - 19.1.1-305-g1cf819b7 41d671128357 de8a6f58704f 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (115s) 19s ago 115s 14.4M - 19.1.1-305-g1cf819b7 41d671128357 ee3d6472b30f 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi026 running (113s) 28s ago 112s 17.2M - 19.1.1-305-g1cf819b7 41d671128357 6261bab6e4cf 2024-09-10T11:42:03.234 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi081 running (110s) 28s ago 110s 17.0M - 19.1.1-305-g1cf819b7 41d671128357 f58adb1cd2d0 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (100s) 19s ago 100s 19.2M - 19.1.1-305-g1cf819b7 41d671128357 f29c1ed2924f 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi026 running (105s) 28s ago 105s 17.9M - 19.1.1-305-g1cf819b7 41d671128357 88095bc7b65e 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi081 running (103s) 28s ago 103s 26.3M - 19.1.1-305-g1cf819b7 41d671128357 373505fdd224 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (119s) 19s ago 118s 16.8M - 19.1.1-305-g1cf819b7 41d671128357 aac8f66abba4 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi026 running (2m) 28s ago 2m 16.9M - 19.1.1-305-g1cf819b7 41d671128357 8e15e1cebfd3 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi081 running (2m) 28s ago 2m 18.4M - 19.1.1-305-g1cf819b7 41d671128357 a0b3a07bfc21 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (8m) 19s ago 8m 508M - 19.1.1-305-g1cf819b7 41d671128357 7e7c8a1a0bd2 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi026 *:8443,8765 running (7m) 28s ago 7m 444M - 19.1.1-305-g1cf819b7 41d671128357 cb5f776d2a08 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi081 *:8443,8765 running (7m) 28s ago 7m 442M - 19.1.1-305-g1cf819b7 41d671128357 a2abf571127a 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (9m) 19s ago 9m 50.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 12bb9e07be04 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi026 running (7m) 28s ago 7m 41.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 32ea2e4b196a 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi081 running (7m) 28s ago 7m 39.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 8eb946e014dc 2024-09-10T11:42:03.235 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 19s ago 6m 55.2M 4273M 19.1.1-305-g1cf819b7 41d671128357 0a92d1b713bd 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi026 running (6m) 28s ago 6m 48.4M 4273M 19.1.1-305-g1cf819b7 41d671128357 6b6cb3fc5191 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi081 running (6m) 28s ago 6m 57.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 9487a9c87c2c 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (5m) 19s ago 5m 56.1M 4273M 19.1.1-305-g1cf819b7 41d671128357 41af02fcf013 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi026 running (5m) 28s ago 5m 52.1M 4273M 19.1.1-305-g1cf819b7 41d671128357 c0612471713e 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi081 running (4m) 28s ago 4m 56.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 f6b6a0211ff1 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (4m) 19s ago 4m 44.3M 4273M 19.1.1-305-g1cf819b7 41d671128357 70c5d64467fb 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi026 running (4m) 28s ago 4m 46.8M 4273M 19.1.1-305-g1cf819b7 41d671128357 7a55631848c8 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi081 running (3m) 28s ago 3m 56.2M 4272M 19.1.1-305-g1cf819b7 41d671128357 5bb192396941 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 19s ago 3m 51.8M 4273M 19.1.1-305-g1cf819b7 41d671128357 4782c5e09fb2 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi026 running (2m) 28s ago 2m 48.3M 4273M 19.1.1-305-g1cf819b7 41d671128357 77f6f295e2e3 2024-09-10T11:42:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi081 running (2m) 28s ago 2m 43.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 2fbfc380f2bf 2024-09-10T11:42:03.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 msgr2=0x7fda680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:03.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 0x7fda680a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda64031610 tx=0x7fda64005fd0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 msgr2=0x7fda7c19a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:03.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c920 tx=0x7fda6c00cde0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 shutdown_connections 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fda680a2c40 0x7fda680a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda7c105920 0x7fda7c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda7c104f60 0x7fda7c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 --2- 172.21.15.17:0/854076570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda7c103e00 0x7fda7c19a0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 >> 172.21.15.17:0/854076570 conn(0x7fda7c0ff5b0 msgr2=0x7fda7c1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 shutdown_connections 2024-09-10T11:42:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:03.235+0000 7fda81f70640 1 -- 172.21.15.17:0/854076570 wait complete. 2024-09-10T11:42:03.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:03 smithi026 ceph-mon[34817]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:03.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:03 smithi017 ceph-mon[30817]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:03.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:03 smithi081 ceph-mon[35059]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:03.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T11:42:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:04.539 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:04 smithi017 ceph-mon[30817]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:04.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:04 smithi026 ceph-mon[34817]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 -- 172.21.15.17:0/2367130124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 msgr2=0x7ff798108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/2367130124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798108f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff790009ca0 tx=0x7ff79002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 -- 172.21.15.17:0/2367130124 shutdown_connections 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/2367130124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798101d10 0x7ff798102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/2367130124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798108f60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/2367130124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798100b10 0x7ff798100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 -- 172.21.15.17:0/2367130124 >> 172.21.15.17:0/2367130124 conn(0x7ff7980fc2a0 msgr2=0x7ff7980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 -- 172.21.15.17:0/2367130124 shutdown_connections 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.751+0000 7ff79cbcd640 1 -- 172.21.15.17:0/2367130124 wait complete. 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 Processor -- start 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 -- start start 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 0x7ff798104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798101d10 0x7ff7981030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff79810c790 con 0x7ff7981026d0 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff79810c610 con 0x7ff798101d10 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff79cbcd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff79810c910 con 0x7ff798100b10 2024-09-10T11:42:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff796d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff796d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47988/0 (socket says 172.21.15.17:47988) 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.752+0000 7ff796d9d640 1 -- 172.21.15.17:0/1928796711 learned_addr learned my addr 172.21.15.17:0/1928796711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff79659c640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 0x7ff798104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff795d9b640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798101d10 0x7ff7981030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 -- 172.21.15.17:0/1928796711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 msgr2=0x7ff798104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 0x7ff798104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 -- 172.21.15.17:0/1928796711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798101d10 msgr2=0x7ff7981030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798101d10 0x7ff7981030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 -- 172.21.15.17:0/1928796711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff798103ef0 con 0x7ff7981026d0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff79659c640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 0x7ff798104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff796d9d640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7900098d0 tx=0x7ff79002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79002fc30 con 0x7ff7981026d0 2024-09-10T11:42:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff790003e50 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7981a1f60 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7900305c0 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.753+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7981a2410 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.754+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7981a2640 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.756+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff790004b40 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.756+0000 7ff7877fe640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 0x7ff7800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.757+0000 7ff79659c640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 0x7ff7800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.757+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff7900f0680 con 0x7ff7981026d0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.757+0000 7ff79659c640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 0x7ff7800a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff798101b70 tx=0x7ff78800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.760+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7900bd5a0 con 0x7ff7981026d0 2024-09-10T11:42:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.946+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff7981a2810 con 0x7ff7800a2c10 2024-09-10T11:42:04.963 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:04 smithi081 ceph-mon[35059]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.952+0000 7ff7877fe640 1 -- 172.21.15.17:0/1928796711 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff7981a2810 con 0x7ff7800a2c10 2024-09-10T11:42:04.964 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T11:42:04.964 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 29s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi026=b;smithi026=e;smithi026=h;smithi026=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-09-10T11:42:04.964 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 29s ago 7m smithi017=x;smithi026=y;smithi081=z;count:3 2024-09-10T11:42:04.964 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 29s ago 7m smithi017:172.21.15.17=a;smithi026:172.21.15.26=b;smithi081:172.21.15.81=c;count:3 2024-09-10T11:42:04.964 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 29s ago - 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 msgr2=0x7ff7800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 0x7ff7800a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff798101b70 tx=0x7ff78800a5e0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 msgr2=0x7ff798103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7900098d0 tx=0x7ff79002f840 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 shutdown_connections 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff7800a2c10 0x7ff7800a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7981026d0 0x7ff798103630 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff798101d10 0x7ff7981030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 --2- 172.21.15.17:0/1928796711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff798100b10 0x7ff798104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 >> 172.21.15.17:0/1928796711 conn(0x7ff7980fc2a0 msgr2=0x7ff7980fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 shutdown_connections 2024-09-10T11:42:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:04.954+0000 7ff79cbcd640 1 -- 172.21.15.17:0/1928796711 wait complete. 2024-09-10T11:42:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:05 smithi017 ceph-mon[30817]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:05.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T11:42:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:05 smithi026 ceph-mon[34817]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:05.884 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:05.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:05 smithi081 ceph-mon[35059]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:06.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- 172.21.15.17:0/872453924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 msgr2=0x7f86101002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 --2- 172.21.15.17:0/872453924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f86101002d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8600009930 tx=0x7f860002a420 comp rx=0 tx=0).stop 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- 172.21.15.17:0/872453924 shutdown_connections 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 --2- 172.21.15.17:0/872453924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610102eb0 0x7f8610103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 --2- 172.21.15.17:0/872453924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610103870 0x7f861010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 --2- 172.21.15.17:0/872453924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f86101002d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- 172.21.15.17:0/872453924 >> 172.21.15.17:0/872453924 conn(0x7f86100fba40 msgr2=0x7f86100fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- 172.21.15.17:0/872453924 shutdown_connections 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- 172.21.15.17:0/872453924 wait complete. 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 Processor -- start 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.344+0000 7f8617084640 1 -- start start 2024-09-10T11:42:06.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 0x7f8610198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 0x7f861019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f861010d900 con 0x7f86100ffed0 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f861010d780 con 0x7f8610102eb0 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f861010da80 con 0x7f8610103870 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48014/0 (socket says 172.21.15.17:48014) 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 -- 172.21.15.17:0/70185114 learned_addr learned my addr 172.21.15.17:0/70185114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8615621640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 0x7f861019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f860ffff640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 0x7f8610198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 -- 172.21.15.17:0/70185114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 msgr2=0x7f861019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 0x7f861019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 -- 172.21.15.17:0/70185114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 msgr2=0x7f8610198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 0x7f8610198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 -- 172.21.15.17:0/70185114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861019fc10 con 0x7f86100ffed0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8615621640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 0x7f861019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f860ffff640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 0x7f8610198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8614e20640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8600031610 tx=0x7f8600032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860003f030 con 0x7f86100ffed0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8600003ce0 con 0x7f86100ffed0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861019fea0 con 0x7f86100ffed0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.345+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600035070 con 0x7f86100ffed0 2024-09-10T11:42:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.346+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86101a02a0 con 0x7f86100ffed0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.347+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8610109150 con 0x7f86100ffed0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.348+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8600042030 con 0x7f86100ffed0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.349+0000 7f860dffb640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 0x7f85f80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.349+0000 7f860ffff640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 0x7f85f80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.349+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f86000ef5f0 con 0x7f86100ffed0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.349+0000 7f860ffff640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 0x7f85f80a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8610199500 tx=0x7f8604005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.353+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86000bc3a0 con 0x7f86100ffed0 2024-09-10T11:42:06.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:06 smithi017 ceph-mon[30817]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:06.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.535+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8610062630 con 0x7f85f80a2c40 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.536+0000 7f860dffb640 1 -- 172.21.15.17:0/70185114 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f8610062630 con 0x7f85f80a2c40 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:smithi026 172.21.15.26 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:smithi081 172.21.15.81 2024-09-10T11:42:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 msgr2=0x7f85f80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 0x7f85f80a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8610199500 tx=0x7f8604005f90 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 msgr2=0x7f8610197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8600031610 tx=0x7f8600032ce0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 shutdown_connections 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f85f80a2c40 0x7f85f80a5100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8610103870 0x7f861019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8610102eb0 0x7f8610198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 --2- 172.21.15.17:0/70185114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86100ffed0 0x7f8610197fe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:06.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 >> 172.21.15.17:0/70185114 conn(0x7f86100fba40 msgr2=0x7f8610106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 shutdown_connections 2024-09-10T11:42:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:06.538+0000 7f8617084640 1 -- 172.21.15.17:0/70185114 wait complete. 2024-09-10T11:42:06.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:06 smithi026 ceph-mon[34817]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:06.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:06 smithi081 ceph-mon[35059]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:07.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T11:42:07.473 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:07.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:07 smithi017 ceph-mon[30817]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:07.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:07 smithi026 ceph-mon[34817]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:07.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 -- 172.21.15.17:0/3599798350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec1037c0 msgr2=0x7f96ec10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:07.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 --2- 172.21.15.17:0/3599798350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec1037c0 0x7f96ec10a050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009ca0 tx=0x7f96e402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 -- 172.21.15.17:0/3599798350 shutdown_connections 2024-09-10T11:42:07.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 --2- 172.21.15.17:0/3599798350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec1037c0 0x7f96ec10a050 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 --2- 172.21.15.17:0/3599798350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 0x7f96ec103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 --2- 172.21.15.17:0/3599798350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec101c00 0x7f96ec102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 -- 172.21.15.17:0/3599798350 >> 172.21.15.17:0/3599798350 conn(0x7f96ec0fd390 msgr2=0x7f96ec0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 -- 172.21.15.17:0/3599798350 shutdown_connections 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.950+0000 7f96f0def640 1 -- 172.21.15.17:0/3599798350 wait complete. 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 Processor -- start 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 -- start start 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 0x7f96ec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec1037c0 0x7f96ec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec10d880 con 0x7f96ec101c00 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec10d700 con 0x7f96ec102e00 2024-09-10T11:42:07.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96f0def640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec10da00 con 0x7f96ec1037c0 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48020/0 (socket says 172.21.15.17:48020) 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 -- 172.21.15.17:0/3864744151 learned_addr learned my addr 172.21.15.17:0/3864744151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96e9d9b640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 0x7f96ec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ead9d640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec1037c0 0x7f96ec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 -- 172.21.15.17:0/3864744151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec1037c0 msgr2=0x7f96ec074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec1037c0 0x7f96ec074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 -- 172.21.15.17:0/3864744151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 msgr2=0x7f96ec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.951+0000 7f96ea59c640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 0x7f96ec0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96ea59c640 1 -- 172.21.15.17:0/3864744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec0753e0 con 0x7f96ec101c00 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96ea59c640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c970 tx=0x7f96dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc004220 con 0x7f96ec101c00 2024-09-10T11:42:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1a1fd0 con 0x7f96ec101c00 2024-09-10T11:42:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96dc0043c0 con 0x7f96ec101c00 2024-09-10T11:42:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc004a00 con 0x7f96ec101c00 2024-09-10T11:42:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.952+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec1a2430 con 0x7f96ec101c00 2024-09-10T11:42:07.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:07 smithi081 ceph-mon[35059]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.953+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec109000 con 0x7f96ec101c00 2024-09-10T11:42:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.954+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f96dc0079b0 con 0x7f96ec101c00 2024-09-10T11:42:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.955+0000 7f96db7fe640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 0x7f96d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.955+0000 7f96e9d9b640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 0x7f96d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:07.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.955+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f96dc0ceeb0 con 0x7f96ec101c00 2024-09-10T11:42:07.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.956+0000 7f96e9d9b640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 0x7f96d40a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96ec075d10 tx=0x7f96e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:07.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:07.960+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96dc014030 con 0x7f96ec101c00 2024-09-10T11:42:08.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.146+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f96ec062630 con 0x7f96d40a2c10 2024-09-10T11:42:08.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.147+0000 7f96db7fe640 1 -- 172.21.15.17:0/3864744151 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f96ec062630 con 0x7f96d40a2c10 2024-09-10T11:42:08.148 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T11:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-10T11:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout:smithi026 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760020480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-10T11:42:08.149 INFO:teuthology.orchestra.run.smithi017.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.149+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 msgr2=0x7f96d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.149+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 0x7f96d40a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96ec075d10 tx=0x7f96e000b390 comp rx=0 tx=0).stop 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.149+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 msgr2=0x7f96ec075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.149+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c970 tx=0x7f96dc00ce30 comp rx=0 tx=0).stop 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 shutdown_connections 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f96d40a2c10 0x7f96d40a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec1037c0 0x7f96ec074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f96ec102e00 0x7f96ec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 --2- 172.21.15.17:0/3864744151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96ec101c00 0x7f96ec075f90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 >> 172.21.15.17:0/3864744151 conn(0x7f96ec0fd390 msgr2=0x7f96ec1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 shutdown_connections 2024-09-10T11:42:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:08.150+0000 7f96f0def640 1 -- 172.21.15.17:0/3864744151 wait complete. 2024-09-10T11:42:08.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:08 smithi026 ceph-mon[34817]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:08.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:08 smithi026 ceph-mon[34817]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:08.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:08 smithi017 ceph-mon[30817]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:08.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:08 smithi017 ceph-mon[30817]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:08.817 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T11:42:08.829 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:42:08.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T11:42:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:08 smithi081 ceph-mon[35059]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:08 smithi081 ceph-mon[35059]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T11:42:09.086 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- 172.21.15.17:0/98054040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04101cd0 msgr2=0x7fdc04102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 --2- 172.21.15.17:0/98054040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04101cd0 0x7fdc04102150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009900 tx=0x7fdbf402a410 comp rx=0 tx=0).stop 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- 172.21.15.17:0/98054040 shutdown_connections 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 --2- 172.21.15.17:0/98054040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04102690 0x7fdc04108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 --2- 172.21.15.17:0/98054040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04101cd0 0x7fdc04102150 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 --2- 172.21.15.17:0/98054040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 0x7fdc04100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- 172.21.15.17:0/98054040 >> 172.21.15.17:0/98054040 conn(0x7fdc040fc280 msgr2=0x7fdc040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- 172.21.15.17:0/98054040 shutdown_connections 2024-09-10T11:42:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- 172.21.15.17:0/98054040 wait complete. 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 Processor -- start 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.548+0000 7fdc0c028640 1 -- start start 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 0x7fdc0406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04101cd0 0x7fdc0419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0410c730 con 0x7fdc04102690 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0410c5b0 con 0x7fdc04100ad0 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0410c8b0 con 0x7fdc04101cd0 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48050/0 (socket says 172.21.15.17:48050) 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 -- 172.21.15.17:0/4146085386 learned_addr learned my addr 172.21.15.17:0/4146085386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc09dc4640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 0x7fdc0406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc095c3640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04101cd0 0x7fdc0419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 -- 172.21.15.17:0/4146085386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04101cd0 msgr2=0x7fdc0419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04101cd0 0x7fdc0419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 -- 172.21.15.17:0/4146085386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 msgr2=0x7fdc0406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 0x7fdc0406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 -- 172.21.15.17:0/4146085386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc041a1d10 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0a5c5640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00cce0 tx=0x7fdbfc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00f450 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbfc00fad0 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc041a1fa0 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc018c10 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.549+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc041a2400 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.550+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc04107e70 con 0x7fdc04102690 2024-09-10T11:42:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.552+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbfc00f5f0 con 0x7fdc04102690 2024-09-10T11:42:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.552+0000 7fdbfaffd640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 0x7fdbf00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.552+0000 7fdc09dc4640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 0x7fdbf00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.552+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fdbfc0cf820 con 0x7fdc04102690 2024-09-10T11:42:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.553+0000 7fdc09dc4640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 0x7fdbf00a5100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc04101b30 tx=0x7fdc0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.556+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbfc014030 con 0x7fdc04102690 2024-09-10T11:42:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.767+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdc0402d9c0 con 0x7fdc04102690 2024-09-10T11:42:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.768+0000 7fdbfaffd640 1 -- 172.21.15.17:0/4146085386 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3117 (secure 0 0 0) 0x7fdbfc09c6c0 con 0x7fdc04102690 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:e27 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-10T11:40:51:538268+0000 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-10T11:42:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 27 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-10T11:40:40.061818+0000 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-10T11:40:51.538239+0000 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-10T11:42:09.771 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 5 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2,3,4 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24523,1=24512,2=24508,3=24496,4=24485} 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-10T11:42:09.772 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 24523 members: 24523,24512,24508,24496,24485 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{0:24523} state up:active seq 7 addr [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{0:24464} state up:standby-replay seq 1 addr [v2:172.21.15.26:6834/3091242502,v1:172.21.15.26:6835/3091242502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{1:24512} state up:active seq 6 addr [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.81:6832/230246363,v1:172.21.15.81:6833/230246363] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{2:24508} state up:active seq 10 addr [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{2:24440} state up:standby-replay seq 1 addr [v2:172.21.15.26:6832/3177397418,v1:172.21.15.26:6833/3177397418] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{3:24496} state up:active seq 11 addr [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{3:14613} state up:standby-replay seq 1 addr [v2:172.21.15.17:6840/1429826923,v1:172.21.15.17:6841/1429826923] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{4:24485} state up:active seq 10 addr [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{4:14601} state up:standby-replay seq 1 addr [v2:172.21.15.17:6838/2696186701,v1:172.21.15.17:6839/2696186701] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:09.774 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.17:6834/3226558545,v1:172.21.15.17:6835/3226558545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.775 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14550} state up:standby seq 1 addr [v2:172.21.15.17:6836/3582550652,v1:172.21.15.17:6837/3582550652] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T11:42:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:42:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 msgr2=0x7fdbf00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 0x7fdbf00a5100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc04101b30 tx=0x7fdc0000b390 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 msgr2=0x7fdc041a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00cce0 tx=0x7fdbfc00a620 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 shutdown_connections 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdbf00a2c40 0x7fdbf00a5100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc04101cd0 0x7fdc0419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc04102690 0x7fdc041a1520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 --2- 172.21.15.17:0/4146085386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc04100ad0 0x7fdc0406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 >> 172.21.15.17:0/4146085386 conn(0x7fdc040fc280 msgr2=0x7fdc04105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 shutdown_connections 2024-09-10T11:42:09.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:09.771+0000 7fdc0c028640 1 -- 172.21.15.17:0/4146085386 wait complete. 2024-09-10T11:42:10.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T11:42:10.559 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:10.680 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:10 smithi017 ceph-mon[30817]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:10.681 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:10 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4146085386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:42:10.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:10 smithi081 ceph-mon[35059]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:10.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:10 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4146085386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:42:11.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:10 smithi026 ceph-mon[34817]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:11.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:10 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4146085386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1651575695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 msgr2=0x7f0c1410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1651575695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1410a050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009ca0 tx=0x7f0c0c02a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1651575695 shutdown_connections 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1651575695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1410a050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1651575695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14102e00 0x7f0c14103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1651575695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14101c00 0x7f0c14102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1651575695 >> 172.21.15.17:0/1651575695 conn(0x7f0c140fd390 msgr2=0x7f0c140ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1651575695 shutdown_connections 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.053+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1651575695 wait complete. 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.054+0000 7f0c18fc7640 1 Processor -- start 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.054+0000 7f0c18fc7640 1 -- start start 2024-09-10T11:42:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.054+0000 7f0c18fc7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14101c00 0x7f0c14197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.054+0000 7f0c18fc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14102e00 0x7f0c14198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.054+0000 7f0c18fc7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c18fc7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1410d860 con 0x7f0c141037c0 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c18fc7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1410d6e0 con 0x7f0c14101c00 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c18fc7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1410d9e0 con 0x7f0c14102e00 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48078/0 (socket says 172.21.15.17:48078) 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 -- 172.21.15.17:0/1275407099 learned_addr learned my addr 172.21.15.17:0/1275407099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c09d9b640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14102e00 0x7f0c14198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c1259c640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14101c00 0x7f0c14197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 -- 172.21.15.17:0/1275407099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14102e00 msgr2=0x7f0c14198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:11.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14102e00 0x7f0c14198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 -- 172.21.15.17:0/1275407099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14101c00 msgr2=0x7f0c14197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14101c00 0x7f0c14197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 -- 172.21.15.17:0/1275407099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1419fa00 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c12d9d640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c005e30 tx=0x7f0c0c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c003c30 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c0c003dd0 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1419fc90 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.055+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c02fde0 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.056+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c141a01c0 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.056+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c14108f30 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.058+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0c0c004050 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.058+0000 7f0c0bfff640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 0x7f0c000a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.059+0000 7f0c1259c640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 0x7f0c000a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.059+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0c0c0f05d0 con 0x7f0c141037c0 2024-09-10T11:42:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.059+0000 7f0c1259c640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 0x7f0c000a5180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c040058c0 tx=0x7f0c04005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.061+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c0c0bd4f0 con 0x7f0c141037c0 2024-09-10T11:42:11.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.238+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f0c1402d7c0 con 0x7f0c141037c0 2024-09-10T11:42:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.239+0000 7f0c0bfff640 1 -- 172.21.15.17:0/1275407099 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) ==== 56+0+5243 (secure 0 0 0) 0x7f0c0c0bcdf0 con 0x7f0c141037c0 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 86 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-10T11:32:58.310121+0000 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-10T11:40:54.542676+0000 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 26 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2024-09-10T11:42:11.241 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/3742829700,v1:172.21.15.17:6803/3742829700] [v2:172.21.15.17:6804/3742829700,v1:172.21.15.17:6805/3742829700] exists,up cb884aa2-728d-4f58-b002-3bd444435819 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6800/3714938498,v1:172.21.15.26:6801/3714938498] [v2:172.21.15.26:6802/3714938498,v1:172.21.15.26:6803/3714938498] exists,up 097fdd5d-de3c-4a64-83c4-0841e483863b 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/318742081,v1:172.21.15.81:6801/318742081] [v2:172.21.15.81:6802/318742081,v1:172.21.15.81:6803/318742081] exists,up b13f41eb-280d-4533-bea8-6b7793493dec 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 25 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/3673598588,v1:172.21.15.17:6811/3673598588] [v2:172.21.15.17:6812/3673598588,v1:172.21.15.17:6813/3673598588] exists,up 87dcd823-ec3a-4980-a67c-12cf81196b58 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 33 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6808/1261155050,v1:172.21.15.26:6809/1261155050] [v2:172.21.15.26:6810/1261155050,v1:172.21.15.26:6811/1261155050] exists,up 8257cbe0-747a-4bcd-8aa4-1e78c14c151f 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 38 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/2098201169,v1:172.21.15.81:6809/2098201169] [v2:172.21.15.81:6810/2098201169,v1:172.21.15.81:6811/2098201169] exists,up f15ffb10-de2f-44fc-9a53-676c63a25e4b 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 46 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/3749111347,v1:172.21.15.17:6819/3749111347] [v2:172.21.15.17:6820/3749111347,v1:172.21.15.17:6821/3749111347] exists,up ac8679de-8c70-44cb-b0bf-528b334c3e70 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 51 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6816/2390923493,v1:172.21.15.26:6817/2390923493] [v2:172.21.15.26:6818/2390923493,v1:172.21.15.26:6819/2390923493] exists,up 57a224a6-f735-4d6a-ac05-574a5b979db9 2024-09-10T11:42:11.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 58 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/476521742,v1:172.21.15.81:6817/476521742] [v2:172.21.15.81:6818/476521742,v1:172.21.15.81:6819/476521742] exists,up 8ba82601-c53f-4ac8-a80d-b3432adeee27 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 65 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/356908580,v1:172.21.15.17:6827/356908580] [v2:172.21.15.17:6828/356908580,v1:172.21.15.17:6829/356908580] exists,up e8603dea-46ab-4afe-a9e8-4e443d826420 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 71 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6824/926527219,v1:172.21.15.26:6825/926527219] [v2:172.21.15.26:6826/926527219,v1:172.21.15.26:6827/926527219] exists,up dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 78 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6824/2880107876,v1:172.21.15.81:6825/2880107876] [v2:172.21.15.81:6826/2880107876,v1:172.21.15.81:6827/2880107876] exists,up f1eceb2e-7cf2-4177-94e7-67fe68ea78a1 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.8 [2,11] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.e [4,8] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1a [5,6] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1e [3,9] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.22 [3,9] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.23 [4,7] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.24 [4,9] 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2483128501 expires 2024-09-11T11:33:53.328197+0000 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/2456904864 expires 2024-09-11T11:33:53.328197+0000 2024-09-10T11:42:11.243 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/2456904864 expires 2024-09-11T11:33:53.328197+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2953600041 expires 2024-09-11T11:33:53.328197+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/456613680 expires 2024-09-11T11:33:53.328197+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/710238438 expires 2024-09-11T11:33:29.648083+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/817290704 expires 2024-09-11T11:33:29.648083+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/817290704 expires 2024-09-11T11:33:29.648083+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/25951598 expires 2024-09-11T11:33:29.648083+0000 2024-09-10T11:42:11.244 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2863615588 expires 2024-09-11T11:33:29.648083+0000 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 msgr2=0x7f0c000a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 0x7f0c000a5180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c040058c0 tx=0x7f0c04005850 comp rx=0 tx=0).stop 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 msgr2=0x7f0c1419f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c005e30 tx=0x7f0c0c031ee0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 shutdown_connections 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c000a2cc0 0x7f0c000a5180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c14102e00 0x7f0c14198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c141037c0 0x7f0c1419f390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 --2- 172.21.15.17:0/1275407099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c14101c00 0x7f0c14197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:11.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 >> 172.21.15.17:0/1275407099 conn(0x7f0c140fd390 msgr2=0x7f0c14106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:11.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 shutdown_connections 2024-09-10T11:42:11.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:11.242+0000 7f0c18fc7640 1 -- 172.21.15.17:0/1275407099 wait complete. 2024-09-10T11:42:11.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:11 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1275407099' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:42:11.870 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T11:42:11.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:42:11.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:11 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1275407099' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:42:12.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:11 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1275407099' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T11:42:12.136 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:12.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 -- 172.21.15.17:0/3605333767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 msgr2=0x7f7c001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/3605333767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c001067e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009900 tx=0x7f7be802a410 comp rx=0 tx=0).stop 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 -- 172.21.15.17:0/3605333767 shutdown_connections 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/3605333767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 0x7f7c0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/3605333767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c001067e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/3605333767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 0x7f7c001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.642+0000 7f7c04b8d640 1 -- 172.21.15.17:0/3605333767 >> 172.21.15.17:0/3605333767 conn(0x7f7c000fd8c0 msgr2=0x7f7c000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 -- 172.21.15.17:0/3605333767 shutdown_connections 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 -- 172.21.15.17:0/3605333767 wait complete. 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 Processor -- start 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 -- start start 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 0x7f7c000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 0x7f7c00074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00111f30 con 0x7f7c00102790 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.643+0000 7f7c04b8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00111db0 con 0x7f7c00106f10 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7c04b8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001120b0 con 0x7f7c00101de0 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35286/0 (socket says 172.21.15.17:35286) 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 -- 172.21.15.17:0/789955917 learned_addr learned my addr 172.21.15.17:0/789955917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bfe59c640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 0x7f7c000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bfed9d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 0x7f7c00074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 -- 172.21.15.17:0/789955917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 msgr2=0x7f7c000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 0x7f7c000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 -- 172.21.15.17:0/789955917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 msgr2=0x7f7c00074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 0x7f7c00074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 -- 172.21.15.17:0/789955917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c001a68f0 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf7fff640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006010 tx=0x7f7be80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be803f030 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be8003ce0 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c001a6b80 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8035070 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.644+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c001a7060 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.645+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c001021c0 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.647+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7be8042030 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.647+0000 7f7bf77fe640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 0x7f7bec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.648+0000 7f7bfe59c640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 0x7f7bec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.648+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7be80ef970 con 0x7f7c00102790 2024-09-10T11:42:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.648+0000 7f7bfe59c640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 0x7f7bec0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0005d00 tx=0x7f7bf000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.651+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7be80bc1f0 con 0x7f7c00102790 2024-09-10T11:42:12.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:12 smithi017 ceph-mon[30817]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.861+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c0010a0f0 con 0x7f7c00102790 2024-09-10T11:42:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.861+0000 7f7bf77fe640 1 -- 172.21.15.17:0/789955917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f7be80c04f0 con 0x7f7c00102790 2024-09-10T11:42:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:12.863 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:42:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.863+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 msgr2=0x7f7bec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.863+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 0x7f7bec0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0005d00 tx=0x7f7bf000b410 comp rx=0 tx=0).stop 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.863+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 msgr2=0x7f7c00074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.863+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006010 tx=0x7f7be80042f0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 shutdown_connections 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7bec0a2c10 0x7f7bec0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c00106f10 0x7f7c00074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c00102790 0x7f7c00074a30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 --2- 172.21.15.17:0/789955917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c00101de0 0x7f7c000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 >> 172.21.15.17:0/789955917 conn(0x7f7c000fd8c0 msgr2=0x7f7c000fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 shutdown_connections 2024-09-10T11:42:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:12.864+0000 7f7c04b8d640 1 -- 172.21.15.17:0/789955917 wait complete. 2024-09-10T11:42:12.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:12 smithi081 ceph-mon[35059]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:13.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:12 smithi026 ceph-mon[34817]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:13.539 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:13 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/789955917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:13.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:42:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:13.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:13 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/789955917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:14.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:13 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/789955917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- 172.21.15.17:0/667788890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc102ef0 msgr2=0x7f7afc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 --2- 172.21.15.17:0/667788890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc102ef0 0x7f7afc10da40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009900 tx=0x7f7af402a480 comp rx=0 tx=0).stop 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- 172.21.15.17:0/667788890 shutdown_connections 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 --2- 172.21.15.17:0/667788890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 0x7f7afc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 --2- 172.21.15.17:0/667788890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc102ef0 0x7f7afc10da40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 --2- 172.21.15.17:0/667788890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7afc100e20 0x7f7afc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- 172.21.15.17:0/667788890 >> 172.21.15.17:0/667788890 conn(0x7f7afc0fc7d0 msgr2=0x7f7afc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- 172.21.15.17:0/667788890 shutdown_connections 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- 172.21.15.17:0/667788890 wait complete. 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 Processor -- start 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.250+0000 7f7b0411b640 1 -- start start 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 0x7f7afc1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7afc102ef0 0x7f7afc1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc110f80 con 0x7f7afc100e20 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc110e00 con 0x7f7afc102ef0 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111100 con 0x7f7afc102570 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35298/0 (socket says 172.21.15.17:35298) 2024-09-10T11:42:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 -- 172.21.15.17:0/2308663171 learned_addr learned my addr 172.21.15.17:0/2308663171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b016b6640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 0x7f7afc1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 -- 172.21.15.17:0/2308663171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 msgr2=0x7f7afc1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 0x7f7afc1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 -- 172.21.15.17:0/2308663171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7afc102ef0 msgr2=0x7f7afc1a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7afc102ef0 0x7f7afc1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 -- 172.21.15.17:0/2308663171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc1a4930 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b01eb7640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00eab0 tx=0x7f7aec00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00ce40 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aec011950 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec010ae0 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc1a4b00 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.251+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc1a4fc0 con 0x7f7afc100e20 2024-09-10T11:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.252+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc101200 con 0x7f7afc100e20 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.253+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7aec011b00 con 0x7f7afc100e20 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.254+0000 7f7afaffd640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 0x7f7ae40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.254+0000 7f7b016b6640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 0x7f7ae40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.254+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7aec0cf980 con 0x7f7afc100e20 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.255+0000 7f7b016b6640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 0x7f7ae40a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7af0005fd0 tx=0x7f7af000b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.258+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7aec016030 con 0x7f7afc100e20 2024-09-10T11:42:14.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.470+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7afc06a560 con 0x7f7afc100e20 2024-09-10T11:42:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.470+0000 7f7afaffd640 1 -- 172.21.15.17:0/2308663171 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11956 (secure 0 0 0) 0x7f7aec09c730 con 0x7f7afc100e20 2024-09-10T11:42:14.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-10T11:40:51:538268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:40:51.538239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:42:14.474 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.472+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 msgr2=0x7f7ae40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.472+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 0x7f7ae40a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7af0005fd0 tx=0x7f7af000b510 comp rx=0 tx=0).stop 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.472+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 msgr2=0x7f7afc199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.472+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00eab0 tx=0x7f7aec00ef70 comp rx=0 tx=0).stop 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 shutdown_connections 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ae40a2c90 0x7f7ae40a5150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc102570 0x7f7afc1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7afc102ef0 0x7f7afc1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 --2- 172.21.15.17:0/2308663171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7afc100e20 0x7f7afc199370 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 >> 172.21.15.17:0/2308663171 conn(0x7f7afc0fc7d0 msgr2=0x7f7afc106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 shutdown_connections 2024-09-10T11:42:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:14.473+0000 7f7b0411b640 1 -- 172.21.15.17:0/2308663171 wait complete. 2024-09-10T11:42:14.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:14 smithi017 ceph-mon[30817]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:14.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:14 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2308663171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:14 smithi081 ceph-mon[35059]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:14 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2308663171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:15.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:14 smithi026 ceph-mon[34817]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:15.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:14 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2308663171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:15.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:42:15.315 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.823+0000 7ff27256a640 1 -- 172.21.15.17:0/2044556346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c101de0 msgr2=0x7ff26c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.823+0000 7ff27256a640 1 --2- 172.21.15.17:0/2044556346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c101de0 0x7ff26c1021c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009900 tx=0x7ff25c02a410 comp rx=0 tx=0).stop 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 -- 172.21.15.17:0/2044556346 shutdown_connections 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 --2- 172.21.15.17:0/2044556346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 0x7ff26c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 --2- 172.21.15.17:0/2044556346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c102790 0x7ff26c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 --2- 172.21.15.17:0/2044556346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c101de0 0x7ff26c1021c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 -- 172.21.15.17:0/2044556346 >> 172.21.15.17:0/2044556346 conn(0x7ff26c0fd8c0 msgr2=0x7ff26c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 -- 172.21.15.17:0/2044556346 shutdown_connections 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 -- 172.21.15.17:0/2044556346 wait complete. 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 Processor -- start 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.824+0000 7ff27256a640 1 -- start start 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 0x7ff26c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 0x7ff26c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c111f90 con 0x7ff26c102790 2024-09-10T11:42:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c111e10 con 0x7ff26c101de0 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c112110 con 0x7ff26c106f10 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35320/0 (socket says 172.21.15.17:35320) 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 -- 172.21.15.17:0/2263488984 learned_addr learned my addr 172.21.15.17:0/2263488984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff26bfff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 0x7ff26c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff270b07640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 0x7ff26c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 -- 172.21.15.17:0/2263488984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 msgr2=0x7ff26c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 0x7ff26c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 -- 172.21.15.17:0/2263488984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 msgr2=0x7ff26c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 0x7ff26c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 -- 172.21.15.17:0/2263488984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c19d430 con 0x7ff26c102790 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff26bfff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 0x7ff26c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff263fff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff25400d950 tx=0x7ff25400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:15.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254017070 con 0x7ff26c102790 2024-09-10T11:42:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff254009c30 con 0x7ff26c102790 2024-09-10T11:42:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26c19d720 con 0x7ff26c102790 2024-09-10T11:42:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.825+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25400f6b0 con 0x7ff26c102790 2024-09-10T11:42:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.826+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26c1a5000 con 0x7ff26c102790 2024-09-10T11:42:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.827+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26c1021c0 con 0x7ff26c102790 2024-09-10T11:42:15.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.828+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff2540109d0 con 0x7ff26c102790 2024-09-10T11:42:15.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.828+0000 7ff269ffb640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 0x7ff2580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.829+0000 7ff26bfff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 0x7ff2580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.829+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7ff2540cef00 con 0x7ff26c102790 2024-09-10T11:42:15.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.829+0000 7ff26bfff640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 0x7ff2580a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff25c005ab0 tx=0x7ff25c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:15.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:15.833+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff254009de0 con 0x7ff26c102790 2024-09-10T11:42:16.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.009+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff26c02d7c0 con 0x7ff26c102790 2024-09-10T11:42:16.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.010+0000 7ff269ffb640 1 -- 172.21.15.17:0/2263488984 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7ff25409bd10 con 0x7ff26c102790 2024-09-10T11:42:16.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:16.012 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:42:16.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 msgr2=0x7ff2580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:16.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 0x7ff2580a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff25c005ab0 tx=0x7ff25c005a20 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 msgr2=0x7ff26c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff25400d950 tx=0x7ff25400de10 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 shutdown_connections 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7ff2580a2c10 0x7ff2580a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff26c106f10 0x7ff26c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff26c102790 0x7ff26c1989c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 --2- 172.21.15.17:0/2263488984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff26c101de0 0x7ff26c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 >> 172.21.15.17:0/2263488984 conn(0x7ff26c0fd8c0 msgr2=0x7ff26c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 shutdown_connections 2024-09-10T11:42:16.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:16.013+0000 7ff27256a640 1 -- 172.21.15.17:0/2263488984 wait complete. 2024-09-10T11:42:16.621 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:16 smithi017 ceph-mon[30817]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:16.621 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:16 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2263488984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:16.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T11:40:40.061818+0000', 'modified': '2024-09-10T11:40:51.538239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24523, 'mds_1': 24512, 'mds_2': 24508, 'mds_3': 24496, 'mds_4': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/2696186701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2696186701}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2696186701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6841/1429826923', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 1429826923}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 1429826923}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.26:6833/3177397418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 3177397418}, {'type': 'v1', 'addr': '172.21.15.26:6833', 'nonce': 3177397418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/230246363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 230246363}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 230246363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.26:6835/3091242502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 3091242502}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 3091242502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.26:6837/2783390333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 2783390333}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 2783390333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.81:6835/997801833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 997801833}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 997801833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.81:6837/4227780996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 4227780996}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 4227780996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.26:6839/1530868796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6838', 'nonce': 1530868796}, {'type': 'v1', 'addr': '172.21.15.26:6839', 'nonce': 1530868796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.81:6839/193630272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 193630272}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 193630272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24523, 'qdb_cluster': [24523, 24512, 24508, 24496, 24485]} 2024-09-10T11:42:16.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T11:42:16.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T11:42:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:16.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:16 smithi081 ceph-mon[35059]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:16.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:16 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2263488984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:17.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:16 smithi026 ceph-mon[34817]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:17.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:16 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2263488984' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 -- 172.21.15.17:0/86490082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720101de0 msgr2=0x7f37201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 --2- 172.21.15.17:0/86490082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720101de0 0x7f37201021c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3710009900 tx=0x7f371002a410 comp rx=0 tx=0).stop 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 -- 172.21.15.17:0/86490082 shutdown_connections 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 --2- 172.21.15.17:0/86490082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720106f10 0x7f372010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 --2- 172.21.15.17:0/86490082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 0x7f37201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 --2- 172.21.15.17:0/86490082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720101de0 0x7f37201021c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 -- 172.21.15.17:0/86490082 >> 172.21.15.17:0/86490082 conn(0x7f37200fd8c0 msgr2=0x7f37200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 -- 172.21.15.17:0/86490082 shutdown_connections 2024-09-10T11:42:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.380+0000 7f3725306640 1 -- 172.21.15.17:0/86490082 wait complete. 2024-09-10T11:42:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 Processor -- start 2024-09-10T11:42:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 -- start start 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 0x7f37201983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 0x7f3720198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111f90 con 0x7f3720106f10 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111e10 con 0x7f3720102790 2024-09-10T11:42:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f3725306640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3720112110 con 0x7f3720101de0 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35340/0 (socket says 172.21.15.17:35340) 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.381+0000 7f371f7fe640 1 -- 172.21.15.17:0/3217485068 learned_addr learned my addr 172.21.15.17:0/3217485068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371e7fc640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 0x7f3720198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371effd640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 0x7f37201983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 -- 172.21.15.17:0/3217485068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 msgr2=0x7f37201983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 0x7f37201983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 -- 172.21.15.17:0/3217485068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 msgr2=0x7f3720198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 0x7f3720198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 -- 172.21.15.17:0/3217485068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372019d380 con 0x7f3720106f10 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371effd640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 0x7f37201983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f371f7fe640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f371800b970 tx=0x7f371800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f3707fff640 1 -- 172.21.15.17:0/3217485068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718019070 con 0x7f3720106f10 2024-09-10T11:42:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f3707fff640 1 -- 172.21.15.17:0/3217485068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3718014440 con 0x7f3720106f10 2024-09-10T11:42:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372019d670 con 0x7f3720106f10 2024-09-10T11:42:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f3707fff640 1 -- 172.21.15.17:0/3217485068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180075d0 con 0x7f3720106f10 2024-09-10T11:42:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.382+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37201a4f50 con 0x7f3720106f10 2024-09-10T11:42:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f3707fff640 1 -- 172.21.15.17:0/3217485068 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f371801c070 con 0x7f3720106f10 2024-09-10T11:42:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 Processor -- start 2024-09-10T11:42:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 -- start start 2024-09-10T11:42:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf56edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56f2f0 0x5647bf579670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647bf4d5090 con 0x5647bf579bb0 2024-09-10T11:42:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5647bf47ca70 con 0x5647bf56f2f0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f37276df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647bf4d1050 con 0x5647bf56e9d0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f371e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f3707fff640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 0x7f37080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f371e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35350/0 (socket says 172.21.15.17:35350) 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f371e7fc640 1 -- 172.21.15.17:0/2098205974 learned_addr learned my addr 172.21.15.17:0/2098205974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f371effd640 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56f2f0 0x5647bf579670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.385+0000 7f371f7fe640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 0x7f37080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf56edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f3707fff640 1 -- 172.21.15.17:0/3217485068 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f37180ce6e0 con 0x7f3720106f10 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 -- 172.21.15.17:0/2098205974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 msgr2=0x5647bf56edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf56edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 -- 172.21.15.17:0/2098205974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56f2f0 msgr2=0x5647bf579670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56f2f0 0x5647bf579670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 -- 172.21.15.17:0/2098205974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bf489130 con 0x5647bf579bb0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371e7fc640 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3714011560 tx=0x7f371400a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ea09f90ec2068d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f371f7fe640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 0x7f37080a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3718097360 tx=0x7f37180bb040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f37057fa640 1 -- 172.21.15.17:0/2098205974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714005220 con 0x5647bf579bb0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f37057fa640 1 -- 172.21.15.17:0/2098205974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3714004c80 con 0x5647bf579bb0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.386+0000 7f37057fa640 1 -- 172.21.15.17:0/2098205974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400fc50 con 0x5647bf579bb0 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- 172.21.15.17:0/2098205974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 msgr2=0x5647bf57bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3714011560 tx=0x7f371400a810 comp rx=0 tx=0).stop 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- 172.21.15.17:0/2098205974 shutdown_connections 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf579bb0 0x5647bf57bfa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56f2f0 0x5647bf579670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 --2- 172.21.15.17:0/2098205974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf56edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- 172.21.15.17:0/2098205974 >> 172.21.15.17:0/2098205974 conn(0x5647bf56af60 msgr2=0x5647bf56b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- 172.21.15.17:0/2098205974 shutdown_connections 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- 172.21.15.17:0/2098205974 wait complete. 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 -- start start 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.387+0000 7f37276df740 1 Processor -- start 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf579450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf576ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647bf57c780 con 0x5647bf56f2f0 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5647bf48ff20 con 0x5647bf579bb0 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647bf57c900 con 0x5647bf56e9d0 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35358/0 (socket says 172.21.15.17:35358) 2024-09-10T11:42:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf579450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371effd640 1 -- 172.21.15.17:0/3187972381 learned_addr learned my addr 172.21.15.17:0/3187972381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f37276df740 10 client.0 _ll_register_callbacks cb 0x5647bf459030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf576ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 -- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 msgr2=0x5647bf576ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf576ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 -- 172.21.15.17:0/3187972381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 msgr2=0x5647bf5767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 -- 172.21.15.17:0/3187972381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bf2462b0 con 0x5647bf56e9d0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371effd640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f371e7fc640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf579450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3714011eb0 tx=0x7f371400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295548f996ff7251 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.388+0000 7f3702ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371402f060 con 0x5647bf56e9d0 2024-09-10T11:42:17.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3714004c80 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3714005000 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3714021040 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 10 client.24868 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5647bf58c490 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3714004c80 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3714027070 con 0x5647bf56e9d0 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 10 client.24868 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 10 client.24868 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 20 client.24868 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf58e860 0x5647bf58fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 4 client.24868 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.389+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647bf4e2600 con 0x5647bf58e860 2024-09-10T11:42:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.390+0000 7f371effd640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf58e860 0x5647bf58fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.390+0000 7f3702ff5640 10 client.24868 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:42:17.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.390+0000 7f371effd640 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf58e860 0x5647bf58fcd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e2f43f80971cd794 server_cookie=130207ef88a62ee1 in_seq=0 out_seq=0 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f3702ff5640 1 -- 172.21.15.17:0/3187972381 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647bf4e2600 con 0x5647bf58e860 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f3702ff5640 10 client.24868 handle_command_reply: tid=0 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 client.24868 shutdown 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 msgr2=0x5647bf579450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf579450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3714011eb0 tx=0x7f371400f850 comp rx=0 tx=0).stop 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 shutdown_connections 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf58e860 0x5647bf58fcd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf576ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf5767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 --2- 172.21.15.17:0/3187972381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56e9d0 0x5647bf579450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f3702ff5640 0 client.24868 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:42:17.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 >> 172.21.15.17:0/3187972381 conn(0x5647bf56af60 msgr2=0x5647bf570c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 shutdown_connections 2024-09-10T11:42:17.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 1 -- 172.21.15.17:0/3187972381 wait complete. 2024-09-10T11:42:17.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.391+0000 7f37276df740 20 client.24868 trim_cache size 0 max 16384 2024-09-10T11:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 Processor -- start 2024-09-10T11:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 -- start start 2024-09-10T11:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56e9d0 0x5647bf58f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf579bb0 0x5647bf58e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647bf58e010 con 0x5647bf56f2f0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5647bf58e6e0 con 0x5647bf56e9d0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f37276df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647bf58edb0 con 0x5647bf579bb0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f371effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f371effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35360/0 (socket says 172.21.15.17:35360) 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.409+0000 7f371effd640 1 -- 172.21.15.17:0/1777163536 learned_addr learned my addr 172.21.15.17:0/1777163536 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371e7fc640 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf579bb0 0x5647bf58e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371e7fc640 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56e9d0 0x5647bf58f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 -- 172.21.15.17:0/1777163536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf579bb0 msgr2=0x5647bf58e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf579bb0 0x5647bf58e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 -- 172.21.15.17:0/1777163536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56e9d0 msgr2=0x5647bf58f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56e9d0 0x5647bf58f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 -- 172.21.15.17:0/1777163536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bf5797c0 con 0x5647bf56f2f0 2024-09-10T11:42:17.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f371effd640 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3710005940 tx=0x7f3710004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bf51f03c3d2def server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f3704ff9640 1 -- 172.21.15.17:0/1777163536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710035040 con 0x5647bf56f2f0 2024-09-10T11:42:17.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f3704ff9640 1 -- 172.21.15.17:0/1777163536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3710005500 con 0x5647bf56f2f0 2024-09-10T11:42:17.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.410+0000 7f3704ff9640 1 -- 172.21.15.17:0/1777163536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100035f0 con 0x5647bf56f2f0 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- 172.21.15.17:0/1777163536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 msgr2=0x5647bf58fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3710005940 tx=0x7f3710004450 comp rx=0 tx=0).stop 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- 172.21.15.17:0/1777163536 shutdown_connections 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf579bb0 0x5647bf58e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56f2f0 0x5647bf58fcd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- 172.21.15.17:0/1777163536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf56e9d0 0x5647bf58f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- 172.21.15.17:0/1777163536 >> 172.21.15.17:0/1777163536 conn(0x5647bf56af60 msgr2=0x5647bf58d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- 172.21.15.17:0/1777163536 shutdown_connections 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- 172.21.15.17:0/1777163536 wait complete. 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- start start 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 Processor -- start 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 0x5647bf592f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf593490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647bf58fb50 con 0x5647bf56e9d0 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5647bf58f480 con 0x5647bf579bb0 2024-09-10T11:42:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647bf590220 con 0x5647bf56f2f0 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f37276df740 10 client.0 _ll_register_callbacks cb 0x7f3710009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f371e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.411+0000 7f371e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35364/0 (socket says 172.21.15.17:35364) 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 -- 172.21.15.17:0/1982787288 learned_addr learned my addr 172.21.15.17:0/1982787288 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371effd640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 0x5647bf592f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 -- 172.21.15.17:0/1982787288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 msgr2=0x5647bf592f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 0x5647bf592f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 -- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 msgr2=0x5647bf593490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf593490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 -- 172.21.15.17:0/1982787288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bf593cc0 con 0x5647bf56e9d0 2024-09-10T11:42:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371effd640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 0x5647bf592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f371e7fc640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3714035c10 tx=0x7f371400a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2334fb9c4d53b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f3702ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714035e60 con 0x5647bf56e9d0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3714035600 con 0x5647bf56e9d0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3710005500 con 0x5647bf56e9d0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f37140056c0 con 0x5647bf56e9d0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f37276df740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.412+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5647bf5f7fc0 con 0x5647bf56e9d0 2024-09-10T11:42:17.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3710005500 con 0x5647bf56e9d0 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3714027040 con 0x5647bf56e9d0 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 20 client.15129 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf5fcbd0 0x5647bf5fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 4 client.15129 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "status"}) -- 0x5647bf4dcb10 con 0x5647bf5fcbd0 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f371effd640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf5fcbd0 0x5647bf5fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f371effd640 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf5fcbd0 0x5647bf5fb8e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b94ad866dc620e07 server_cookie=32b2be289efa6882 in_seq=0 out_seq=0 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.413+0000 7f3702ff5640 10 client.15129 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:42:17.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f3702ff5640 1 -- 172.21.15.17:0/1982787288 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5647bf4dcb10 con 0x5647bf5fcbd0 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f3702ff5640 10 client.15129 handle_command_reply: tid=0 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 client.15129 shutdown 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 msgr2=0x5647bf598750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3714035c10 tx=0x7f371400a990 comp rx=0 tx=0).stop 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 shutdown_connections 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5647bf5fcbd0 0x5647bf5fb8e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647bf56f2f0 0x5647bf592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5647bf579bb0 0x5647bf593490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 --2- 172.21.15.17:0/1982787288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647bf56e9d0 0x5647bf598750 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 >> 172.21.15.17:0/1982787288 conn(0x5647bf56af60 msgr2=0x5647bf565ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f3702ff5640 0 client.15129 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:42:17.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 shutdown_connections 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 1 -- 172.21.15.17:0/1982787288 wait complete. 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.414+0000 7f37276df740 20 client.15129 trim_cache size 0 max 16384 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24485, 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:42:17.422 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 86.885323498999995, 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 119.75395668100001 2024-09-10T11:42:17.423 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 msgr2=0x7f37080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 0x7f37080a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3718097360 tx=0x7f37180bb040 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 msgr2=0x7f372019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f371800b970 tx=0x7f371800bd70 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 shutdown_connections 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f37080a2c10 0x7f37080a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3720106f10 0x7f372019cca0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3720102790 0x7f3720198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 --2- 172.21.15.17:0/3217485068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3720101de0 0x7f37201983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 >> 172.21.15.17:0/3217485068 conn(0x7f37200fd8c0 msgr2=0x7f37200fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:17.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 shutdown_connections 2024-09-10T11:42:17.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:17.415+0000 7f3725306640 1 -- 172.21.15.17:0/3217485068 wait complete. 2024-09-10T11:42:18.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T11:42:18.461 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:18.872 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:18 smithi017 ceph-mon[30817]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:18.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:18 smithi081 ceph-mon[35059]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.954+0000 7f0459c23640 1 -- 172.21.15.17:0/338842533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0454101280 msgr2=0x7f045410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 --2- 172.21.15.17:0/338842533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0454101280 0x7f045410df40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0448009900 tx=0x7f044802a410 comp rx=0 tx=0).stop 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 -- 172.21.15.17:0/338842533 shutdown_connections 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 --2- 172.21.15.17:0/338842533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f045410e480 0x7f0454110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 --2- 172.21.15.17:0/338842533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0454101280 0x7f045410df40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 --2- 172.21.15.17:0/338842533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f0454100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 -- 172.21.15.17:0/338842533 >> 172.21.15.17:0/338842533 conn(0x7f04540fc7a0 msgr2=0x7f04540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 -- 172.21.15.17:0/338842533 shutdown_connections 2024-09-10T11:42:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 -- 172.21.15.17:0/338842533 wait complete. 2024-09-10T11:42:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 Processor -- start 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.955+0000 7f0459c23640 1 -- start start 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f045419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f045410e480 0x7f045419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0454114190 con 0x7f045410e480 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0454114010 con 0x7f0454101280 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0459c23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0454114310 con 0x7f04541008d0 2024-09-10T11:42:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f04537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f045419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:50310/0 (socket says 172.21.15.17:50310) 2024-09-10T11:42:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 -- 172.21.15.17:0/1117546796 learned_addr learned my addr 172.21.15.17:0/1117546796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0453fff640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f045410e480 0x7f045419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 -- 172.21.15.17:0/1117546796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 msgr2=0x7f045419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f045419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 -- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f045410e480 msgr2=0x7f045419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f045410e480 0x7f045419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f0452ffd640 1 -- 172.21.15.17:0/1117546796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045419f6a0 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.956+0000 7f04537fe640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f045419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0452ffd640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0448006010 tx=0x7f04480042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0450ff9640 1 -- 172.21.15.17:0/1117546796 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044803f030 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045419f930 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0450ff9640 1 -- 172.21.15.17:0/1117546796 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0448003ce0 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0450ff9640 1 -- 172.21.15.17:0/1117546796 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448035070 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.957+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541a7270 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 Processor -- start 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f0450ff9640 1 -- 172.21.15.17:0/1117546796 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0448042030 con 0x7f0454101280 2024-09-10T11:42:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 -- start start 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a346452670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a346452bb0 0x55a346454fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a3463ae090 con 0x55a3464479d0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a346355a70 con 0x55a346452bb0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.960+0000 7f045bffc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3463aa050 con 0x55a3464482f0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35394/0 (socket says 172.21.15.17:35394) 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 -- 172.21.15.17:0/2834827591 learned_addr learned my addr 172.21.15.17:0/2834827591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0452ffd640 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a346452bb0 0x55a346454fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f04537fe640 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a346452670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 -- 172.21.15.17:0/2834827591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 msgr2=0x55a346452670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a346452670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 -- 172.21.15.17:0/2834827591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a346452bb0 msgr2=0x55a346454fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a346452bb0 0x55a346454fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 -- 172.21.15.17:0/2834827591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a346362130 con 0x55a3464479d0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0450ff9640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0453fff640 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f044c009f10 tx=0x7f044c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee103c851fb7541 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f04537fe640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0450ff9640 1 -- 172.21.15.17:0/1117546796 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f04480ef330 con 0x7f0454101280 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.961+0000 7f0439ffb640 1 -- 172.21.15.17:0/2834827591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c016070 con 0x55a3464479d0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f0439ffb640 1 -- 172.21.15.17:0/2834827591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c012930 con 0x55a3464479d0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f0439ffb640 1 -- 172.21.15.17:0/2834827591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c011980 con 0x55a3464479d0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 -- 172.21.15.17:0/2834827591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 msgr2=0x55a346447db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f04537fe640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 0x7f043c0a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55a346444dc0 tx=0x7f044400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f044c009f10 tx=0x7f044c010740 comp rx=0 tx=0).stop 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 -- 172.21.15.17:0/2834827591 shutdown_connections 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a346452670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a346452bb0 0x55a346454fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 --2- 172.21.15.17:0/2834827591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3464479d0 0x55a346447db0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 -- 172.21.15.17:0/2834827591 >> 172.21.15.17:0/2834827591 conn(0x55a346443f60 msgr2=0x55a346444340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 -- 172.21.15.17:0/2834827591 shutdown_connections 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.962+0000 7f045bffc740 1 -- 172.21.15.17:0/2834827591 wait complete. 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 -- start start 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 Processor -- start 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a346452490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a346455780 con 0x55a346452bb0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a346368f20 con 0x55a3464479d0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a346455900 con 0x55a3464482f0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f045bffc740 10 client.0 _ll_register_callbacks cb 0x55a346332030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35396/0 (socket says 172.21.15.17:35396) 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f0453fff640 1 -- 172.21.15.17:0/3432887989 learned_addr learned my addr 172.21.15.17:0/3432887989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f04537fe640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a346452490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.963+0000 7f0452ffd640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 -- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 msgr2=0x55a34644f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 -- 172.21.15.17:0/3432887989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 msgr2=0x55a346452490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a346452490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 -- 172.21.15.17:0/3432887989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34611f2b0 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0453fff640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f044c011420 tx=0x7f044c012d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb53096bc3d61c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c02a060 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f044c012660 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044c012930 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f044c016050 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f045bffc740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.964+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a3464610f0 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c012930 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f044c00f040 con 0x55a346452bb0 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 10 client.15141 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T11:42:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 20 client.15141 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464625b0 0x55a3464647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 4 client.15141 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3463bb600 con 0x55a3464625b0 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f04537fe640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464625b0 0x55a3464647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f04537fe640 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464625b0 0x55a3464647b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3acabc37bcebcfcb server_cookie=98cc98805d303eec in_seq=0 out_seq=0 2024-09-10T11:42:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.965+0000 7f0432ffd640 10 client.15141 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f0432ffd640 1 -- 172.21.15.17:0/3432887989 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3463bb600 con 0x55a3464625b0 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f0432ffd640 10 client.15141 handle_command_reply: tid=0 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 client.15141 shutdown 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 msgr2=0x55a34644fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f044c011420 tx=0x7f044c012d10 comp rx=0 tx=0).stop 2024-09-10T11:42:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 shutdown_connections 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464625b0 0x55a3464647b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644fd20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 --2- 172.21.15.17:0/3432887989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a346452490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 >> 172.21.15.17:0/3432887989 conn(0x55a346443f60 msgr2=0x55a346449c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.966+0000 7f0432ffd640 0 client.15141 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.967+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 shutdown_connections 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.967+0000 7f045bffc740 1 -- 172.21.15.17:0/3432887989 wait complete. 2024-09-10T11:42:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.967+0000 7f045bffc740 20 client.15141 trim_cache size 0 max 16384 2024-09-10T11:42:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.984+0000 7f045bffc740 1 Processor -- start 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.984+0000 7f045bffc740 1 -- start start 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.984+0000 7f045bffc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a3464647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f045bffc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f045bffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f045bffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a346462af0 con 0x55a346452bb0 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f045bffc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a3464631c0 con 0x55a3464479d0 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f045bffc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a346463890 con 0x55a3464482f0 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35406/0 (socket says 172.21.15.17:35406) 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 -- 172.21.15.17:0/4076180654 learned_addr learned my addr 172.21.15.17:0/4076180654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f04537fe640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a3464647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0452ffd640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 -- 172.21.15.17:0/4076180654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 msgr2=0x55a34644e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 -- 172.21.15.17:0/4076180654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 msgr2=0x55a3464647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a3464647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 -- 172.21.15.17:0/4076180654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34644e7b0 con 0x55a346452bb0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0452ffd640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f0453fff640 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f044c002230 tx=0x7f044c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd54d73324d6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f04397fa640 1 -- 172.21.15.17:0/4076180654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c035070 con 0x55a346452bb0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f04397fa640 1 -- 172.21.15.17:0/4076180654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c011b10 con 0x55a346452bb0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.985+0000 7f04397fa640 1 -- 172.21.15.17:0/4076180654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c003c60 con 0x55a346452bb0 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- 172.21.15.17:0/4076180654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 msgr2=0x55a34644ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f044c002230 tx=0x7f044c009bd0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- 172.21.15.17:0/4076180654 shutdown_connections 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644ca80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 --2- 172.21.15.17:0/4076180654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a3464647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- 172.21.15.17:0/4076180654 >> 172.21.15.17:0/4076180654 conn(0x55a346443f60 msgr2=0x55a346449c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- 172.21.15.17:0/4076180654 shutdown_connections 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- 172.21.15.17:0/4076180654 wait complete. 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.986+0000 7f045bffc740 1 -- start start 2024-09-10T11:42:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 Processor -- start 2024-09-10T11:42:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a34646d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a346464630 con 0x55a346452bb0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a346463f60 con 0x55a3464479d0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a346464d00 con 0x55a3464482f0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35422/0 (socket says 172.21.15.17:35422) 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 -- 172.21.15.17:0/694855690 learned_addr learned my addr 172.21.15.17:0/694855690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f045bffc740 10 client.0 _ll_register_callbacks cb 0x7f04480f2d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f04537fe640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a34646d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0452ffd640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 -- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 msgr2=0x55a34644c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 -- 172.21.15.17:0/694855690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 msgr2=0x55a34646d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a34646d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0453fff640 1 -- 172.21.15.17:0/694855690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34644d000 con 0x55a346452bb0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.987+0000 7f0452ffd640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0453fff640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f044c011010 tx=0x7f044c0043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e237e3c6fdba66b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c035070 con 0x55a346452bb0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f044c021040 con 0x55a346452bb0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044c011b10 con 0x55a346452bb0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f044c0113e0 con 0x55a346452bb0 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f045bffc740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a34646b920 con 0x55a346452bb0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c011b10 con 0x55a346452bb0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f044c005030 con 0x55a346452bb0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.988+0000 7f045bffc740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 10 client.15147 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 20 client.15147 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464d1fd0 0x55a3464d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 4 client.15147 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "status"}) -- 0x55a3463b5b10 con 0x55a3464d1fd0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f04537fe640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464d1fd0 0x55a3464d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f04537fe640 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464d1fd0 0x55a3464d0ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=646351da5799e63b server_cookie=35b6ad1e816560b6 in_seq=0 out_seq=0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f0432ffd640 10 client.15147 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f0432ffd640 1 -- 172.21.15.17:0/694855690 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a3463b5b10 con 0x55a3464d1fd0 2024-09-10T11:42:18.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f0432ffd640 10 client.15147 handle_command_reply: tid=0 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.989+0000 7f045bffc740 1 client.15147 shutdown 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 msgr2=0x55a34644c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f044c011010 tx=0x7f044c0043a0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 shutdown_connections 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a3464d1fd0 0x55a3464d0ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3464482f0 0x55a34644c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a346452bb0 0x55a34644c990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 --2- 172.21.15.17:0/694855690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a3464479d0 0x55a34646d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 >> 172.21.15.17:0/694855690 conn(0x55a346443f60 msgr2=0x55a346449c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0432ffd640 0 client.15147 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 shutdown_connections 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 1 -- 172.21.15.17:0/694855690 wait complete. 2024-09-10T11:42:18.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f045bffc740 20 client.15147 trim_cache size 0 max 16384 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24496, 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 89.467938368000006, 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:42:18.998 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:42:18.999 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:42:18.999 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 126.405505684 2024-09-10T11:42:18.999 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 msgr2=0x7f043c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 0x7f043c0a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55a346444dc0 tx=0x7f044400b410 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 msgr2=0x7f045419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0448006010 tx=0x7f04480042f0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 shutdown_connections 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f045410e480 0x7f045419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0454101280 0x7f045419ac30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 --2- 172.21.15.17:0/1117546796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04541008d0 0x7f045419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.990+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 >> 172.21.15.17:0/1117546796 conn(0x7f04540fc7a0 msgr2=0x7f04540feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.991+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 shutdown_connections 2024-09-10T11:42:19.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:18.991+0000 7f0459c23640 1 -- 172.21.15.17:0/1117546796 wait complete. 2024-09-10T11:42:19.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:18 smithi026 ceph-mon[34817]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:19.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T11:42:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 -- 172.21.15.17:0/1861184019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718102ef0 msgr2=0x7f671810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 --2- 172.21.15.17:0/1861184019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718102ef0 0x7f671810da40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6708009ca0 tx=0x7f670802a950 comp rx=0 tx=0).stop 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 -- 172.21.15.17:0/1861184019 shutdown_connections 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 --2- 172.21.15.17:0/1861184019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 0x7f67181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 --2- 172.21.15.17:0/1861184019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718102ef0 0x7f671810da40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 --2- 172.21.15.17:0/1861184019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718100e20 0x7f6718101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 -- 172.21.15.17:0/1861184019 >> 172.21.15.17:0/1861184019 conn(0x7f67180fc7d0 msgr2=0x7f67180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 -- 172.21.15.17:0/1861184019 shutdown_connections 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.561+0000 7f671d071640 1 -- 172.21.15.17:0/1861184019 wait complete. 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.562+0000 7f671d071640 1 Processor -- start 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.562+0000 7f671d071640 1 -- start start 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 0x7f6718198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718102ef0 0x7f671819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6718110fa0 con 0x7f6718100e20 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6718110e20 con 0x7f6718102ef0 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671d071640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6718111120 con 0x7f6718102570 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35442/0 (socket says 172.21.15.17:35442) 2024-09-10T11:42:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 -- 172.21.15.17:0/3845361306 learned_addr learned my addr 172.21.15.17:0/3845361306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671659c640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 0x7f6718198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f671759e640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718102ef0 0x7f671819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 -- 172.21.15.17:0/3845361306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 msgr2=0x7f6718198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 0x7f6718198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 -- 172.21.15.17:0/3845361306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718102ef0 msgr2=0x7f671819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718102ef0 0x7f671819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 -- 172.21.15.17:0/3845361306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671819d530 con 0x7f6718100e20 2024-09-10T11:42:20.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.563+0000 7f6716d9d640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f671000d950 tx=0x7f671000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.564+0000 7f670ffff640 1 -- 172.21.15.17:0/3845361306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710017070 con 0x7f6718100e20 2024-09-10T11:42:20.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.564+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671819d820 con 0x7f6718100e20 2024-09-10T11:42:20.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.564+0000 7f670ffff640 1 -- 172.21.15.17:0/3845361306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f671000de80 con 0x7f6718100e20 2024-09-10T11:42:20.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.564+0000 7f670ffff640 1 -- 172.21.15.17:0/3845361306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671000f620 con 0x7f6718100e20 2024-09-10T11:42:20.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.564+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181a5100 con 0x7f6718100e20 2024-09-10T11:42:20.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.566+0000 7f670ffff640 1 -- 172.21.15.17:0/3845361306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6710009c30 con 0x7f6718100e20 2024-09-10T11:42:20.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.566+0000 7f671f44a740 1 Processor -- start 2024-09-10T11:42:20.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.566+0000 7f671f44a740 1 -- start start 2024-09-10T11:42:20.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa85670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa85bb0 0x557e2fa87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e2f9e1090 con 0x557e2fa7a9d0 2024-09-10T11:42:20.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557e2f988a70 con 0x557e2fa7b2f0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671f44a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557e2f9dd050 con 0x557e2fa85bb0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35458/0 (socket says 172.21.15.17:35458) 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 -- 172.21.15.17:0/3978787900 learned_addr learned my addr 172.21.15.17:0/3978787900 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f670ffff640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 0x7f67040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f6716d9d640 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa85670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 -- 172.21.15.17:0/3978787900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa85bb0 msgr2=0x557e2fa87fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa85bb0 0x557e2fa87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 -- 172.21.15.17:0/3978787900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 msgr2=0x557e2fa85670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa85670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 -- 172.21.15.17:0/3978787900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e2f995130 con 0x557e2fa7a9d0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f671759e640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 0x7f67040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.567+0000 7f670ffff640 1 -- 172.21.15.17:0/3845361306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f67100ceed0 con 0x7f6718100e20 2024-09-10T11:42:20.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.568+0000 7f671759e640 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f670802f9b0 tx=0x7f670802f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecc3ad32923ff5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.568+0000 7f670d7fa640 1 -- 172.21.15.17:0/3978787900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708041040 con 0x557e2fa7a9d0 2024-09-10T11:42:20.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.568+0000 7f670d7fa640 1 -- 172.21.15.17:0/3978787900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6708004520 con 0x557e2fa7a9d0 2024-09-10T11:42:20.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.568+0000 7f670d7fa640 1 -- 172.21.15.17:0/3978787900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708034040 con 0x557e2fa7a9d0 2024-09-10T11:42:20.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.568+0000 7f671759e640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 0x7f67040a50d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f670804c000 tx=0x7f670804d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- 172.21.15.17:0/3978787900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 msgr2=0x557e2fa7adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f670802f9b0 tx=0x7f670802f9e0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- 172.21.15.17:0/3978787900 shutdown_connections 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa85bb0 0x557e2fa87fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa85670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 --2- 172.21.15.17:0/3978787900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa7adb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- 172.21.15.17:0/3978787900 >> 172.21.15.17:0/3978787900 conn(0x557e2fa76f60 msgr2=0x557e2fa77340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- 172.21.15.17:0/3978787900 shutdown_connections 2024-09-10T11:42:20.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- 172.21.15.17:0/3978787900 wait complete. 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 -- start start 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.569+0000 7f671f44a740 1 Processor -- start 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa88780 con 0x557e2fa7a9d0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557e2f99bf20 con 0x557e2fa85bb0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa88900 con 0x557e2fa7b2f0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671f44a740 10 client.0 _ll_register_callbacks cb 0x557e2f965030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:50376/0 (socket says 172.21.15.17:50376) 2024-09-10T11:42:20.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35460/0 (socket says 172.21.15.17:35460) 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 -- 172.21.15.17:0/1843364926 learned_addr learned my addr 172.21.15.17:0/1843364926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671659c640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 -- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 msgr2=0x557e2fa827c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa827c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 -- 172.21.15.17:0/1843364926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 msgr2=0x557e2fa85470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 -- 172.21.15.17:0/1843364926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e2f7522b0 con 0x557e2fa85bb0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f6716d9d640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f671759e640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6708039530 tx=0x7f6708009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6bed1efd8d2a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.570+0000 7f66fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708058020 con 0x557e2fa85bb0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6708004520 con 0x557e2fa85bb0 2024-09-10T11:42:20.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6708004040 con 0x557e2fa85bb0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6708041040 con 0x557e2fa85bb0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 10 client.24899 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e2fa88780 con 0x557e2fa85bb0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6708004520 con 0x557e2fa85bb0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6708030890 con 0x557e2fa85bb0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 10 client.24899 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 10 client.24899 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 20 client.24899 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fa9a6e0 0x557e2fa9bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 4 client.24899 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.571+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e2f9ee600 con 0x557e2fa9a6e0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.572+0000 7f6716d9d640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fa9a6e0 0x557e2fa9bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.572+0000 7f66fe7fc640 10 client.24899 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:42:20.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.572+0000 7f6716d9d640 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fa9a6e0 0x557e2fa9bb50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97a65761f4cecf6d server_cookie=297654860975ae90 in_seq=0 out_seq=0 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f66fe7fc640 1 -- 172.21.15.17:0/1843364926 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e2f9ee600 con 0x557e2fa9a6e0 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f66fe7fc640 10 client.24899 handle_command_reply: tid=0 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 client.24899 shutdown 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 msgr2=0x557e2fa82d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6708039530 tx=0x7f6708009800 comp rx=0 tx=0).stop 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 shutdown_connections 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fa9a6e0 0x557e2fa9bb50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa827c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa82d00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 --2- 172.21.15.17:0/1843364926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f66fe7fc640 0 client.24899 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 >> 172.21.15.17:0/1843364926 conn(0x557e2fa76f60 msgr2=0x557e2fa7cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 shutdown_connections 2024-09-10T11:42:20.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 1 -- 172.21.15.17:0/1843364926 wait complete. 2024-09-10T11:42:20.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.573+0000 7f671f44a740 20 client.24899 trim_cache size 0 max 16384 2024-09-10T11:42:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.591+0000 7f671f44a740 1 Processor -- start 2024-09-10T11:42:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.591+0000 7f671f44a740 1 -- start start 2024-09-10T11:42:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7a9d0 0x557e2fa77340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa77880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa99e90 con 0x557e2fa85bb0 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa9a560 con 0x557e2fa7b2f0 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671f44a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa9ac30 con 0x557e2fa7a9d0 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35468/0 (socket says 172.21.15.17:35468) 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 -- 172.21.15.17:0/1071967473 learned_addr learned my addr 172.21.15.17:0/1071967473 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f6716d9d640 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7a9d0 0x557e2fa77340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671659c640 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa77880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 -- 172.21.15.17:0/1071967473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7a9d0 msgr2=0x557e2fa77340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7a9d0 0x557e2fa77340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 -- 172.21.15.17:0/1071967473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 msgr2=0x557e2fa77880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa77880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 -- 172.21.15.17:0/1071967473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e2fa7b120 con 0x557e2fa85bb0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f671759e640 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6708030dd0 tx=0x7f670802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7183212eea18f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.592+0000 7f670cff9640 1 -- 172.21.15.17:0/1071967473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708058070 con 0x557e2fa85bb0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f670cff9640 1 -- 172.21.15.17:0/1071967473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6708030e50 con 0x557e2fa85bb0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f670cff9640 1 -- 172.21.15.17:0/1071967473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708030440 con 0x557e2fa85bb0 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 -- 172.21.15.17:0/1071967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 msgr2=0x557e2fa81090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6708030dd0 tx=0x7f670802f840 comp rx=0 tx=0).stop 2024-09-10T11:42:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 -- 172.21.15.17:0/1071967473 shutdown_connections 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa85bb0 0x557e2fa81090 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa7b2f0 0x557e2fa77880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 --2- 172.21.15.17:0/1071967473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7a9d0 0x557e2fa77340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 -- 172.21.15.17:0/1071967473 >> 172.21.15.17:0/1071967473 conn(0x557e2fa76f60 msgr2=0x557e2fa71ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 -- 172.21.15.17:0/1071967473 shutdown_connections 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.593+0000 7f671f44a740 1 -- 172.21.15.17:0/1071967473 wait complete. 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 -- start start 2024-09-10T11:42:20.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 Processor -- start 2024-09-10T11:42:20.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa9f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa9f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa9b9d0 con 0x557e2fa7a9d0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa9b300 con 0x557e2fa85bb0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557e2fa9c0a0 con 0x557e2fa7b2f0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671f44a740 10 client.0 _ll_register_callbacks cb 0x7f670802ffa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35484/0 (socket says 172.21.15.17:35484) 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 -- 172.21.15.17:0/39326196 learned_addr learned my addr 172.21.15.17:0/39326196 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671659c640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa9f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f671759e640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa9f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 -- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 msgr2=0x557e2fa9f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa9f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 -- 172.21.15.17:0/39326196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 msgr2=0x557e2fa9f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:20.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa9f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.594+0000 7f6716d9d640 1 -- 172.21.15.17:0/39326196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e2fb02f10 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f6716d9d640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6710009610 tx=0x7f671009bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f638638c0af755 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710020040 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f67100cca80 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6708030e50 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67100a41f0 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e2fb041f0 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6708030e50 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6710097360 con 0x557e2fa7a9d0 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:20.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 10 client.15165 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 20 client.15165 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fb08d90 0x557e2fb07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 4 client.15165 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.595+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "status"}) -- 0x557e2f9e8b10 con 0x557e2fb08d90 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f671659c640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fb08d90 0x557e2fb07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f671659c640 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fb08d90 0x557e2fb07aa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f6242065a30cb39 server_cookie=47165334f909ff3 in_seq=0 out_seq=0 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f66fe7fc640 10 client.15165 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f66fe7fc640 1 -- 172.21.15.17:0/39326196 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557e2f9e8b10 con 0x557e2fb08d90 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f66fe7fc640 10 client.15165 handle_command_reply: tid=0 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f671f44a740 1 client.15165 shutdown 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 msgr2=0x557e2fa9ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.596+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6710009610 tx=0x7f671009bd40 comp rx=0 tx=0).stop 2024-09-10T11:42:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 shutdown_connections 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x557e2fb08d90 0x557e2fb07aa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557e2fa7b2f0 0x557e2fa9f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f66fe7fc640 0 client.15165 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557e2fa85bb0 0x557e2fa9f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 --2- 172.21.15.17:0/39326196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e2fa7a9d0 0x557e2fa9ed50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 >> 172.21.15.17:0/39326196 conn(0x557e2fa76f60 msgr2=0x557e2fa77340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 shutdown_connections 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 1 -- 172.21.15.17:0/39326196 wait complete. 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671f44a740 20 client.15165 trim_cache size 0 max 16384 2024-09-10T11:42:20.604 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24508, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 92.083688800000004, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 125.568521183 2024-09-10T11:42:20.605 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 msgr2=0x7f67040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 0x7f67040a50d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f670804c000 tx=0x7f670804d000 comp rx=0 tx=0).stop 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 msgr2=0x7f6718198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f671000d950 tx=0x7f671000dd50 comp rx=0 tx=0).stop 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 shutdown_connections 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67040a2c10 0x7f67040a50d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6718102570 0x7f6718198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6718102ef0 0x7f671819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 --2- 172.21.15.17:0/3845361306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6718100e20 0x7f6718198580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.597+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 >> 172.21.15.17:0/3845361306 conn(0x7f67180fc7d0 msgr2=0x7f671806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.598+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 shutdown_connections 2024-09-10T11:42:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:20.598+0000 7f671d071640 1 -- 172.21.15.17:0/3845361306 wait complete. 2024-09-10T11:42:20.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:20 smithi017 ceph-mon[30817]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:20.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:20 smithi081 ceph-mon[35059]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:21.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:20 smithi026 ceph-mon[34817]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:42:21.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T11:42:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.024+0000 7f5353b83640 1 -- 172.21.15.17:0/3008497121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 msgr2=0x7f534c110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.024+0000 7f5353b83640 1 --2- 172.21.15.17:0/3008497121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c110910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5344009ca0 tx=0x7f534402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- 172.21.15.17:0/3008497121 shutdown_connections 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- 172.21.15.17:0/3008497121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c101440 0x7f534c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- 172.21.15.17:0/3008497121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c110910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- 172.21.15.17:0/3008497121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c100b20 0x7f534c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- 172.21.15.17:0/3008497121 >> 172.21.15.17:0/3008497121 conn(0x7f534c0fc7d0 msgr2=0x7f534c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- 172.21.15.17:0/3008497121 shutdown_connections 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- 172.21.15.17:0/3008497121 wait complete. 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 Processor -- start 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- start start 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c100b20 0x7f534c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c101440 0x7f534c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.025+0000 7f5353b83640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f534c114230 con 0x7f534c10e500 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5353b83640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1140b0 con 0x7f534c101440 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5353b83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1143b0 con 0x7f534c100b20 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34028/0 (socket says 172.21.15.17:34028) 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 -- 172.21.15.17:0/363394821 learned_addr learned my addr 172.21.15.17:0/363394821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f535111e640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c101440 0x7f534c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f535191f640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c100b20 0x7f534c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 -- 172.21.15.17:0/363394821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c100b20 msgr2=0x7f534c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c100b20 0x7f534c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 -- 172.21.15.17:0/363394821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c101440 msgr2=0x7f534c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c101440 0x7f534c19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 -- 172.21.15.17:0/363394821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c19f6c0 con 0x7f534c10e500 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5352120640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f53440319f0 tx=0x7f5344031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5342ffd640 1 -- 172.21.15.17:0/363394821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344003c30 con 0x7f534c10e500 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c19f950 con 0x7f534c10e500 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5342ffd640 1 -- 172.21.15.17:0/363394821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5344003dd0 con 0x7f534c10e500 2024-09-10T11:42:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5342ffd640 1 -- 172.21.15.17:0/363394821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534402fdd0 con 0x7f534c10e500 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.026+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a7290 con 0x7f534c10e500 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5342ffd640 1 -- 172.21.15.17:0/363394821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5344004050 con 0x7f534c10e500 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5355f5c740 1 Processor -- start 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5355f5c740 1 -- start start 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5342ffd640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 0x7f53380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e152f0 0x55a961e1f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.029+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e1fbb0 0x55a961e21fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f5355f5c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a961d7b090 con 0x55a961e149d0 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f5355f5c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a961d22a70 con 0x55a961e1fbb0 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f5355f5c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a961d77050 con 0x55a961e152f0 2024-09-10T11:42:22.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535191f640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 0x7f53380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34034/0 (socket says 172.21.15.17:34034) 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 -- 172.21.15.17:0/2523523654 learned_addr learned my addr 172.21.15.17:0/2523523654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e152f0 0x55a961e1f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f5352120640 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e1fbb0 0x55a961e21fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f5342ffd640 1 -- 172.21.15.17:0/363394821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f53440f03b0 con 0x7f534c10e500 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 -- 172.21.15.17:0/2523523654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e152f0 msgr2=0x55a961e1f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e152f0 0x55a961e1f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 -- 172.21.15.17:0/2523523654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e1fbb0 msgr2=0x55a961e21fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e1fbb0 0x55a961e21fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 -- 172.21.15.17:0/2523523654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a961d2f130 con 0x55a961e149d0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535191f640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 0x7f53380a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5348005fd0 tx=0x7f534800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.030+0000 7f535111e640 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bfd0 tx=0x7f533c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127061085623ba86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5337fff640 1 -- 172.21.15.17:0/2523523654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c012c80 con 0x55a961e149d0 2024-09-10T11:42:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5337fff640 1 -- 172.21.15.17:0/2523523654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c012e20 con 0x55a961e149d0 2024-09-10T11:42:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5337fff640 1 -- 172.21.15.17:0/2523523654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c003830 con 0x55a961e149d0 2024-09-10T11:42:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 -- 172.21.15.17:0/2523523654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 msgr2=0x55a961e14db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f533c00bfd0 tx=0x7f533c00b6d0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 -- 172.21.15.17:0/2523523654 shutdown_connections 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e152f0 0x55a961e1f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e1fbb0 0x55a961e21fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 --2- 172.21.15.17:0/2523523654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e14db0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.031+0000 7f5355f5c740 1 -- 172.21.15.17:0/2523523654 >> 172.21.15.17:0/2523523654 conn(0x55a961e10f60 msgr2=0x55a961e11340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 -- 172.21.15.17:0/2523523654 shutdown_connections 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 -- 172.21.15.17:0/2523523654 wait complete. 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 -- start start 2024-09-10T11:42:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 Processor -- start 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e149d0 0x55a961e1f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.032+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5355f5c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a961e22780 con 0x55a961e1fbb0 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5355f5c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a961d35f20 con 0x55a961e152f0 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5355f5c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a961e22900 con 0x55a961e149d0 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5355f5c740 10 client.0 _ll_register_callbacks cb 0x55a961cff030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:22.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34040/0 (socket says 172.21.15.17:34040) 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 -- 172.21.15.17:0/1772539807 learned_addr learned my addr 172.21.15.17:0/1772539807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f535111e640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f535191f640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e149d0 0x55a961e1f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 -- 172.21.15.17:0/1772539807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e149d0 msgr2=0x55a961e1f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e149d0 0x55a961e1f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 -- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 msgr2=0x55a961e1c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 -- 172.21.15.17:0/1772539807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a961aec2b0 con 0x55a961e1fbb0 2024-09-10T11:42:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5352120640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f53440bc900 tx=0x7f53440bc7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dcbd84a8ca4d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f53357fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53440bd300 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f53440a0b10 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.033+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c012e20 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53440bcc00 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 10 client.15177 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a961e22780 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c012e20 con 0x55a961e1fbb0 2024-09-10T11:42:22.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f53440c5350 con 0x55a961e1fbb0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 10 client.15177 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 10 client.15177 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 20 client.15177 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e307a0 0x55a961e31c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 4 client.15177 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a961d88600 con 0x55a961e307a0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.034+0000 7f535191f640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e307a0 0x55a961e31c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.035+0000 7f535191f640 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e307a0 0x55a961e31c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edb0fc91c66b3c81 server_cookie=cb1323d7fee3453b in_seq=0 out_seq=0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.035+0000 7f53357fa640 10 client.15177 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f53357fa640 1 -- 172.21.15.17:0/1772539807 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a961d88600 con 0x55a961e307a0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f53357fa640 10 client.15177 handle_command_reply: tid=0 2024-09-10T11:42:22.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 client.15177 shutdown 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 msgr2=0x55a961e1cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f53440bc900 tx=0x7f53440bc7c0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 shutdown_connections 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e307a0 0x55a961e31c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e1fbb0 0x55a961e1cd30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1772539807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e149d0 0x55a961e1f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 >> 172.21.15.17:0/1772539807 conn(0x55a961e10f60 msgr2=0x55a961e16c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f53357fa640 0 client.15177 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 shutdown_connections 2024-09-10T11:42:22.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 1 -- 172.21.15.17:0/1772539807 wait complete. 2024-09-10T11:42:22.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.036+0000 7f5355f5c740 20 client.15177 trim_cache size 0 max 16384 2024-09-10T11:42:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 Processor -- start 2024-09-10T11:42:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 -- start start 2024-09-10T11:42:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e2f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a961e2ff50 con 0x55a961e149d0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a961e30620 con 0x55a961e152f0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.054+0000 7f5355f5c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a961e30cf0 con 0x55a961e1fbb0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34044/0 (socket says 172.21.15.17:34044) 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 -- 172.21.15.17:0/892717103 learned_addr learned my addr 172.21.15.17:0/892717103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535111e640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f5352120640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e2f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 -- 172.21.15.17:0/892717103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 msgr2=0x55a961e2f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e2f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 -- 172.21.15.17:0/892717103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 msgr2=0x55a961e1b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 -- 172.21.15.17:0/892717103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a961e1f0c0 con 0x55a961e149d0 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f5352120640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e2f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535111e640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f535191f640 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f53480058c0 tx=0x7f5348015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf35dc3c75787ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f53377fe640 1 -- 172.21.15.17:0/892717103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53480285b0 con 0x55a961e149d0 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f53377fe640 1 -- 172.21.15.17:0/892717103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f534802e070 con 0x55a961e149d0 2024-09-10T11:42:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.055+0000 7f53377fe640 1 -- 172.21.15.17:0/892717103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348011bb0 con 0x55a961e149d0 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 -- 172.21.15.17:0/892717103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 msgr2=0x55a961e1b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f53480058c0 tx=0x7f5348015000 comp rx=0 tx=0).stop 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 -- 172.21.15.17:0/892717103 shutdown_connections 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e2f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e1b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 --2- 172.21.15.17:0/892717103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e1b0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 -- 172.21.15.17:0/892717103 >> 172.21.15.17:0/892717103 conn(0x55a961e10f60 msgr2=0x55a961e0bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 -- 172.21.15.17:0/892717103 shutdown_connections 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.056+0000 7f5355f5c740 1 -- 172.21.15.17:0/892717103 wait complete. 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 -- start start 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 Processor -- start 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e33400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e33960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a961e31a90 con 0x55a961e149d0 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a961e313c0 con 0x55a961e152f0 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a961e32160 con 0x55a961e1fbb0 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f535191f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f5355f5c740 10 client.0 _ll_register_callbacks cb 0x7f5344009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f535191f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34058/0 (socket says 172.21.15.17:34058) 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.057+0000 7f535191f640 1 -- 172.21.15.17:0/1471624261 learned_addr learned my addr 172.21.15.17:0/1471624261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535111e640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e33400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f5352120640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e33960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 -- 172.21.15.17:0/1471624261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 msgr2=0x55a961e33960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e33960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 -- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 msgr2=0x55a961e33400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e33400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 -- 172.21.15.17:0/1471624261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a961e99170 con 0x55a961e149d0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f5352120640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e33960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f535191f640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f534800fed0 tx=0x7f53480115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99137d853916e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f53357fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348038070 con 0x55a961e149d0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5348005040 con 0x55a961e149d0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.058+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f534802e070 con 0x55a961e149d0 2024-09-10T11:42:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5348044050 con 0x55a961e149d0 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a961e9a3e0 con 0x55a961e149d0 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53480046c0 con 0x55a961e149d0 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f53480283b0 con 0x55a961e149d0 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 10 client.15183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 20 client.15183 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e9eb90 0x55a961e9d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 4 client.15183 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.059+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "status"}) -- 0x7f534802e070 con 0x55a961e9eb90 2024-09-10T11:42:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f535111e640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e9eb90 0x55a961e9d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f53357fa640 10 client.15183 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:42:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f535111e640 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e9eb90 0x55a961e9d8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a34b95af61748646 server_cookie=dbbea4cc1373ba82 in_seq=0 out_seq=0 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f53357fa640 1 -- 172.21.15.17:0/1471624261 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x7f534802e070 con 0x55a961e9eb90 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f53357fa640 10 client.15183 handle_command_reply: tid=0 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.060+0000 7f5355f5c740 1 client.15183 shutdown 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 msgr2=0x55a961e32ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f534800fed0 tx=0x7f53480115e0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 shutdown_connections 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55a961e9eb90 0x55a961e9d8a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a961e1fbb0 0x55a961e33960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a961e152f0 0x55a961e33400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f53357fa640 0 client.15183 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 --2- 172.21.15.17:0/1471624261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a961e149d0 0x55a961e32ec0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 >> 172.21.15.17:0/1471624261 conn(0x55a961e10f60 msgr2=0x55a961e2f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 shutdown_connections 2024-09-10T11:42:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 1 -- 172.21.15.17:0/1471624261 wait complete. 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.061+0000 7f5355f5c740 20 client.15183 trim_cache size 0 max 16384 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24512, 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.552229601999997, 2024-09-10T11:42:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:42:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:42:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:42:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 113.088685322 2024-09-10T11:42:22.068 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 msgr2=0x7f53380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 0x7f53380a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5348005fd0 tx=0x7f534800b590 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 msgr2=0x7f534c19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f53440319f0 tx=0x7f5344031a20 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 shutdown_connections 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53380a2c10 0x7f53380a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f534c10e500 0x7f534c19efe0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f534c101440 0x7f534c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 --2- 172.21.15.17:0/363394821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f534c100b20 0x7f534c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 >> 172.21.15.17:0/363394821 conn(0x7f534c0fc7d0 msgr2=0x7f534c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 shutdown_connections 2024-09-10T11:42:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:22.062+0000 7f5353b83640 1 -- 172.21.15.17:0/363394821 wait complete. 2024-09-10T11:42:22.785 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:22 smithi017 ceph-mon[30817]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:22.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T11:42:22.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:22 smithi081 ceph-mon[35059]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:23.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:22 smithi026 ceph-mon[34817]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:42:23.068 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 -- 172.21.15.17:0/748366413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c106f40 msgr2=0x7fab8c10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 --2- 172.21.15.17:0/748366413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c106f40 0x7fab8c10eac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fab84009ca0 tx=0x7fab8402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 -- 172.21.15.17:0/748366413 shutdown_connections 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 --2- 172.21.15.17:0/748366413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c106f40 0x7fab8c10eac0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 --2- 172.21.15.17:0/748366413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c1027c0 0x7fab8c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 --2- 172.21.15.17:0/748366413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c101e10 0x7fab8c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 -- 172.21.15.17:0/748366413 >> 172.21.15.17:0/748366413 conn(0x7fab8c0fd8d0 msgr2=0x7fab8c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 -- 172.21.15.17:0/748366413 shutdown_connections 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.544+0000 7fab916f1640 1 -- 172.21.15.17:0/748366413 wait complete. 2024-09-10T11:42:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 Processor -- start 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 -- start start 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1027c0 0x7fab8c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 0x7fab8c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c111ff0 con 0x7fab8c101e10 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c111e70 con 0x7fab8c106f40 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab916f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c112170 con 0x7fab8c1027c0 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34090/0 (socket says 172.21.15.17:34090) 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.545+0000 7fab8affd640 1 -- 172.21.15.17:0/222469996 learned_addr learned my addr 172.21.15.17:0/222469996 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1027c0 0x7fab8c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 0x7fab8c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 -- 172.21.15.17:0/222469996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1027c0 msgr2=0x7fab8c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1027c0 0x7fab8c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 -- 172.21.15.17:0/222469996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 msgr2=0x7fab8c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 0x7fab8c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 -- 172.21.15.17:0/222469996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a68b0 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 0x7fab8c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab8affd640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d950 tx=0x7fab7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab73fff640 1 -- 172.21.15.17:0/222469996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c017070 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a6ba0 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab73fff640 1 -- 172.21.15.17:0/222469996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c009c30 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab73fff640 1 -- 172.21.15.17:0/222469996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00f6b0 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.546+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a7130 con 0x7fab8c101e10 2024-09-10T11:42:23.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.548+0000 7fab73fff640 1 -- 172.21.15.17:0/222469996 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fab7c0109d0 con 0x7fab8c101e10 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 Processor -- start 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab73fff640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 0x7fab740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 -- start start 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab73fff640 1 -- 172.21.15.17:0/222469996 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fab7c0ceca0 con 0x7fab8c101e10 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 0x7fab740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d05d93f090 con 0x55d05d9d92f0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d05d8e6a70 con 0x55d05d9d89d0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab93aca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d05d93b050 con 0x55d05d9e3bb0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab8affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab8affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:37934/0 (socket says 172.21.15.17:37934) 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.549+0000 7fab8affd640 1 -- 172.21.15.17:0/1157284089 learned_addr learned my addr 172.21.15.17:0/1157284089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 -- 172.21.15.17:0/1157284089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 msgr2=0x55d05d9e5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 0x7fab740a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab84005fe0 tx=0x7fab84005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 -- 172.21.15.17:0/1157284089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 msgr2=0x55d05d9e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 -- 172.21.15.17:0/1157284089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d05d8f3130 con 0x55d05d9d89d0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab8affd640 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab7c09b1b0 tx=0x7fab7c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488fd4c413751daf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab717fa640 1 -- 172.21.15.17:0/1157284089 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c020040 con 0x55d05d9d89d0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab717fa640 1 -- 172.21.15.17:0/1157284089 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c09f860 con 0x55d05d9d89d0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.550+0000 7fab717fa640 1 -- 172.21.15.17:0/1157284089 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c09ab60 con 0x55d05d9d89d0 2024-09-10T11:42:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- 172.21.15.17:0/1157284089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 msgr2=0x55d05d9d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab7c09b1b0 tx=0x7fab7c00bf60 comp rx=0 tx=0).stop 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- 172.21.15.17:0/1157284089 shutdown_connections 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 --2- 172.21.15.17:0/1157284089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9d8db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- 172.21.15.17:0/1157284089 >> 172.21.15.17:0/1157284089 conn(0x55d05d9d4f60 msgr2=0x55d05d9d5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- 172.21.15.17:0/1157284089 shutdown_connections 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- 172.21.15.17:0/1157284089 wait complete. 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 -- start start 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.551+0000 7fab93aca740 1 Processor -- start 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d92f0 0x55d05d9e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9e6780 con 0x55d05d9d89d0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d05d8f9f20 con 0x55d05d9e3bb0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9e6900 con 0x55d05d9d92f0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 10 client.0 _ll_register_callbacks cb 0x55d05d8c3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34116/0 (socket says 172.21.15.17:34116) 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 -- 172.21.15.17:0/2972068598 learned_addr learned my addr 172.21.15.17:0/2972068598 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d92f0 0x55d05d9e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 -- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d92f0 msgr2=0x55d05d9e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d92f0 0x55d05d9e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 -- 172.21.15.17:0/2972068598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 msgr2=0x55d05d9e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 -- 172.21.15.17:0/2972068598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d05d6b02b0 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab8affd640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0a3bf0 tx=0x7fab7c09b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0162ffaa0f9bf4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0b9060 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fab7c0b4410 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab7c09f860 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab7c0b4070 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 10 client.15195 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.552+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d05d9f2130 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c09f860 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fab7c09a4e0 con 0x55d05d9d89d0 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 10 client.15195 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 10 client.15195 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:42:23.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 20 client.15195 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05d9f4320 0x55d05d9f5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 4 client.15195 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d05d94c600 con 0x55d05d9f4320 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.553+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05d9f4320 0x55d05d9f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05d9f4320 0x55d05d9f5790 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91303bcb268c8a26 server_cookie=f335799daab48ba2 in_seq=0 out_seq=0 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab6eff5640 10 client.15195 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab6eff5640 1 -- 172.21.15.17:0/2972068598 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d05d94c600 con 0x55d05d9f4320 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab6eff5640 10 client.15195 handle_command_reply: tid=0 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 client.15195 shutdown 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 msgr2=0x55d05d9e34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0a3bf0 tx=0x7fab7c09b630 comp rx=0 tx=0).stop 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 shutdown_connections 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05d9f4320 0x55d05d9f5790 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d92f0 0x55d05d9e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 --2- 172.21.15.17:0/2972068598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d89d0 0x55d05d9e34c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab6eff5640 0 client.15195 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 >> 172.21.15.17:0/2972068598 conn(0x55d05d9d4f60 msgr2=0x55d05d9dac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.554+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 shutdown_connections 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.555+0000 7fab93aca740 1 -- 172.21.15.17:0/2972068598 wait complete. 2024-09-10T11:42:23.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.555+0000 7fab93aca740 20 client.15195 trim_cache size 0 max 16384 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 Processor -- start 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 -- start start 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f3ad0 con 0x55d05d9d92f0 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f41a0 con 0x55d05d9d89d0 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab93aca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f4870 con 0x55d05d9e3bb0 2024-09-10T11:42:23.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34128/0 (socket says 172.21.15.17:34128) 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 -- 172.21.15.17:0/619105438 learned_addr learned my addr 172.21.15.17:0/619105438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8affd640 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 -- 172.21.15.17:0/619105438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 msgr2=0x55d05d9ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9ddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 -- 172.21.15.17:0/619105438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 msgr2=0x55d05d9f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 -- 172.21.15.17:0/619105438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d05d9df7e0 con 0x55d05d9d92f0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.573+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab8c075f80 tx=0x7fab8000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3de5d220808c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab70ff9640 1 -- 172.21.15.17:0/619105438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80004220 con 0x55d05d9d92f0 2024-09-10T11:42:23.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab70ff9640 1 -- 172.21.15.17:0/619105438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab800043c0 con 0x55d05d9d92f0 2024-09-10T11:42:23.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab70ff9640 1 -- 172.21.15.17:0/619105438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8001d9e0 con 0x55d05d9d92f0 2024-09-10T11:42:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 -- 172.21.15.17:0/619105438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 msgr2=0x55d05d9df100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab8c075f80 tx=0x7fab8000b410 comp rx=0 tx=0).stop 2024-09-10T11:42:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 -- 172.21.15.17:0/619105438 shutdown_connections 2024-09-10T11:42:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9e3bb0 0x55d05d9ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9df100 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 --2- 172.21.15.17:0/619105438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9d89d0 0x55d05d9f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 -- 172.21.15.17:0/619105438 >> 172.21.15.17:0/619105438 conn(0x55d05d9d4f60 msgr2=0x55d05d9e08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 -- 172.21.15.17:0/619105438 shutdown_connections 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.574+0000 7fab93aca740 1 -- 172.21.15.17:0/619105438 wait complete. 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 -- start start 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 Processor -- start 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d89d0 0x55d05d9fe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f5610 con 0x55d05d9d92f0 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f4f40 con 0x55d05d9e3bb0 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d05d9f5ce0 con 0x55d05d9d89d0 2024-09-10T11:42:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab93aca740 10 client.0 _ll_register_callbacks cb 0x7fab8000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34130/0 (socket says 172.21.15.17:34130) 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab8a7fc640 1 -- 172.21.15.17:0/851764917 learned_addr learned my addr 172.21.15.17:0/851764917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.575+0000 7fab8affd640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d89d0 0x55d05d9fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 -- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d89d0 msgr2=0x55d05d9fe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d89d0 0x55d05d9fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 -- 172.21.15.17:0/851764917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 msgr2=0x55d05d9f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9f9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 -- 172.21.15.17:0/851764917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d05da5da30 con 0x55d05d9d92f0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8b7fe640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab8a7fc640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab8001d560 tx=0x7fab8001d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfe7904637dafd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:23.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80005050 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fab8002b040 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab800043c0 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab800051f0 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab93aca740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d05da5ebb0 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab800043c0 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.576+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fab800048c0 con 0x55d05d9d92f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 10 client.15201 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 20 client.15201 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05da633f0 0x55d05da62100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 4 client.15201 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "status"}) -- 0x55d05d946b10 con 0x55d05da633f0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab8affd640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05da633f0 0x55d05da62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab6eff5640 10 client.15201 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab8affd640 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05da633f0 0x55d05da62100 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38a4fd62cdbb0b server_cookie=6157b943872ac41b in_seq=0 out_seq=0 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab6eff5640 1 -- 172.21.15.17:0/851764917 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55d05d946b10 con 0x55d05da633f0 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab6eff5640 10 client.15201 handle_command_reply: tid=0 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.577+0000 7fab93aca740 1 client.15201 shutdown 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 msgr2=0x55d05d9f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab8001d560 tx=0x7fab8001d470 comp rx=0 tx=0).stop 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 shutdown_connections 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d05da633f0 0x55d05da62100 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d05d9e3bb0 0x55d05d9f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d05d9d92f0 0x55d05d9f9640 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 --2- 172.21.15.17:0/851764917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d05d9d89d0 0x55d05d9fe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 >> 172.21.15.17:0/851764917 conn(0x55d05d9d4f60 msgr2=0x55d05d9e08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab6eff5640 0 client.15201 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 shutdown_connections 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 1 -- 172.21.15.17:0/851764917 wait complete. 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab93aca740 20 client.15201 trim_cache size 0 max 16384 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "44611ec8-6f68-11ef-bcea-c7b262605968", 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24523, 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T11:42:23.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 103.089035122, 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 86, 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 123.578062186 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:23.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 msgr2=0x7fab740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 0x7fab740a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab84005fe0 tx=0x7fab84005d80 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 msgr2=0x7fab8c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d950 tx=0x7fab7c00de10 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 shutdown_connections 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fab740a2b80 0x7fab740a5040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1027c0 0x7fab8c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c106f40 0x7fab8c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 --2- 172.21.15.17:0/222469996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c101e10 0x7fab8c0744f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.578+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 >> 172.21.15.17:0/222469996 conn(0x7fab8c0fd8d0 msgr2=0x7fab8c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.579+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 shutdown_connections 2024-09-10T11:42:23.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:23.579+0000 7fab916f1640 1 -- 172.21.15.17:0/222469996 wait complete. 2024-09-10T11:42:24.222 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T11:42:24.233 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T11:42:24.234 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T11:42:24.234 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T11:42:24.234 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T11:42:24.268 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T11:42:24.268 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T11:42:24.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:24.268 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T11:42:24.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:24.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-10T11:42:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-09-10T11:42:24.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:42:24.359 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T11:42:24.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T11:42:24.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:24.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T11:42:24.657 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:24.801 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:24 smithi017 ceph-mon[30817]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:24.801 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:24 smithi017 ceph-mon[30817]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:42:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:24 smithi081 ceph-mon[35059]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:24 smithi081 ceph-mon[35059]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:42:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:24 smithi026 ceph-mon[34817]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:42:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:24 smithi026 ceph-mon[34817]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T11:42:25.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 -- 172.21.15.17:0/777094707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87241082a0 msgr2=0x7f872410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:25.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 --2- 172.21.15.17:0/777094707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87241082a0 0x7f872410ec40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8714009cd0 tx=0x7f871402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 -- 172.21.15.17:0/777094707 shutdown_connections 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 --2- 172.21.15.17:0/777094707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87241082a0 0x7f872410ec40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 --2- 172.21.15.17:0/777094707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 0x7f8724107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 --2- 172.21.15.17:0/777094707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8724102d30 0x7f8724103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 -- 172.21.15.17:0/777094707 >> 172.21.15.17:0/777094707 conn(0x7f87240fc7d0 msgr2=0x7f87240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 -- 172.21.15.17:0/777094707 shutdown_connections 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.134+0000 7f8728951640 1 -- 172.21.15.17:0/777094707 wait complete. 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 Processor -- start 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 -- start start 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 0x7f87241a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87241082a0 0x7f872419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87241120a0 con 0x7f8724102d30 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8724111f20 con 0x7f87241036e0 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8728951640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8724112220 con 0x7f87241082a0 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34162/0 (socket says 172.21.15.17:34162) 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 -- 172.21.15.17:0/267812922 learned_addr learned my addr 172.21.15.17:0/267812922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8721d9b640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 0x7f87241a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f8722d9d640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87241082a0 0x7f872419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 -- 172.21.15.17:0/267812922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87241082a0 msgr2=0x7f872419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87241082a0 0x7f872419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 -- 172.21.15.17:0/267812922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 msgr2=0x7f87241a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:25.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 0x7f87241a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.135+0000 7f872259c640 1 -- 172.21.15.17:0/267812922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872419acd0 con 0x7f8724102d30 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f872259c640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d770 tx=0x7f871c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c017070 con 0x7f8724102d30 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872419afc0 con 0x7f8724102d30 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f871c005500 con 0x7f8724102d30 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004e00 con 0x7f8724102d30 2024-09-10T11:42:25.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.136+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87241a72b0 con 0x7f8724102d30 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.137+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8724103110 con 0x7f8724102d30 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.138+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f871c004fa0 con 0x7f8724102d30 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.139+0000 7f871b7fe640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 0x7f87100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.139+0000 7f8721d9b640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 0x7f87100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.139+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f871c0cee40 con 0x7f8724102d30 2024-09-10T11:42:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.139+0000 7f8721d9b640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 0x7f87100a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8724100a90 tx=0x7f870c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.142+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f871c09b700 con 0x7f8724102d30 2024-09-10T11:42:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.354+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f872410c2c0 con 0x7f8724102d30 2024-09-10T11:42:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.355+0000 7f871b7fe640 1 -- 172.21.15.17:0/267812922 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f871c09fa00 con 0x7f8724102d30 2024-09-10T11:42:25.356 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.357+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 msgr2=0x7f87100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 0x7f87100a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8724100a90 tx=0x7f870c00b390 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 msgr2=0x7f87241a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d770 tx=0x7f871c00dc30 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 shutdown_connections 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f87100a2b80 0x7f87100a5040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87241082a0 0x7f872419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87241036e0 0x7f87241a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 --2- 172.21.15.17:0/267812922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8724102d30 0x7f87241a03e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 >> 172.21.15.17:0/267812922 conn(0x7f87240fc7d0 msgr2=0x7f87241012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 shutdown_connections 2024-09-10T11:42:25.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:25.358+0000 7f8728951640 1 -- 172.21.15.17:0/267812922 wait complete. 2024-09-10T11:42:25.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:25 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/267812922' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:42:25.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:25 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/267812922' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:42:26.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:25 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/267812922' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T11:42:26.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T11:42:26.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T11:42:26.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:26.013 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:42:26.031 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42152sec preferred_lft 42152sec 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T11:42:26.032 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T11:42:26.033 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T11:42:26.033 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T11:42:26.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:26.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:26.257 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T11:42:26.283 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T11:42:26.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:26.285 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T11:42:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T11:42:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T11:42:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T11:42:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T11:42:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T11:42:26.360 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:42:26.360 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T11:42:26.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T11:42:26.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T11:42:26.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T11:42:26.361 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T11:42:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:26.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:26.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:26.656 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T11:42:26.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:26.673 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-10T11:42:26.729 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:42:26.729 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T11:42:26.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T11:42:26.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T11:42:26.730 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T11:42:26.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:26 smithi017 ceph-mon[30817]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:26.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:26.850 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T11:42:26.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T11:42:26.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T11:42:26.851 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T11:42:26.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:26.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:26 smithi081 ceph-mon[35059]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:26.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:26.983 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T11:42:26.983 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T11:42:26.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T11:42:26.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T11:42:26.984 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T11:42:27.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:26 smithi026 ceph-mon[34817]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:27.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:27.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:27.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T11:42:27.063 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:27.079 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T11:42:27.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T11:42:27.079 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:27.134 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T11:42:27.134 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T11:42:27.134 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/d1de11f4-901c-44a0-9cec-ac13d8d115c4 2024-09-10T11:42:27.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:27.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/d1de11f4-901c-44a0-9cec-ac13d8d115c4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T11:42:27.233 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T11:42:27.234 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-09-10T11:42:27.385 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-09-10T11:42:27.385 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-09-10T11:42:27.385 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.26:3300,172.21.15.81:3300" 2024-09-10T11:42:27.385 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 0@44611ec8-6f68-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/d1de11f4-901c-44a0-9cec-ac13d8d115c4 2024-09-10T11:42:27.385 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync,name=0,key=0,mon_addr=172.21.15.17:3300/172.21.15.26:3300/172.21.15.81:3300" will pass to kernel 2024-09-10T11:42:27.386 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T11:42:27.386 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-09-10T11:42:27.386 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T11:42:27.386 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T11:42:27.386 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T11:42:27.388 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T11:42:27.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:42:27.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:27.418 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:42:27.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:42:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:27.516 INFO:teuthology.orchestra.run.smithi017.stdout:client15210 2024-09-10T11:42:27.516 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:42:27.517 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:42:27.534 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:42:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:42:27.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:27.633 INFO:teuthology.orchestra.run.smithi017.stdout:client15210 2024-09-10T11:42:27.633 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T11:42:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T11:42:27.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:27.691 INFO:teuthology.orchestra.run.smithi017.stdout:client15210 2024-09-10T11:42:27.691 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/44611ec8-6f68-11ef-bcea-c7b262605968.client15210/status') 2024-09-10T11:42:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T11:42:27.751 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.15210 (3)192.168.0.1:0/3268409778 2024-09-10T11:42:27.751 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2024-09-10T11:42:27.751 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2024-09-10T11:42:27.751 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2024-09-10T11:42:27.751 INFO:teuthology.orchestra.run.smithi017.stderr:70 bytes copied, 2.7577e-05 s, 2.5 MB/s 2024-09-10T11:42:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T11:42:27.758 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T11:42:27.772 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T11:42:27.772 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:42:27.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- 172.21.15.17:0/1681954549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 msgr2=0x7f8498108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- 172.21.15.17:0/1681954549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f8498108eb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8490009ca0 tx=0x7f849002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- 172.21.15.17:0/1681954549 shutdown_connections 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- 172.21.15.17:0/1681954549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f8498108eb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- 172.21.15.17:0/1681954549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498101c60 0x7f84981020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- 172.21.15.17:0/1681954549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498100a70 0x7f8498100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- 172.21.15.17:0/1681954549 >> 172.21.15.17:0/1681954549 conn(0x7f84980fc1f0 msgr2=0x7f84980fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- 172.21.15.17:0/1681954549 shutdown_connections 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- 172.21.15.17:0/1681954549 wait complete. 2024-09-10T11:42:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 Processor -- start 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- start start 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498100a70 0x7f8498197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498101c60 0x7f8498198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f849810c6f0 con 0x7f8498102620 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f849810c570 con 0x7f8498100a70 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.877+0000 7f849ec27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f849810c870 con 0x7f8498101c60 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34174/0 (socket says 172.21.15.17:34174) 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 -- 172.21.15.17:0/2376792493 learned_addr learned my addr 172.21.15.17:0/2376792493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849c9c3640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498100a70 0x7f8498197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f8497fff640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498101c60 0x7f8498198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 -- 172.21.15.17:0/2376792493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498101c60 msgr2=0x7f8498198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498101c60 0x7f8498198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 -- 172.21.15.17:0/2376792493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498100a70 msgr2=0x7f8498197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498100a70 0x7f8498197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 -- 172.21.15.17:0/2376792493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849819fa70 con 0x7f8498102620 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849d1c4640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8490031ee0 tx=0x7f8490031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490003c30 con 0x7f8498102620 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8490003dd0 con 0x7f8498102620 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849819fd00 con 0x7f8498102620 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.878+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849002fc10 con 0x7f8498102620 2024-09-10T11:42:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.879+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84981a01f0 con 0x7f8498102620 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.880+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84981a0420 con 0x7f8498102620 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.881+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84900046c0 con 0x7f8498102620 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.882+0000 7f8495ffb640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 0x7f84880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.882+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f84900f0270 con 0x7f8498102620 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.882+0000 7f849c9c3640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 0x7f84880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.882+0000 7f849c9c3640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 0x7f84880a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f848c005fd0 tx=0x7f848c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:27.886+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84900bd300 con 0x7f8498102620 2024-09-10T11:42:28.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.099+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f84981a0780 con 0x7f8498102620 2024-09-10T11:42:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.543+0000 7f8495ffb640 1 -- 172.21.15.17:0/2376792493 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f84900bcc00 con 0x7f8498102620 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.545+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 msgr2=0x7f84880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.545+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 0x7f84880a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f848c005fd0 tx=0x7f848c00b390 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.545+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 msgr2=0x7f849819f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.545+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8490031ee0 tx=0x7f8490031f10 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 shutdown_connections 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f84880a2b80 0x7f84880a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8498101c60 0x7f8498198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8498102620 0x7f849819f400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 --2- 172.21.15.17:0/2376792493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8498100a70 0x7f8498197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 >> 172.21.15.17:0/2376792493 conn(0x7f84980fc1f0 msgr2=0x7f849806a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 shutdown_connections 2024-09-10T11:42:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.546+0000 7f849ec27640 1 -- 172.21.15.17:0/2376792493 wait complete. 2024-09-10T11:42:28.559 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T11:42:28.571 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T11:42:28.591 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 -- 172.21.15.17:0/1202448207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0101670 msgr2=0x7f7df0108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/1202448207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0101670 0x7f7df0108f10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009ca0 tx=0x7f7de802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 -- 172.21.15.17:0/1202448207 shutdown_connections 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/1202448207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0100cb0 0x7f7df0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/1202448207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0101670 0x7f7df0108f10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/1202448207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0102060 0x7f7df0102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 -- 172.21.15.17:0/1202448207 >> 172.21.15.17:0/1202448207 conn(0x7f7df00fb930 msgr2=0x7f7df00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 -- 172.21.15.17:0/1202448207 shutdown_connections 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.699+0000 7f7df7cc9640 1 -- 172.21.15.17:0/1202448207 wait complete. 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 Processor -- start 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 -- start start 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0100cb0 0x7f7df0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 0x7f7df0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7df010c6c0 con 0x7f7df0102060 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7df010c540 con 0x7f7df0100cb0 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df7cc9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7df010c840 con 0x7f7df0101670 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34190/0 (socket says 172.21.15.17:34190) 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 -- 172.21.15.17:0/2780133412 learned_addr learned my addr 172.21.15.17:0/2780133412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df5a65640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0100cb0 0x7f7df0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df5264640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 0x7f7df0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 -- 172.21.15.17:0/2780133412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 msgr2=0x7f7df0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 0x7f7df0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 -- 172.21.15.17:0/2780133412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0100cb0 msgr2=0x7f7df0197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0100cb0 0x7f7df0197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df6266640 1 -- 172.21.15.17:0/2780133412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df019faf0 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.700+0000 7f7df5264640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 0x7f7df0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7df6266640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7de8031ee0 tx=0x7f7de8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8003c30 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de8003dd0 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df019fd80 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de802fbb0 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.701+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df01a0270 con 0x7f7df0102060 2024-09-10T11:42:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.702+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df01a04a0 con 0x7f7df0102060 2024-09-10T11:42:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.703+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7de8004650 con 0x7f7df0102060 2024-09-10T11:42:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.704+0000 7f7de2ffd640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 0x7f7ddc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.704+0000 7f7df5a65640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 0x7f7ddc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:28.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.704+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7de80f04f0 con 0x7f7df0102060 2024-09-10T11:42:28.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.704+0000 7f7df5a65640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 0x7f7ddc0a5050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7df006a150 tx=0x7f7dec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.708+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7de80bd400 con 0x7f7df0102060 2024-09-10T11:42:28.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.885+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7df01a0800 con 0x7f7df0102060 2024-09-10T11:42:28.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.887+0000 7f7de2ffd640 1 -- 172.21.15.17:0/2780133412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7f7de80bcd00 con 0x7f7df0102060 2024-09-10T11:42:28.888 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:28.888 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:42:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 msgr2=0x7f7ddc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 0x7f7ddc0a5050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7df006a150 tx=0x7f7dec00b390 comp rx=0 tx=0).stop 2024-09-10T11:42:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 msgr2=0x7f7df019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:28.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7de8031ee0 tx=0x7f7de8004ab0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 shutdown_connections 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7ddc0a2b90 0x7f7ddc0a5050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df0101670 0x7f7df0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7df0102060 0x7f7df019f480 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 --2- 172.21.15.17:0/2780133412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7df0100cb0 0x7f7df0197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 >> 172.21.15.17:0/2780133412 conn(0x7f7df00fb930 msgr2=0x7f7df00ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 shutdown_connections 2024-09-10T11:42:28.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:28.889+0000 7f7df7cc9640 1 -- 172.21.15.17:0/2780133412 wait complete. 2024-09-10T11:42:28.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:28 smithi017 ceph-mon[30817]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T11:42:28.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:28 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T11:42:28.902 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T11:36:09.827861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T11:40:36.301628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T11:40:38.460005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T11:42:28.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T11:42:28.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:28 smithi081 ceph-mon[35059]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T11:42:28.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:28 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T11:42:29.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:28 smithi026 ceph-mon[34817]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T11:42:29.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:28 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 -- 172.21.15.17:0/1981260238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f94102d20 msgr2=0x7f2f941031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 --2- 172.21.15.17:0/1981260238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f94102d20 0x7f2f941031a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009900 tx=0x7f2f8802a410 comp rx=0 tx=0).stop 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 -- 172.21.15.17:0/1981260238 shutdown_connections 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 --2- 172.21.15.17:0/1981260238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f941036e0 0x7f2f94109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 --2- 172.21.15.17:0/1981260238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f94102d20 0x7f2f941031a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 --2- 172.21.15.17:0/1981260238 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 -- 172.21.15.17:0/1981260238 >> 172.21.15.17:0/1981260238 conn(0x7f2f940fd270 msgr2=0x7f2f940ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 -- 172.21.15.17:0/1981260238 shutdown_connections 2024-09-10T11:42:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.008+0000 7f2f988f8640 1 -- 172.21.15.17:0/1981260238 wait complete. 2024-09-10T11:42:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 Processor -- start 2024-09-10T11:42:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 -- start start 2024-09-10T11:42:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102d20 0x7f2f94198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9410d7b0 con 0x7f2f941036e0 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9410d630 con 0x7f2f94101b30 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f988f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9410d930 con 0x7f2f94102d20 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34212/0 (socket says 172.21.15.17:34212) 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 -- 172.21.15.17:0/2570454091 learned_addr learned my addr 172.21.15.17:0/2570454091 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f91d9b640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102d20 0x7f2f94198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f9259c640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 -- 172.21.15.17:0/2570454091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102d20 msgr2=0x7f2f94198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102d20 0x7f2f94198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 -- 172.21.15.17:0/2570454091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 msgr2=0x7f2f94197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f92d9d640 1 -- 172.21.15.17:0/2570454091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9419fa30 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.009+0000 7f2f9259c640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f92d9d640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00eaa0 tx=0x7f2f8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00cdb0 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8c005020 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9419fd20 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0116b0 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.010+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941a01e0 con 0x7f2f941036e0 2024-09-10T11:42:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.011+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f94108f70 con 0x7f2f941036e0 2024-09-10T11:42:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.012+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2f8c005560 con 0x7f2f941036e0 2024-09-10T11:42:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.012+0000 7f2f837fe640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 0x7f2f7c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.013+0000 7f2f9259c640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 0x7f2f7c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.013+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2f8c0cf330 con 0x7f2f941036e0 2024-09-10T11:42:29.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.013+0000 7f2f9259c640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 0x7f2f7c0a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f94102b80 tx=0x7f2f84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.017+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f8c016030 con 0x7f2f941036e0 2024-09-10T11:42:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.190+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f94062e90 con 0x7f2f941036e0 2024-09-10T11:42:29.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.191+0000 7f2f837fe640 1 -- 172.21.15.17:0/2570454091 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f2f8c09c2a0 con 0x7f2f941036e0 2024-09-10T11:42:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T11:42:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 msgr2=0x7f2f7c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 0x7f2f7c0a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2f94102b80 tx=0x7f2f84005f90 comp rx=0 tx=0).stop 2024-09-10T11:42:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 msgr2=0x7f2f9419f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00eaa0 tx=0x7f2f8c00ef60 comp rx=0 tx=0).stop 2024-09-10T11:42:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 shutdown_connections 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2f7c0a2b90 0x7f2f7c0a5050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102d20 0x7f2f94198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f941036e0 0x7f2f9419f3c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 --2- 172.21.15.17:0/2570454091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f94101b30 0x7f2f94197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 >> 172.21.15.17:0/2570454091 conn(0x7f2f940fd270 msgr2=0x7f2f94106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 shutdown_connections 2024-09-10T11:42:29.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.193+0000 7f2f988f8640 1 -- 172.21.15.17:0/2570454091 wait complete. 2024-09-10T11:42:29.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3622803092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 msgr2=0x7f99e81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3622803092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e81031a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009900 tx=0x7f99dc02a410 comp rx=0 tx=0).stop 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3622803092 shutdown_connections 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3622803092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3622803092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e81031a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3622803092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 0x7f99e8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3622803092 >> 172.21.15.17:0/3622803092 conn(0x7f99e80fd270 msgr2=0x7f99e80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.310+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3622803092 shutdown_connections 2024-09-10T11:42:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3622803092 wait complete. 2024-09-10T11:42:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 Processor -- start 2024-09-10T11:42:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 -- start start 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 0x7f99e8075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99e810d7b0 con 0x7f99e8102d20 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f99e810d630 con 0x7f99e81036e0 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99ee4ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99e810d930 con 0x7f99e8101b30 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.311+0000 7f99e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34234/0 (socket says 172.21.15.17:34234) 2024-09-10T11:42:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 -- 172.21.15.17:0/3296344509 learned_addr learned my addr 172.21.15.17:0/3296344509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99eca49640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e7fff640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 0x7f99e8075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 -- 172.21.15.17:0/3296344509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 msgr2=0x7f99e8075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 0x7f99e8075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 -- 172.21.15.17:0/3296344509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 msgr2=0x7f99e8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 -- 172.21.15.17:0/3296344509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e80753b0 con 0x7f99e8102d20 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99eca49640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e77fe640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009230 tx=0x7f99dc031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc03f030 con 0x7f99e8102d20 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99dc003ad0 con 0x7f99e8102d20 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc035070 con 0x7f99e8102d20 2024-09-10T11:42:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e81a1f50 con 0x7f99e8102d20 2024-09-10T11:42:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.312+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e81a23b0 con 0x7f99e8102d20 2024-09-10T11:42:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.313+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e8108f10 con 0x7f99e8102d20 2024-09-10T11:42:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.314+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f99dc042030 con 0x7f99e8102d20 2024-09-10T11:42:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.315+0000 7f99e57fa640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 0x7f99d00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.315+0000 7f99e7fff640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 0x7f99d00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.315+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f99dc0ef5e0 con 0x7f99e8102d20 2024-09-10T11:42:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.316+0000 7f99e7fff640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 0x7f99d00a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005fd0 tx=0x7f99d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.319+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99dc0bc4f0 con 0x7f99e8102d20 2024-09-10T11:42:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.497+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f99e8062e90 con 0x7f99e8102d20 2024-09-10T11:42:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.497+0000 7f99e57fa640 1 -- 172.21.15.17:0/3296344509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f99dc0bbdf0 con 0x7f99e8102d20 2024-09-10T11:42:29.499 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 msgr2=0x7f99d00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 0x7f99d00a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005fd0 tx=0x7f99d8005850 comp rx=0 tx=0).stop 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 msgr2=0x7f99e80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009230 tx=0x7f99dc031b60 comp rx=0 tx=0).stop 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 shutdown_connections 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99d00a2b90 0x7f99d00a5050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e81036e0 0x7f99e8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e8102d20 0x7f99e80745e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 --2- 172.21.15.17:0/3296344509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99e8101b30 0x7f99e8075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 >> 172.21.15.17:0/3296344509 conn(0x7f99e80fd270 msgr2=0x7f99e81060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 shutdown_connections 2024-09-10T11:42:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.500+0000 7f99ee4ac640 1 -- 172.21.15.17:0/3296344509 wait complete. 2024-09-10T11:42:29.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T11:42:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- 172.21.15.17:0/65910138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84100a50 msgr2=0x7f0d84100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 --2- 172.21.15.17:0/65910138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84100a50 0x7f0d84100e50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009900 tx=0x7f0d7402a410 comp rx=0 tx=0).stop 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- 172.21.15.17:0/65910138 shutdown_connections 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 --2- 172.21.15.17:0/65910138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84102600 0x7f0d84108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 --2- 172.21.15.17:0/65910138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84101c40 0x7f0d841020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 --2- 172.21.15.17:0/65910138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84100a50 0x7f0d84100e50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- 172.21.15.17:0/65910138 >> 172.21.15.17:0/65910138 conn(0x7f0d840fc190 msgr2=0x7f0d840fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- 172.21.15.17:0/65910138 shutdown_connections 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- 172.21.15.17:0/65910138 wait complete. 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 Processor -- start 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.618+0000 7f0d8a942640 1 -- start start 2024-09-10T11:42:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84100a50 0x7f0d8406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 0x7f0d8419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8410c6d0 con 0x7f0d84101c40 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8410c550 con 0x7f0d84102600 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d8a942640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8410c850 con 0x7f0d84100a50 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34242/0 (socket says 172.21.15.17:34242) 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 -- 172.21.15.17:0/507965599 learned_addr learned my addr 172.21.15.17:0/507965599 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d88edf640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 0x7f0d8419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d83fff640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84100a50 0x7f0d8406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 -- 172.21.15.17:0/507965599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84100a50 msgr2=0x7f0d8406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84100a50 0x7f0d8406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 -- 172.21.15.17:0/507965599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 msgr2=0x7f0d8419f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 0x7f0d8419f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 -- 172.21.15.17:0/507965599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8419fb90 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d88edf640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 0x7f0d8419f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.619+0000 7f0d837fe640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c890 tx=0x7f0d7800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.620+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78004220 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.620+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8419fe20 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.620+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d780043c0 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.620+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78004a00 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.620+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d841a0330 con 0x7f0d84101c40 2024-09-10T11:42:29.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.621+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d84107ed0 con 0x7f0d84101c40 2024-09-10T11:42:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.622+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0d780079b0 con 0x7f0d84101c40 2024-09-10T11:42:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.622+0000 7f0d817fa640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 0x7f0d6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.623+0000 7f0d83fff640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 0x7f0d6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.623+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0d780ced60 con 0x7f0d84101c40 2024-09-10T11:42:29.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.623+0000 7f0d83fff640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 0x7f0d6c0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d74000c00 tx=0x7f0d740314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.626+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d78014030 con 0x7f0d84101c40 2024-09-10T11:42:29.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T11:42:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:29 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:42:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2780133412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2570454091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:42:29.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3296344509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:42:29.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.805+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0d84062e90 con 0x7f0d84101c40 2024-09-10T11:42:29.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.805+0000 7f0d817fa640 1 -- 172.21.15.17:0/507965599 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f0d7809bcd0 con 0x7f0d84101c40 2024-09-10T11:42:29.809 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-10T11:42:29.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 msgr2=0x7f0d6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 0x7f0d6c0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d74000c00 tx=0x7f0d740314a0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 msgr2=0x7f0d8419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c890 tx=0x7f0d7800cd50 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 shutdown_connections 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0d6c0a2c10 0x7f0d6c0a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d84102600 0x7f0d8419f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d84101c40 0x7f0d8419cc60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 --2- 172.21.15.17:0/507965599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84100a50 0x7f0d8406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 >> 172.21.15.17:0/507965599 conn(0x7f0d840fc190 msgr2=0x7f0d841050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 shutdown_connections 2024-09-10T11:42:29.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:29.807+0000 7f0d8a942640 1 -- 172.21.15.17:0/507965599 wait complete. 2024-09-10T11:42:29.819 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T11:42:29.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:42:29.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T11:42:29.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:29 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:42:29.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2780133412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:29.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2570454091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:42:29.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3296344509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:42:30.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2376792493' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T11:42:30.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:29 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:42:30.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2780133412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:30.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2570454091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:42:30.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3296344509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:42:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.546+0000 7f26012b8640 1 -- 172.21.15.17:0/1411886841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc106f50 msgr2=0x7f25fc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.546+0000 7f26012b8640 1 --2- 172.21.15.17:0/1411886841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc106f50 0x7f25fc10eaf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009cd0 tx=0x7f25f402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.546+0000 7f26012b8640 1 -- 172.21.15.17:0/1411886841 shutdown_connections 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 --2- 172.21.15.17:0/1411886841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc100ca0 0x7f25fc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 --2- 172.21.15.17:0/1411886841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc106f50 0x7f25fc10eaf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 --2- 172.21.15.17:0/1411886841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc1002f0 0x7f25fc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 -- 172.21.15.17:0/1411886841 >> 172.21.15.17:0/1411886841 conn(0x7f25fc077210 msgr2=0x7f25fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 -- 172.21.15.17:0/1411886841 shutdown_connections 2024-09-10T11:42:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 -- 172.21.15.17:0/1411886841 wait complete. 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 Processor -- start 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 -- start start 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.547+0000 7f26012b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc1002f0 0x7f25fc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc106f50 0x7f25fc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc111fa0 con 0x7f25fc100ca0 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc111e20 con 0x7f25fc106f50 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc112120 con 0x7f25fc1002f0 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34262/0 (socket says 172.21.15.17:34262) 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 -- 172.21.15.17:0/134545904 learned_addr learned my addr 172.21.15.17:0/134545904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25faffd640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc1002f0 0x7f25fc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25fb7fe640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc106f50 0x7f25fc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 -- 172.21.15.17:0/134545904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc1002f0 msgr2=0x7f25fc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc1002f0 0x7f25fc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 -- 172.21.15.17:0/134545904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc106f50 msgr2=0x7f25fc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc106f50 0x7f25fc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 -- 172.21.15.17:0/134545904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc19d450 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f3fff640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d740 tx=0x7f25e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4017070 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc19d740 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25e400de50 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.548+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004e00 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.549+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1a5020 con 0x7f25fc100ca0 2024-09-10T11:42:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.550+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc1006d0 con 0x7f25fc100ca0 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.551+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25e4004fa0 con 0x7f25fc100ca0 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.552+0000 7f25f8ff9640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 0x7f25e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.552+0000 7f25faffd640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 0x7f25e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.553+0000 7f25faffd640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 0x7f25e80a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009bd0 tx=0x7f25ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.553+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f25e4099680 con 0x7f25fc100ca0 2024-09-10T11:42:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.558+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25e409bce0 con 0x7f25fc100ca0 2024-09-10T11:42:30.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.769+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25fc199800 con 0x7f25fc100ca0 2024-09-10T11:42:30.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:30 smithi017 ceph-mon[30817]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:30.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:30 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/507965599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:42:30.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.770+0000 7f25f8ff9640 1 -- 172.21.15.17:0/134545904 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f25fc199800 con 0x7f25fc100ca0 2024-09-10T11:42:30.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:30.772 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-10T11:42:28:538585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:42:28.100418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:42:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-10T11:42:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 msgr2=0x7f25e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 0x7f25e80a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009bd0 tx=0x7f25ec005f90 comp rx=0 tx=0).stop 2024-09-10T11:42:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 msgr2=0x7f25fc1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f25e400d740 tx=0x7f25e400dc00 comp rx=0 tx=0).stop 2024-09-10T11:42:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 shutdown_connections 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25e80a2b80 0x7f25e80a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25fc106f50 0x7f25fc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25fc100ca0 0x7f25fc1989e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 --2- 172.21.15.17:0/134545904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc1002f0 0x7f25fc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 >> 172.21.15.17:0/134545904 conn(0x7f25fc077210 msgr2=0x7f25fc105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 shutdown_connections 2024-09-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:30.772+0000 7f26012b8640 1 -- 172.21.15.17:0/134545904 wait complete. 2024-09-10T11:42:30.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:30 smithi081 ceph-mon[35059]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:30.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:30 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/507965599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:42:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:30 smithi026 ceph-mon[34817]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:30 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/507965599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:42:31.483 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T11:42:31.483 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T11:42:31.483 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 -- 172.21.15.17:0/3917920501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8101c40 msgr2=0x7fa1d81020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 --2- 172.21.15.17:0/3917920501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8101c40 0x7fa1d81020c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009900 tx=0x7fa1c002a410 comp rx=0 tx=0).stop 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 -- 172.21.15.17:0/3917920501 shutdown_connections 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 --2- 172.21.15.17:0/3917920501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8102600 0x7fa1d8108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 --2- 172.21.15.17:0/3917920501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8101c40 0x7fa1d81020c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 --2- 172.21.15.17:0/3917920501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 0x7fa1d8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 -- 172.21.15.17:0/3917920501 >> 172.21.15.17:0/3917920501 conn(0x7fa1d80fc190 msgr2=0x7fa1d80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 -- 172.21.15.17:0/3917920501 shutdown_connections 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.593+0000 7fa1de19f640 1 -- 172.21.15.17:0/3917920501 wait complete. 2024-09-10T11:42:31.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 Processor -- start 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 -- start start 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 0x7fa1d806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8101c40 0x7fa1d819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d810c700 con 0x7fa1d8102600 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d810c580 con 0x7fa1d8100a50 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1de19f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d810c880 con 0x7fa1d8101c40 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41624/0 (socket says 172.21.15.17:41624) 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 -- 172.21.15.17:0/484934096 learned_addr learned my addr 172.21.15.17:0/484934096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d77fe640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 0x7fa1d806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1cffff640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8101c40 0x7fa1d819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 -- 172.21.15.17:0/484934096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8101c40 msgr2=0x7fa1d819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8101c40 0x7fa1d819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 -- 172.21.15.17:0/484934096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 msgr2=0x7fa1d806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 0x7fa1d806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.594+0000 7fa1d7fff640 1 -- 172.21.15.17:0/484934096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d819fb30 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1d7fff640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009fd0 tx=0x7fa1d000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0017070 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d819fdc0 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d0003e50 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00106c0 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.595+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d81a0230 con 0x7fa1d8102600 2024-09-10T11:42:31.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.596+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d8107e40 con 0x7fa1d8102600 2024-09-10T11:42:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.597+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa1d0003970 con 0x7fa1d8102600 2024-09-10T11:42:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.597+0000 7fa1d57fa640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 0x7fa1c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.598+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa1d00cedd0 con 0x7fa1d8102600 2024-09-10T11:42:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.598+0000 7fa1d77fe640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 0x7fa1c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.598+0000 7fa1d77fe640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 0x7fa1c40a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8101aa0 tx=0x7fa1c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:31.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.602+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1d009bd40 con 0x7fa1d8102600 2024-09-10T11:42:31.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:31 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/134545904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.773+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1d8062630 con 0x7fa1c40a2b90 2024-09-10T11:42:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.780+0000 7fa1d57fa640 1 -- 172.21.15.17:0/484934096 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7fa1d8062630 con 0x7fa1c40a2b90 2024-09-10T11:42:31.784 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 msgr2=0x7fa1c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 0x7fa1c40a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8101aa0 tx=0x7fa1c800b390 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 msgr2=0x7fa1d819f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009fd0 tx=0x7fa1d000b260 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 shutdown_connections 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa1c40a2b90 0x7fa1c40a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1d8101c40 0x7fa1d819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d8102600 0x7fa1d819f220 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 --2- 172.21.15.17:0/484934096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d8100a50 0x7fa1d806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 >> 172.21.15.17:0/484934096 conn(0x7fa1d80fc190 msgr2=0x7fa1d8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:31.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 shutdown_connections 2024-09-10T11:42:31.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.783+0000 7fa1de19f640 1 -- 172.21.15.17:0/484934096 wait complete. 2024-09-10T11:42:31.795 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-10T11:42:31.435622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665581,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":707,"num_write":443,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391548,"kb_used_data":13180,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550276,"statfs":{"total":1151940427776,"available":1151539482624,"internally_reserved":0,"allocated":13496320,"data_stored":7421731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5461,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":75,"num_write":15,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002954"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427702+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:42:23.427702+0000","last_peered":"2024-09-10T11:42:23.427702+0000","last_clean":"2024-09-10T11:42:23.427702+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:42:23.427702+0000","last_undegraded":"2024-09-10T11:42:23.427702+0000","last_fullsized":"2024-09-10T11:42:23.427702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419067+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:42:23.419067+0000","last_peered":"2024-09-10T11:42:23.419067+0000","last_clean":"2024-09-10T11:42:23.419067+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:42:23.419067+0000","last_undegraded":"2024-09-10T11:42:23.419067+0000","last_fullsized":"2024-09-10T11:42:23.419067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427705+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:42:23.427705+0000","last_peered":"2024-09-10T11:42:23.427705+0000","last_clean":"2024-09-10T11:42:23.427705+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:42:23.427705+0000","last_undegraded":"2024-09-10T11:42:23.427705+0000","last_fullsized":"2024-09-10T11:42:23.427705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422869+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:42:23.422869+0000","last_peered":"2024-09-10T11:42:23.422869+0000","last_clean":"2024-09-10T11:42:23.422869+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:42:23.422869+0000","last_undegraded":"2024-09-10T11:42:23.422869+0000","last_fullsized":"2024-09-10T11:42:23.422869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420187+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:42:23.420187+0000","last_peered":"2024-09-10T11:42:23.420187+0000","last_clean":"2024-09-10T11:42:23.420187+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:42:23.420187+0000","last_undegraded":"2024-09-10T11:42:23.420187+0000","last_fullsized":"2024-09-10T11:42:23.420187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414331+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:42:23.414331+0000","last_peered":"2024-09-10T11:42:23.414331+0000","last_clean":"2024-09-10T11:42:23.414331+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:42:23.414331+0000","last_undegraded":"2024-09-10T11:42:23.414331+0000","last_fullsized":"2024-09-10T11:42:23.414331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432151+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:42:23.432151+0000","last_peered":"2024-09-10T11:42:23.432151+0000","last_clean":"2024-09-10T11:42:23.432151+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:42:23.432151+0000","last_undegraded":"2024-09-10T11:42:23.432151+0000","last_fullsized":"2024-09-10T11:42:23.432151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419427+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:42:23.419427+0000","last_peered":"2024-09-10T11:42:23.419427+0000","last_clean":"2024-09-10T11:42:23.419427+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:42:23.419427+0000","last_undegraded":"2024-09-10T11:42:23.419427+0000","last_fullsized":"2024-09-10T11:42:23.419427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430276+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:42:23.430276+0000","last_peered":"2024-09-10T11:42:23.430276+0000","last_clean":"2024-09-10T11:42:23.430276+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:42:23.430276+0000","last_undegraded":"2024-09-10T11:42:23.430276+0000","last_fullsized":"2024-09-10T11:42:23.430276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431042+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:42:23.431042+0000","last_peered":"2024-09-10T11:42:23.431042+0000","last_clean":"2024-09-10T11:42:23.431042+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:42:23.431042+0000","last_undegraded":"2024-09-10T11:42:23.431042+0000","last_fullsized":"2024-09-10T11:42:23.431042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426662+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:42:23.426662+0000","last_peered":"2024-09-10T11:42:23.426662+0000","last_clean":"2024-09-10T11:42:23.426662+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:42:23.426662+0000","last_undegraded":"2024-09-10T11:42:23.426662+0000","last_fullsized":"2024-09-10T11:42:23.426662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421278+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:42:23.421278+0000","last_peered":"2024-09-10T11:42:23.421278+0000","last_clean":"2024-09-10T11:42:23.421278+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:42:23.421278+0000","last_undegraded":"2024-09-10T11:42:23.421278+0000","last_fullsized":"2024-09-10T11:42:23.421278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418911+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:42:23.418911+0000","last_peered":"2024-09-10T11:42:23.418911+0000","last_clean":"2024-09-10T11:42:23.418911+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:42:23.418911+0000","last_undegraded":"2024-09-10T11:42:23.418911+0000","last_fullsized":"2024-09-10T11:42:23.418911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421710+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:42:23.421710+0000","last_peered":"2024-09-10T11:42:23.421710+0000","last_clean":"2024-09-10T11:42:23.421710+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:42:23.421710+0000","last_undegraded":"2024-09-10T11:42:23.421710+0000","last_fullsized":"2024-09-10T11:42:23.421710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434563+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:42:23.434563+0000","last_peered":"2024-09-10T11:42:23.434563+0000","last_clean":"2024-09-10T11:42:23.434563+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:42:23.434563+0000","last_undegraded":"2024-09-10T11:42:23.434563+0000","last_fullsized":"2024-09-10T11:42:23.434563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429338+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:42:23.429338+0000","last_peered":"2024-09-10T11:42:23.429338+0000","last_clean":"2024-09-10T11:42:23.429338+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:42:23.429338+0000","last_undegraded":"2024-09-10T11:42:23.429338+0000","last_fullsized":"2024-09-10T11:42:23.429338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426188+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:42:23.426188+0000","last_peered":"2024-09-10T11:42:23.426188+0000","last_clean":"2024-09-10T11:42:23.426188+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:42:23.426188+0000","last_undegraded":"2024-09-10T11:42:23.426188+0000","last_fullsized":"2024-09-10T11:42:23.426188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416649+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:42:23.416649+0000","last_peered":"2024-09-10T11:42:23.416649+0000","last_clean":"2024-09-10T11:42:23.416649+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:42:23.416649+0000","last_undegraded":"2024-09-10T11:42:23.416649+0000","last_fullsized":"2024-09-10T11:42:23.416649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426528+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:42:23.426528+0000","last_peered":"2024-09-10T11:42:23.426528+0000","last_clean":"2024-09-10T11:42:23.426528+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:42:23.426528+0000","last_undegraded":"2024-09-10T11:42:23.426528+0000","last_fullsized":"2024-09-10T11:42:23.426528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431087+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:42:23.431087+0000","last_peered":"2024-09-10T11:42:23.431087+0000","last_clean":"2024-09-10T11:42:23.431087+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:42:23.431087+0000","last_undegraded":"2024-09-10T11:42:23.431087+0000","last_fullsized":"2024-09-10T11:42:23.431087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434978+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:42:23.434978+0000","last_peered":"2024-09-10T11:42:23.434978+0000","last_clean":"2024-09-10T11:42:23.434978+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:42:23.434978+0000","last_undegraded":"2024-09-10T11:42:23.434978+0000","last_fullsized":"2024-09-10T11:42:23.434978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415943+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:42:23.415943+0000","last_peered":"2024-09-10T11:42:23.415943+0000","last_clean":"2024-09-10T11:42:23.415943+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:42:23.415943+0000","last_undegraded":"2024-09-10T11:42:23.415943+0000","last_fullsized":"2024-09-10T11:42:23.415943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422864+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:42:23.422864+0000","last_peered":"2024-09-10T11:42:23.422864+0000","last_clean":"2024-09-10T11:42:23.422864+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:42:23.422864+0000","last_undegraded":"2024-09-10T11:42:23.422864+0000","last_fullsized":"2024-09-10T11:42:23.422864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.405282+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:42:23.405282+0000","last_peered":"2024-09-10T11:42:23.405282+0000","last_clean":"2024-09-10T11:42:23.405282+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:42:23.405282+0000","last_undegraded":"2024-09-10T11:42:23.405282+0000","last_fullsized":"2024-09-10T11:42:23.405282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428751+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:42:23.428751+0000","last_peered":"2024-09-10T11:42:23.428751+0000","last_clean":"2024-09-10T11:42:23.428751+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:42:23.428751+0000","last_undegraded":"2024-09-10T11:42:23.428751+0000","last_fullsized":"2024-09-10T11:42:23.428751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426208+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:42:23.426208+0000","last_peered":"2024-09-10T11:42:23.426208+0000","last_clean":"2024-09-10T11:42:23.426208+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:42:23.426208+0000","last_undegraded":"2024-09-10T11:42:23.426208+0000","last_fullsized":"2024-09-10T11:42:23.426208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420466+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:42:23.420466+0000","last_peered":"2024-09-10T11:42:23.420466+0000","last_clean":"2024-09-10T11:42:23.420466+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:42:23.420466+0000","last_undegraded":"2024-09-10T11:42:23.420466+0000","last_fullsized":"2024-09-10T11:42:23.420466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420513+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:42:23.420513+0000","last_peered":"2024-09-10T11:42:23.420513+0000","last_clean":"2024-09-10T11:42:23.420513+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:42:23.420513+0000","last_undegraded":"2024-09-10T11:42:23.420513+0000","last_fullsized":"2024-09-10T11:42:23.420513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422634+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:42:23.422634+0000","last_peered":"2024-09-10T11:42:23.422634+0000","last_clean":"2024-09-10T11:42:23.422634+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:42:23.422634+0000","last_undegraded":"2024-09-10T11:42:23.422634+0000","last_fullsized":"2024-09-10T11:42:23.422634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425047+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:42:23.425047+0000","last_peered":"2024-09-10T11:42:23.425047+0000","last_clean":"2024-09-10T11:42:23.425047+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:42:23.425047+0000","last_undegraded":"2024-09-10T11:42:23.425047+0000","last_fullsized":"2024-09-10T11:42:23.425047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425372+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:42:23.425372+0000","last_peered":"2024-09-10T11:42:23.425372+0000","last_clean":"2024-09-10T11:42:23.425372+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:42:23.425372+0000","last_undegraded":"2024-09-10T11:42:23.425372+0000","last_fullsized":"2024-09-10T11:42:23.425372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415080+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:42:23.415080+0000","last_peered":"2024-09-10T11:42:23.415080+0000","last_clean":"2024-09-10T11:42:23.415080+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:42:23.415080+0000","last_undegraded":"2024-09-10T11:42:23.415080+0000","last_fullsized":"2024-09-10T11:42:23.415080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:27.688909+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:42:27.688909+0000","last_peered":"2024-09-10T11:42:27.688909+0000","last_clean":"2024-09-10T11:42:27.688909+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:42:27.688909+0000","last_undegraded":"2024-09-10T11:42:27.688909+0000","last_fullsized":"2024-09-10T11:42:27.688909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429245+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:42:23.429245+0000","last_peered":"2024-09-10T11:42:23.429245+0000","last_clean":"2024-09-10T11:42:23.429245+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:42:23.429245+0000","last_undegraded":"2024-09-10T11:42:23.429245+0000","last_fullsized":"2024-09-10T11:42:23.429245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416384+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:42:23.416384+0000","last_peered":"2024-09-10T11:42:23.416384+0000","last_clean":"2024-09-10T11:42:23.416384+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:42:23.416384+0000","last_undegraded":"2024-09-10T11:42:23.416384+0000","last_fullsized":"2024-09-10T11:42:23.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420739+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:42:23.420739+0000","last_peered":"2024-09-10T11:42:23.420739+0000","last_clean":"2024-09-10T11:42:23.420739+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:42:23.420739+0000","last_undegraded":"2024-09-10T11:42:23.420739+0000","last_fullsized":"2024-09-10T11:42:23.420739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692336+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:42:30.692336+0000","last_peered":"2024-09-10T11:42:30.692336+0000","last_clean":"2024-09-10T11:42:30.692336+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:42:30.692336+0000","last_undegraded":"2024-09-10T11:42:30.692336+0000","last_fullsized":"2024-09-10T11:42:30.692336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432288+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:42:23.432288+0000","last_peered":"2024-09-10T11:42:23.432288+0000","last_clean":"2024-09-10T11:42:23.432288+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:42:23.432288+0000","last_undegraded":"2024-09-10T11:42:23.432288+0000","last_fullsized":"2024-09-10T11:42:23.432288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417659+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:42:23.417659+0000","last_peered":"2024-09-10T11:42:23.417659+0000","last_clean":"2024-09-10T11:42:23.417659+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:42:23.417659+0000","last_undegraded":"2024-09-10T11:42:23.417659+0000","last_fullsized":"2024-09-10T11:42:23.417659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430925+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:42:23.430925+0000","last_peered":"2024-09-10T11:42:23.430925+0000","last_clean":"2024-09-10T11:42:23.430925+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:42:23.430925+0000","last_undegraded":"2024-09-10T11:42:23.430925+0000","last_fullsized":"2024-09-10T11:42:23.430925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'38","reported_seq":272,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692691+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:42:30.692691+0000","last_peered":"2024-09-10T11:42:30.692691+0000","last_clean":"2024-09-10T11:42:30.692691+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:42:30.692691+0000","last_undegraded":"2024-09-10T11:42:30.692691+0000","last_fullsized":"2024-09-10T11:42:30.692691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.424458+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:42:23.424458+0000","last_peered":"2024-09-10T11:42:23.424458+0000","last_clean":"2024-09-10T11:42:23.424458+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:42:23.424458+0000","last_undegraded":"2024-09-10T11:42:23.424458+0000","last_fullsized":"2024-09-10T11:42:23.424458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430680+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:42:23.430680+0000","last_peered":"2024-09-10T11:42:23.430680+0000","last_clean":"2024-09-10T11:42:23.430680+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:42:23.430680+0000","last_undegraded":"2024-09-10T11:42:23.430680+0000","last_fullsized":"2024-09-10T11:42:23.430680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433173+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:42:23.433173+0000","last_peered":"2024-09-10T11:42:23.433173+0000","last_clean":"2024-09-10T11:42:23.433173+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:42:23.433173+0000","last_undegraded":"2024-09-10T11:42:23.433173+0000","last_fullsized":"2024-09-10T11:42:23.433173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.674357+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:42:26.674357+0000","last_peered":"2024-09-10T11:42:26.674357+0000","last_clean":"2024-09-10T11:42:26.674357+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:42:26.674357+0000","last_undegraded":"2024-09-10T11:42:26.674357+0000","last_fullsized":"2024-09-10T11:42:26.674357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432214+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:42:23.432214+0000","last_peered":"2024-09-10T11:42:23.432214+0000","last_clean":"2024-09-10T11:42:23.432214+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:42:23.432214+0000","last_undegraded":"2024-09-10T11:42:23.432214+0000","last_fullsized":"2024-09-10T11:42:23.432214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434847+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:42:23.434847+0000","last_peered":"2024-09-10T11:42:23.434847+0000","last_clean":"2024-09-10T11:42:23.434847+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:42:23.434847+0000","last_undegraded":"2024-09-10T11:42:23.434847+0000","last_fullsized":"2024-09-10T11:42:23.434847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426167+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:42:23.426167+0000","last_peered":"2024-09-10T11:42:23.426167+0000","last_clean":"2024-09-10T11:42:23.426167+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:42:23.426167+0000","last_undegraded":"2024-09-10T11:42:23.426167+0000","last_fullsized":"2024-09-10T11:42:23.426167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433839+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:42:23.433839+0000","last_peered":"2024-09-10T11:42:23.433839+0000","last_clean":"2024-09-10T11:42:23.433839+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:42:23.433839+0000","last_undegraded":"2024-09-10T11:42:23.433839+0000","last_fullsized":"2024-09-10T11:42:23.433839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432616+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:42:23.432616+0000","last_peered":"2024-09-10T11:42:23.432616+0000","last_clean":"2024-09-10T11:42:23.432616+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:42:23.432616+0000","last_undegraded":"2024-09-10T11:42:23.432616+0000","last_fullsized":"2024-09-10T11:42:23.432616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.687353+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:42:26.687353+0000","last_peered":"2024-09-10T11:42:26.687353+0000","last_clean":"2024-09-10T11:42:26.687353+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:42:26.687353+0000","last_undegraded":"2024-09-10T11:42:26.687353+0000","last_fullsized":"2024-09-10T11:42:26.687353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558595+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558595+0000","last_peered":"2024-09-10T11:40:54.558595+0000","last_clean":"2024-09-10T11:40:54.558595+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558595+0000","last_undegraded":"2024-09-10T11:40:54.558595+0000","last_fullsized":"2024-09-10T11:40:54.558595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418491+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:42:23.418491+0000","last_peered":"2024-09-10T11:42:23.418491+0000","last_clean":"2024-09-10T11:42:23.418491+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:42:23.418491+0000","last_undegraded":"2024-09-10T11:42:23.418491+0000","last_fullsized":"2024-09-10T11:42:23.418491+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417447+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:42:23.417447+0000","last_peered":"2024-09-10T11:42:23.417447+0000","last_clean":"2024-09-10T11:42:23.417447+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:42:23.417447+0000","last_undegraded":"2024-09-10T11:42:23.417447+0000","last_fullsized":"2024-09-10T11:42:23.417447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.673871+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:42:26.673871+0000","last_peered":"2024-09-10T11:42:26.673871+0000","last_clean":"2024-09-10T11:42:26.673871+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:42:26.673871+0000","last_undegraded":"2024-09-10T11:42:26.673871+0000","last_fullsized":"2024-09-10T11:42:26.673871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428767+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:42:23.428767+0000","last_peered":"2024-09-10T11:42:23.428767+0000","last_clean":"2024-09-10T11:42:23.428767+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:42:23.428767+0000","last_undegraded":"2024-09-10T11:42:23.428767+0000","last_fullsized":"2024-09-10T11:42:23.428767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'7","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:25.672538+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:42:25.672538+0000","last_peered":"2024-09-10T11:42:25.672538+0000","last_clean":"2024-09-10T11:42:25.672538+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:42:25.672538+0000","last_undegraded":"2024-09-10T11:42:25.672538+0000","last_fullsized":"2024-09-10T11:42:25.672538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415667+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:42:23.415667+0000","last_peered":"2024-09-10T11:42:23.415667+0000","last_clean":"2024-09-10T11:42:23.415667+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:42:23.415667+0000","last_undegraded":"2024-09-10T11:42:23.415667+0000","last_fullsized":"2024-09-10T11:42:23.415667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420888+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:42:23.420888+0000","last_peered":"2024-09-10T11:42:23.420888+0000","last_clean":"2024-09-10T11:42:23.420888+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:42:23.420888+0000","last_undegraded":"2024-09-10T11:42:23.420888+0000","last_fullsized":"2024-09-10T11:42:23.420888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418551+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:42:23.418551+0000","last_peered":"2024-09-10T11:42:23.418551+0000","last_clean":"2024-09-10T11:42:23.418551+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:42:23.418551+0000","last_undegraded":"2024-09-10T11:42:23.418551+0000","last_fullsized":"2024-09-10T11:42:23.418551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:05.498359+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:41:05.498359+0000","last_peered":"2024-09-10T11:41:05.498359+0000","last_clean":"2024-09-10T11:41:05.498359+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:41:05.498359+0000","last_undegraded":"2024-09-10T11:41:05.498359+0000","last_fullsized":"2024-09-10T11:41:05.498359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416697+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:42:23.416697+0000","last_peered":"2024-09-10T11:42:23.416697+0000","last_clean":"2024-09-10T11:42:23.416697+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:42:23.416697+0000","last_undegraded":"2024-09-10T11:42:23.416697+0000","last_fullsized":"2024-09-10T11:42:23.416697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417486+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:42:23.417486+0000","last_peered":"2024-09-10T11:42:23.417486+0000","last_clean":"2024-09-10T11:42:23.417486+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:42:23.417486+0000","last_undegraded":"2024-09-10T11:42:23.417486+0000","last_fullsized":"2024-09-10T11:42:23.417486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.390251+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:42:23.390251+0000","last_peered":"2024-09-10T11:42:23.390251+0000","last_clean":"2024-09-10T11:42:23.390251+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:42:23.390251+0000","last_undegraded":"2024-09-10T11:42:23.390251+0000","last_fullsized":"2024-09-10T11:42:23.390251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425892+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:42:23.425892+0000","last_peered":"2024-09-10T11:42:23.425892+0000","last_clean":"2024-09-10T11:42:23.425892+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:42:23.425892+0000","last_undegraded":"2024-09-10T11:42:23.425892+0000","last_fullsized":"2024-09-10T11:42:23.425892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548480+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548480+0000","last_peered":"2024-09-10T11:40:54.548480+0000","last_clean":"2024-09-10T11:40:54.548480+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548480+0000","last_undegraded":"2024-09-10T11:40:54.548480+0000","last_fullsized":"2024-09-10T11:40:54.548480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414620+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:42:23.414620+0000","last_peered":"2024-09-10T11:42:23.414620+0000","last_clean":"2024-09-10T11:42:23.414620+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:42:23.414620+0000","last_undegraded":"2024-09-10T11:42:23.414620+0000","last_fullsized":"2024-09-10T11:42:23.414620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435462+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:42:23.435462+0000","last_peered":"2024-09-10T11:42:23.435462+0000","last_clean":"2024-09-10T11:42:23.435462+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:42:23.435462+0000","last_undegraded":"2024-09-10T11:42:23.435462+0000","last_fullsized":"2024-09-10T11:42:23.435462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435509+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:42:23.435509+0000","last_peered":"2024-09-10T11:42:23.435509+0000","last_clean":"2024-09-10T11:42:23.435509+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:42:23.435509+0000","last_undegraded":"2024-09-10T11:42:23.435509+0000","last_fullsized":"2024-09-10T11:42:23.435509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432541+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:42:23.432541+0000","last_peered":"2024-09-10T11:42:23.432541+0000","last_clean":"2024-09-10T11:42:23.432541+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:42:23.432541+0000","last_undegraded":"2024-09-10T11:42:23.432541+0000","last_fullsized":"2024-09-10T11:42:23.432541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427749+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:42:23.427749+0000","last_peered":"2024-09-10T11:42:23.427749+0000","last_clean":"2024-09-10T11:42:23.427749+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:42:23.427749+0000","last_undegraded":"2024-09-10T11:42:23.427749+0000","last_fullsized":"2024-09-10T11:42:23.427749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418362+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:42:23.418362+0000","last_peered":"2024-09-10T11:42:23.418362+0000","last_clean":"2024-09-10T11:42:23.418362+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:42:23.418362+0000","last_undegraded":"2024-09-10T11:42:23.418362+0000","last_fullsized":"2024-09-10T11:42:23.418362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:24.670472+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:42:24.670472+0000","last_peered":"2024-09-10T11:42:24.670472+0000","last_clean":"2024-09-10T11:42:24.670472+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:42:24.670472+0000","last_undegraded":"2024-09-10T11:42:24.670472+0000","last_fullsized":"2024-09-10T11:42:24.670472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74979,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1025,"num_read_kb":598,"num_write":260,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":216001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678055,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1646592,"data_stored":1112763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103218,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":454200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":454061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":517974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:42:31.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 -- 172.21.15.17:0/196831966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8430101b40 msgr2=0x7f8430101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 --2- 172.21.15.17:0/196831966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8430101b40 0x7f8430101f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8420009900 tx=0x7f842002a410 comp rx=0 tx=0).stop 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 -- 172.21.15.17:0/196831966 shutdown_connections 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 --2- 172.21.15.17:0/196831966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84301036f0 0x7f8430109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 --2- 172.21.15.17:0/196831966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430102d30 0x7f84301031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 --2- 172.21.15.17:0/196831966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8430101b40 0x7f8430101f40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 -- 172.21.15.17:0/196831966 >> 172.21.15.17:0/196831966 conn(0x7f84300fd2a0 msgr2=0x7f84300ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 -- 172.21.15.17:0/196831966 shutdown_connections 2024-09-10T11:42:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.938+0000 7f8435bc4640 1 -- 172.21.15.17:0/196831966 wait complete. 2024-09-10T11:42:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 Processor -- start 2024-09-10T11:42:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 -- start start 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430101b40 0x7f8430197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8430102d30 0x7f8430198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f843010d810 con 0x7f84301036f0 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f843010d690 con 0x7f8430101b40 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f8435bc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f843010d990 con 0x7f8430102d30 2024-09-10T11:42:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.939+0000 7f842ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41648/0 (socket says 172.21.15.17:41648) 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 -- 172.21.15.17:0/2716228890 learned_addr learned my addr 172.21.15.17:0/2716228890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842f7fe640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430101b40 0x7f8430197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f8426ffd640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8430102d30 0x7f8430198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 -- 172.21.15.17:0/2716228890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8430102d30 msgr2=0x7f8430198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8430102d30 0x7f8430198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 -- 172.21.15.17:0/2716228890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430101b40 msgr2=0x7f8430197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430101b40 0x7f8430197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 -- 172.21.15.17:0/2716228890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843019fa00 con 0x7f84301036f0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842ffff640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f842800eb10 tx=0x7f842800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842800ce20 con 0x7f84301036f0 2024-09-10T11:42:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8428005020 con 0x7f84301036f0 2024-09-10T11:42:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843019fcf0 con 0x7f84301036f0 2024-09-10T11:42:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428010690 con 0x7f84301036f0 2024-09-10T11:42:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.940+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84301a01e0 con 0x7f84301036f0 2024-09-10T11:42:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.941+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8430108e60 con 0x7f84301036f0 2024-09-10T11:42:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.943+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8428005540 con 0x7f84301036f0 2024-09-10T11:42:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.943+0000 7f842d7fa640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 0x7f841c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.944+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f84280cfa20 con 0x7f84301036f0 2024-09-10T11:42:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.944+0000 7f842f7fe640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 0x7f841c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.944+0000 7f842f7fe640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 0x7f841c0a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f842002aa00 tx=0x7f84200315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:31.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:31.946+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f842809c990 con 0x7f84301036f0 2024-09-10T11:42:31.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:31 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/134545904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:32.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:31 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/134545904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.137+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8430062630 con 0x7f841c0a2b90 2024-09-10T11:42:32.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.144+0000 7f842d7fa640 1 -- 172.21.15.17:0/2716228890 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f8430062630 con 0x7f841c0a2b90 2024-09-10T11:42:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:42:32.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 msgr2=0x7f841c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 0x7f841c0a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f842002aa00 tx=0x7f84200315b0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 msgr2=0x7f843019f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f842800eb10 tx=0x7f842800ef10 comp rx=0 tx=0).stop 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 shutdown_connections 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f841c0a2b90 0x7f841c0a5050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8430102d30 0x7f8430198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84301036f0 0x7f843019f390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 --2- 172.21.15.17:0/2716228890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8430101b40 0x7f8430197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 >> 172.21.15.17:0/2716228890 conn(0x7f84300fd2a0 msgr2=0x7f8430106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 shutdown_connections 2024-09-10T11:42:32.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.147+0000 7f8435bc4640 1 -- 172.21.15.17:0/2716228890 wait complete. 2024-09-10T11:42:32.159 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-10T11:42:31.435622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665581,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":707,"num_write":443,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391548,"kb_used_data":13180,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550276,"statfs":{"total":1151940427776,"available":1151539482624,"internally_reserved":0,"allocated":13496320,"data_stored":7421731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5461,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":75,"num_write":15,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002954"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427702+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:42:23.427702+0000","last_peered":"2024-09-10T11:42:23.427702+0000","last_clean":"2024-09-10T11:42:23.427702+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:42:23.427702+0000","last_undegraded":"2024-09-10T11:42:23.427702+0000","last_fullsized":"2024-09-10T11:42:23.427702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419067+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:42:23.419067+0000","last_peered":"2024-09-10T11:42:23.419067+0000","last_clean":"2024-09-10T11:42:23.419067+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:42:23.419067+0000","last_undegraded":"2024-09-10T11:42:23.419067+0000","last_fullsized":"2024-09-10T11:42:23.419067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427705+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:42:23.427705+0000","last_peered":"2024-09-10T11:42:23.427705+0000","last_clean":"2024-09-10T11:42:23.427705+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:42:23.427705+0000","last_undegraded":"2024-09-10T11:42:23.427705+0000","last_fullsized":"2024-09-10T11:42:23.427705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422869+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:42:23.422869+0000","last_peered":"2024-09-10T11:42:23.422869+0000","last_clean":"2024-09-10T11:42:23.422869+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:42:23.422869+0000","last_undegraded":"2024-09-10T11:42:23.422869+0000","last_fullsized":"2024-09-10T11:42:23.422869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420187+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:42:23.420187+0000","last_peered":"2024-09-10T11:42:23.420187+0000","last_clean":"2024-09-10T11:42:23.420187+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:42:23.420187+0000","last_undegraded":"2024-09-10T11:42:23.420187+0000","last_fullsized":"2024-09-10T11:42:23.420187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414331+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:42:23.414331+0000","last_peered":"2024-09-10T11:42:23.414331+0000","last_clean":"2024-09-10T11:42:23.414331+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:42:23.414331+0000","last_undegraded":"2024-09-10T11:42:23.414331+0000","last_fullsized":"2024-09-10T11:42:23.414331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432151+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:42:23.432151+0000","last_peered":"2024-09-10T11:42:23.432151+0000","last_clean":"2024-09-10T11:42:23.432151+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:42:23.432151+0000","last_undegraded":"2024-09-10T11:42:23.432151+0000","last_fullsized":"2024-09-10T11:42:23.432151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419427+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:42:23.419427+0000","last_peered":"2024-09-10T11:42:23.419427+0000","last_clean":"2024-09-10T11:42:23.419427+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:42:23.419427+0000","last_undegraded":"2024-09-10T11:42:23.419427+0000","last_fullsized":"2024-09-10T11:42:23.419427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430276+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:42:23.430276+0000","last_peered":"2024-09-10T11:42:23.430276+0000","last_clean":"2024-09-10T11:42:23.430276+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:42:23.430276+0000","last_undegraded":"2024-09-10T11:42:23.430276+0000","last_fullsized":"2024-09-10T11:42:23.430276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431042+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:42:23.431042+0000","last_peered":"2024-09-10T11:42:23.431042+0000","last_clean":"2024-09-10T11:42:23.431042+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:42:23.431042+0000","last_undegraded":"2024-09-10T11:42:23.431042+0000","last_fullsized":"2024-09-10T11:42:23.431042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426662+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:42:23.426662+0000","last_peered":"2024-09-10T11:42:23.426662+0000","last_clean":"2024-09-10T11:42:23.426662+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:42:23.426662+0000","last_undegraded":"2024-09-10T11:42:23.426662+0000","last_fullsized":"2024-09-10T11:42:23.426662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421278+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:42:23.421278+0000","last_peered":"2024-09-10T11:42:23.421278+0000","last_clean":"2024-09-10T11:42:23.421278+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:42:23.421278+0000","last_undegraded":"2024-09-10T11:42:23.421278+0000","last_fullsized":"2024-09-10T11:42:23.421278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418911+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:42:23.418911+0000","last_peered":"2024-09-10T11:42:23.418911+0000","last_clean":"2024-09-10T11:42:23.418911+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:42:23.418911+0000","last_undegraded":"2024-09-10T11:42:23.418911+0000","last_fullsized":"2024-09-10T11:42:23.418911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421710+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:42:23.421710+0000","last_peered":"2024-09-10T11:42:23.421710+0000","last_clean":"2024-09-10T11:42:23.421710+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:42:23.421710+0000","last_undegraded":"2024-09-10T11:42:23.421710+0000","last_fullsized":"2024-09-10T11:42:23.421710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434563+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:42:23.434563+0000","last_peered":"2024-09-10T11:42:23.434563+0000","last_clean":"2024-09-10T11:42:23.434563+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:42:23.434563+0000","last_undegraded":"2024-09-10T11:42:23.434563+0000","last_fullsized":"2024-09-10T11:42:23.434563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429338+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:42:23.429338+0000","last_peered":"2024-09-10T11:42:23.429338+0000","last_clean":"2024-09-10T11:42:23.429338+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:42:23.429338+0000","last_undegraded":"2024-09-10T11:42:23.429338+0000","last_fullsized":"2024-09-10T11:42:23.429338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426188+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:42:23.426188+0000","last_peered":"2024-09-10T11:42:23.426188+0000","last_clean":"2024-09-10T11:42:23.426188+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:42:23.426188+0000","last_undegraded":"2024-09-10T11:42:23.426188+0000","last_fullsized":"2024-09-10T11:42:23.426188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416649+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:42:23.416649+0000","last_peered":"2024-09-10T11:42:23.416649+0000","last_clean":"2024-09-10T11:42:23.416649+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:42:23.416649+0000","last_undegraded":"2024-09-10T11:42:23.416649+0000","last_fullsized":"2024-09-10T11:42:23.416649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426528+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:42:23.426528+0000","last_peered":"2024-09-10T11:42:23.426528+0000","last_clean":"2024-09-10T11:42:23.426528+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:42:23.426528+0000","last_undegraded":"2024-09-10T11:42:23.426528+0000","last_fullsized":"2024-09-10T11:42:23.426528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431087+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:42:23.431087+0000","last_peered":"2024-09-10T11:42:23.431087+0000","last_clean":"2024-09-10T11:42:23.431087+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:42:23.431087+0000","last_undegraded":"2024-09-10T11:42:23.431087+0000","last_fullsized":"2024-09-10T11:42:23.431087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434978+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:42:23.434978+0000","last_peered":"2024-09-10T11:42:23.434978+0000","last_clean":"2024-09-10T11:42:23.434978+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:42:23.434978+0000","last_undegraded":"2024-09-10T11:42:23.434978+0000","last_fullsized":"2024-09-10T11:42:23.434978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415943+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:42:23.415943+0000","last_peered":"2024-09-10T11:42:23.415943+0000","last_clean":"2024-09-10T11:42:23.415943+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:42:23.415943+0000","last_undegraded":"2024-09-10T11:42:23.415943+0000","last_fullsized":"2024-09-10T11:42:23.415943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422864+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:42:23.422864+0000","last_peered":"2024-09-10T11:42:23.422864+0000","last_clean":"2024-09-10T11:42:23.422864+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:42:23.422864+0000","last_undegraded":"2024-09-10T11:42:23.422864+0000","last_fullsized":"2024-09-10T11:42:23.422864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.405282+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:42:23.405282+0000","last_peered":"2024-09-10T11:42:23.405282+0000","last_clean":"2024-09-10T11:42:23.405282+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:42:23.405282+0000","last_undegraded":"2024-09-10T11:42:23.405282+0000","last_fullsized":"2024-09-10T11:42:23.405282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428751+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:42:23.428751+0000","last_peered":"2024-09-10T11:42:23.428751+0000","last_clean":"2024-09-10T11:42:23.428751+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:42:23.428751+0000","last_undegraded":"2024-09-10T11:42:23.428751+0000","last_fullsized":"2024-09-10T11:42:23.428751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426208+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:42:23.426208+0000","last_peered":"2024-09-10T11:42:23.426208+0000","last_clean":"2024-09-10T11:42:23.426208+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:42:23.426208+0000","last_undegraded":"2024-09-10T11:42:23.426208+0000","last_fullsized":"2024-09-10T11:42:23.426208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420466+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:42:23.420466+0000","last_peered":"2024-09-10T11:42:23.420466+0000","last_clean":"2024-09-10T11:42:23.420466+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:42:23.420466+0000","last_undegraded":"2024-09-10T11:42:23.420466+0000","last_fullsized":"2024-09-10T11:42:23.420466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420513+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:42:23.420513+0000","last_peered":"2024-09-10T11:42:23.420513+0000","last_clean":"2024-09-10T11:42:23.420513+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:42:23.420513+0000","last_undegraded":"2024-09-10T11:42:23.420513+0000","last_fullsized":"2024-09-10T11:42:23.420513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422634+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:42:23.422634+0000","last_peered":"2024-09-10T11:42:23.422634+0000","last_clean":"2024-09-10T11:42:23.422634+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:42:23.422634+0000","last_undegraded":"2024-09-10T11:42:23.422634+0000","last_fullsized":"2024-09-10T11:42:23.422634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425047+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:42:23.425047+0000","last_peered":"2024-09-10T11:42:23.425047+0000","last_clean":"2024-09-10T11:42:23.425047+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:42:23.425047+0000","last_undegraded":"2024-09-10T11:42:23.425047+0000","last_fullsized":"2024-09-10T11:42:23.425047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425372+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:42:23.425372+0000","last_peered":"2024-09-10T11:42:23.425372+0000","last_clean":"2024-09-10T11:42:23.425372+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:42:23.425372+0000","last_undegraded":"2024-09-10T11:42:23.425372+0000","last_fullsized":"2024-09-10T11:42:23.425372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415080+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:42:23.415080+0000","last_peered":"2024-09-10T11:42:23.415080+0000","last_clean":"2024-09-10T11:42:23.415080+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:42:23.415080+0000","last_undegraded":"2024-09-10T11:42:23.415080+0000","last_fullsized":"2024-09-10T11:42:23.415080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:27.688909+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:42:27.688909+0000","last_peered":"2024-09-10T11:42:27.688909+0000","last_clean":"2024-09-10T11:42:27.688909+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:42:27.688909+0000","last_undegraded":"2024-09-10T11:42:27.688909+0000","last_fullsized":"2024-09-10T11:42:27.688909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429245+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:42:23.429245+0000","last_peered":"2024-09-10T11:42:23.429245+0000","last_clean":"2024-09-10T11:42:23.429245+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:42:23.429245+0000","last_undegraded":"2024-09-10T11:42:23.429245+0000","last_fullsized":"2024-09-10T11:42:23.429245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416384+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:42:23.416384+0000","last_peered":"2024-09-10T11:42:23.416384+0000","last_clean":"2024-09-10T11:42:23.416384+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:42:23.416384+0000","last_undegraded":"2024-09-10T11:42:23.416384+0000","last_fullsized":"2024-09-10T11:42:23.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420739+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:42:23.420739+0000","last_peered":"2024-09-10T11:42:23.420739+0000","last_clean":"2024-09-10T11:42:23.420739+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:42:23.420739+0000","last_undegraded":"2024-09-10T11:42:23.420739+0000","last_fullsized":"2024-09-10T11:42:23.420739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692336+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:42:30.692336+0000","last_peered":"2024-09-10T11:42:30.692336+0000","last_clean":"2024-09-10T11:42:30.692336+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:42:30.692336+0000","last_undegraded":"2024-09-10T11:42:30.692336+0000","last_fullsized":"2024-09-10T11:42:30.692336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432288+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:42:23.432288+0000","last_peered":"2024-09-10T11:42:23.432288+0000","last_clean":"2024-09-10T11:42:23.432288+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:42:23.432288+0000","last_undegraded":"2024-09-10T11:42:23.432288+0000","last_fullsized":"2024-09-10T11:42:23.432288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417659+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:42:23.417659+0000","last_peered":"2024-09-10T11:42:23.417659+0000","last_clean":"2024-09-10T11:42:23.417659+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:42:23.417659+0000","last_undegraded":"2024-09-10T11:42:23.417659+0000","last_fullsized":"2024-09-10T11:42:23.417659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430925+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:42:23.430925+0000","last_peered":"2024-09-10T11:42:23.430925+0000","last_clean":"2024-09-10T11:42:23.430925+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:42:23.430925+0000","last_undegraded":"2024-09-10T11:42:23.430925+0000","last_fullsized":"2024-09-10T11:42:23.430925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'38","reported_seq":272,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692691+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:42:30.692691+0000","last_peered":"2024-09-10T11:42:30.692691+0000","last_clean":"2024-09-10T11:42:30.692691+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:42:30.692691+0000","last_undegraded":"2024-09-10T11:42:30.692691+0000","last_fullsized":"2024-09-10T11:42:30.692691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.424458+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:42:23.424458+0000","last_peered":"2024-09-10T11:42:23.424458+0000","last_clean":"2024-09-10T11:42:23.424458+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:42:23.424458+0000","last_undegraded":"2024-09-10T11:42:23.424458+0000","last_fullsized":"2024-09-10T11:42:23.424458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430680+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:42:23.430680+0000","last_peered":"2024-09-10T11:42:23.430680+0000","last_clean":"2024-09-10T11:42:23.430680+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:42:23.430680+0000","last_undegraded":"2024-09-10T11:42:23.430680+0000","last_fullsized":"2024-09-10T11:42:23.430680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433173+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:42:23.433173+0000","last_peered":"2024-09-10T11:42:23.433173+0000","last_clean":"2024-09-10T11:42:23.433173+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:42:23.433173+0000","last_undegraded":"2024-09-10T11:42:23.433173+0000","last_fullsized":"2024-09-10T11:42:23.433173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.674357+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:42:26.674357+0000","last_peered":"2024-09-10T11:42:26.674357+0000","last_clean":"2024-09-10T11:42:26.674357+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:42:26.674357+0000","last_undegraded":"2024-09-10T11:42:26.674357+0000","last_fullsized":"2024-09-10T11:42:26.674357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432214+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:42:23.432214+0000","last_peered":"2024-09-10T11:42:23.432214+0000","last_clean":"2024-09-10T11:42:23.432214+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:42:23.432214+0000","last_undegraded":"2024-09-10T11:42:23.432214+0000","last_fullsized":"2024-09-10T11:42:23.432214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434847+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:42:23.434847+0000","last_peered":"2024-09-10T11:42:23.434847+0000","last_clean":"2024-09-10T11:42:23.434847+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:42:23.434847+0000","last_undegraded":"2024-09-10T11:42:23.434847+0000","last_fullsized":"2024-09-10T11:42:23.434847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426167+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:42:23.426167+0000","last_peered":"2024-09-10T11:42:23.426167+0000","last_clean":"2024-09-10T11:42:23.426167+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:42:23.426167+0000","last_undegraded":"2024-09-10T11:42:23.426167+0000","last_fullsized":"2024-09-10T11:42:23.426167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433839+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:42:23.433839+0000","last_peered":"2024-09-10T11:42:23.433839+0000","last_clean":"2024-09-10T11:42:23.433839+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:42:23.433839+0000","last_undegraded":"2024-09-10T11:42:23.433839+0000","last_fullsized":"2024-09-10T11:42:23.433839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432616+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:42:23.432616+0000","last_peered":"2024-09-10T11:42:23.432616+0000","last_clean":"2024-09-10T11:42:23.432616+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:42:23.432616+0000","last_undegraded":"2024-09-10T11:42:23.432616+0000","last_fullsized":"2024-09-10T11:42:23.432616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.687353+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:42:26.687353+0000","last_peered":"2024-09-10T11:42:26.687353+0000","last_clean":"2024-09-10T11:42:26.687353+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:42:26.687353+0000","last_undegraded":"2024-09-10T11:42:26.687353+0000","last_fullsized":"2024-09-10T11:42:26.687353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558595+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558595+0000","last_peered":"2024-09-10T11:40:54.558595+0000","last_clean":"2024-09-10T11:40:54.558595+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558595+0000","last_undegraded":"2024-09-10T11:40:54.558595+0000","last_fullsized":"2024-09-10T11:40:54.558595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418491+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:42:23.418491+0000","last_peered":"2024-09-10T11:42:23.418491+0000","last_clean":"2024-09-10T11:42:23.418491+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:42:23.418491+0000","last_undegraded":"2024-09-10T11:42:23.418491+0000","last_fullsized":"2024-09-10T11:42:23.418491+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417447+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:42:23.417447+0000","last_peered":"2024-09-10T11:42:23.417447+0000","last_clean":"2024-09-10T11:42:23.417447+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:42:23.417447+0000","last_undegraded":"2024-09-10T11:42:23.417447+0000","last_fullsized":"2024-09-10T11:42:23.417447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.673871+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:42:26.673871+0000","last_peered":"2024-09-10T11:42:26.673871+0000","last_clean":"2024-09-10T11:42:26.673871+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:42:26.673871+0000","last_undegraded":"2024-09-10T11:42:26.673871+0000","last_fullsized":"2024-09-10T11:42:26.673871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428767+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:42:23.428767+0000","last_peered":"2024-09-10T11:42:23.428767+0000","last_clean":"2024-09-10T11:42:23.428767+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:42:23.428767+0000","last_undegraded":"2024-09-10T11:42:23.428767+0000","last_fullsized":"2024-09-10T11:42:23.428767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'7","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:25.672538+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:42:25.672538+0000","last_peered":"2024-09-10T11:42:25.672538+0000","last_clean":"2024-09-10T11:42:25.672538+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:42:25.672538+0000","last_undegraded":"2024-09-10T11:42:25.672538+0000","last_fullsized":"2024-09-10T11:42:25.672538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415667+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:42:23.415667+0000","last_peered":"2024-09-10T11:42:23.415667+0000","last_clean":"2024-09-10T11:42:23.415667+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:42:23.415667+0000","last_undegraded":"2024-09-10T11:42:23.415667+0000","last_fullsized":"2024-09-10T11:42:23.415667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420888+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:42:23.420888+0000","last_peered":"2024-09-10T11:42:23.420888+0000","last_clean":"2024-09-10T11:42:23.420888+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:42:23.420888+0000","last_undegraded":"2024-09-10T11:42:23.420888+0000","last_fullsized":"2024-09-10T11:42:23.420888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418551+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:42:23.418551+0000","last_peered":"2024-09-10T11:42:23.418551+0000","last_clean":"2024-09-10T11:42:23.418551+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:42:23.418551+0000","last_undegraded":"2024-09-10T11:42:23.418551+0000","last_fullsized":"2024-09-10T11:42:23.418551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:05.498359+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:41:05.498359+0000","last_peered":"2024-09-10T11:41:05.498359+0000","last_clean":"2024-09-10T11:41:05.498359+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:41:05.498359+0000","last_undegraded":"2024-09-10T11:41:05.498359+0000","last_fullsized":"2024-09-10T11:41:05.498359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416697+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:42:23.416697+0000","last_peered":"2024-09-10T11:42:23.416697+0000","last_clean":"2024-09-10T11:42:23.416697+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:42:23.416697+0000","last_undegraded":"2024-09-10T11:42:23.416697+0000","last_fullsized":"2024-09-10T11:42:23.416697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417486+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:42:23.417486+0000","last_peered":"2024-09-10T11:42:23.417486+0000","last_clean":"2024-09-10T11:42:23.417486+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:42:23.417486+0000","last_undegraded":"2024-09-10T11:42:23.417486+0000","last_fullsized":"2024-09-10T11:42:23.417486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.390251+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:42:23.390251+0000","last_peered":"2024-09-10T11:42:23.390251+0000","last_clean":"2024-09-10T11:42:23.390251+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:42:23.390251+0000","last_undegraded":"2024-09-10T11:42:23.390251+0000","last_fullsized":"2024-09-10T11:42:23.390251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425892+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:42:23.425892+0000","last_peered":"2024-09-10T11:42:23.425892+0000","last_clean":"2024-09-10T11:42:23.425892+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:42:23.425892+0000","last_undegraded":"2024-09-10T11:42:23.425892+0000","last_fullsized":"2024-09-10T11:42:23.425892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548480+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548480+0000","last_peered":"2024-09-10T11:40:54.548480+0000","last_clean":"2024-09-10T11:40:54.548480+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548480+0000","last_undegraded":"2024-09-10T11:40:54.548480+0000","last_fullsized":"2024-09-10T11:40:54.548480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414620+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:42:23.414620+0000","last_peered":"2024-09-10T11:42:23.414620+0000","last_clean":"2024-09-10T11:42:23.414620+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:42:23.414620+0000","last_undegraded":"2024-09-10T11:42:23.414620+0000","last_fullsized":"2024-09-10T11:42:23.414620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435462+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:42:23.435462+0000","last_peered":"2024-09-10T11:42:23.435462+0000","last_clean":"2024-09-10T11:42:23.435462+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:42:23.435462+0000","last_undegraded":"2024-09-10T11:42:23.435462+0000","last_fullsized":"2024-09-10T11:42:23.435462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435509+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:42:23.435509+0000","last_peered":"2024-09-10T11:42:23.435509+0000","last_clean":"2024-09-10T11:42:23.435509+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:42:23.435509+0000","last_undegraded":"2024-09-10T11:42:23.435509+0000","last_fullsized":"2024-09-10T11:42:23.435509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432541+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:42:23.432541+0000","last_peered":"2024-09-10T11:42:23.432541+0000","last_clean":"2024-09-10T11:42:23.432541+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:42:23.432541+0000","last_undegraded":"2024-09-10T11:42:23.432541+0000","last_fullsized":"2024-09-10T11:42:23.432541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427749+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:42:23.427749+0000","last_peered":"2024-09-10T11:42:23.427749+0000","last_clean":"2024-09-10T11:42:23.427749+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:42:23.427749+0000","last_undegraded":"2024-09-10T11:42:23.427749+0000","last_fullsized":"2024-09-10T11:42:23.427749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418362+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:42:23.418362+0000","last_peered":"2024-09-10T11:42:23.418362+0000","last_clean":"2024-09-10T11:42:23.418362+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:42:23.418362+0000","last_undegraded":"2024-09-10T11:42:23.418362+0000","last_fullsized":"2024-09-10T11:42:23.418362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:24.670472+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:42:24.670472+0000","last_peered":"2024-09-10T11:42:24.670472+0000","last_clean":"2024-09-10T11:42:24.670472+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:42:24.670472+0000","last_undegraded":"2024-09-10T11:42:24.670472+0000","last_fullsized":"2024-09-10T11:42:24.670472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74979,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1025,"num_read_kb":598,"num_write":260,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":216001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678055,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1646592,"data_stored":1112763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103218,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":454200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":454061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":517974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:42:32.163 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T11:42:32.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:42:32.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 -- 172.21.15.17:0/1496672149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44102060 msgr2=0x7fbf44102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 --2- 172.21.15.17:0/1496672149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44102060 0x7fbf44102460 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009900 tx=0x7fbf3402a410 comp rx=0 tx=0).stop 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 -- 172.21.15.17:0/1496672149 shutdown_connections 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 --2- 172.21.15.17:0/1496672149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44100cb0 0x7fbf44101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 --2- 172.21.15.17:0/1496672149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44101670 0x7fbf44108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 --2- 172.21.15.17:0/1496672149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44102060 0x7fbf44102460 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 -- 172.21.15.17:0/1496672149 >> 172.21.15.17:0/1496672149 conn(0x7fbf440fb930 msgr2=0x7fbf440fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.301+0000 7fbf48b11640 1 -- 172.21.15.17:0/1496672149 shutdown_connections 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.302+0000 7fbf48b11640 1 -- 172.21.15.17:0/1496672149 wait complete. 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.302+0000 7fbf48b11640 1 Processor -- start 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.302+0000 7fbf48b11640 1 -- start start 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.302+0000 7fbf48b11640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44100cb0 0x7fbf44104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:32.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 0x7fbf441035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c6e0 con 0x7fbf44101670 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c560 con 0x7fbf44100cb0 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4410c860 con 0x7fbf44102060 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41660/0 (socket says 172.21.15.17:41660) 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 -- 172.21.15.17:0/3363705641 learned_addr learned my addr 172.21.15.17:0/3363705641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf4259c640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44100cb0 0x7fbf44104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf42d9d640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 0x7fbf441035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 -- 172.21.15.17:0/3363705641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 msgr2=0x7fbf441035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 0x7fbf441035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 -- 172.21.15.17:0/3363705641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44100cb0 msgr2=0x7fbf44104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44100cb0 0x7fbf44104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 -- 172.21.15.17:0/3363705641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44103e70 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf42d9d640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 0x7fbf441035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf41d9b640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c970 tx=0x7fbf3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004220 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf380043c0 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf441a1fe0 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004a00 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.303+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf441a2450 con 0x7fbf44101670 2024-09-10T11:42:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.304+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf441a2740 con 0x7fbf44101670 2024-09-10T11:42:32.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.306+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbf380079b0 con 0x7fbf44101670 2024-09-10T11:42:32.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.307+0000 7fbf337fe640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 0x7fbf2c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:32.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.307+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fbf380cf1e0 con 0x7fbf44101670 2024-09-10T11:42:32.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.307+0000 7fbf4259c640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 0x7fbf2c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:32.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.308+0000 7fbf4259c640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 0x7fbf2c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009230 tx=0x7fbf340315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:32.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.310+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf38014030 con 0x7fbf44101670 2024-09-10T11:42:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.485+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 --> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf441003a0 con 0x7fbf2c0a2b90 2024-09-10T11:42:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.492+0000 7fbf337fe640 1 -- 172.21.15.17:0/3363705641 <== mgr.14150 v2:172.21.15.17:6800/3008774641 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7fbf441003a0 con 0x7fbf2c0a2b90 2024-09-10T11:42:32.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:32.497 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T11:42:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 msgr2=0x7fbf2c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 0x7fbf2c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009230 tx=0x7fbf340315b0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 msgr2=0x7fbf441030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c970 tx=0x7fbf3800ce30 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 shutdown_connections 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbf2c0a2b90 0x7fbf2c0a5050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf44102060 0x7fbf441035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101670 0x7fbf441030a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 --2- 172.21.15.17:0/3363705641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf44100cb0 0x7fbf44104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 >> 172.21.15.17:0/3363705641 conn(0x7fbf440fb930 msgr2=0x7fbf440ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 shutdown_connections 2024-09-10T11:42:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:32.495+0000 7fbf48b11640 1 -- 172.21.15.17:0/3363705641 wait complete. 2024-09-10T11:42:32.507 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-10T11:42:31.435622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665581,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1151,"num_read_kb":707,"num_write":443,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391548,"kb_used_data":13180,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550276,"statfs":{"total":1151940427776,"available":1151539482624,"internally_reserved":0,"allocated":13496320,"data_stored":7421731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5461,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":75,"num_write":15,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002954"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427702+0000","last_change":"2024-09-10T11:40:39.498994+0000","last_active":"2024-09-10T11:42:23.427702+0000","last_peered":"2024-09-10T11:42:23.427702+0000","last_clean":"2024-09-10T11:42:23.427702+0000","last_became_active":"2024-09-10T11:40:39.498252+0000","last_became_peered":"2024-09-10T11:40:39.498252+0000","last_unstale":"2024-09-10T11:42:23.427702+0000","last_undegraded":"2024-09-10T11:42:23.427702+0000","last_fullsized":"2024-09-10T11:42:23.427702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:35:41.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419067+0000","last_change":"2024-09-10T11:40:39.497085+0000","last_active":"2024-09-10T11:42:23.419067+0000","last_peered":"2024-09-10T11:42:23.419067+0000","last_clean":"2024-09-10T11:42:23.419067+0000","last_became_active":"2024-09-10T11:40:39.496724+0000","last_became_peered":"2024-09-10T11:40:39.496724+0000","last_unstale":"2024-09-10T11:42:23.419067+0000","last_undegraded":"2024-09-10T11:42:23.419067+0000","last_fullsized":"2024-09-10T11:42:23.419067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:20.787594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427705+0000","last_change":"2024-09-10T11:40:39.499238+0000","last_active":"2024-09-10T11:42:23.427705+0000","last_peered":"2024-09-10T11:42:23.427705+0000","last_clean":"2024-09-10T11:42:23.427705+0000","last_became_active":"2024-09-10T11:40:39.498669+0000","last_became_peered":"2024-09-10T11:40:39.498669+0000","last_unstale":"2024-09-10T11:42:23.427705+0000","last_undegraded":"2024-09-10T11:42:23.427705+0000","last_fullsized":"2024-09-10T11:42:23.427705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:59.773306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422869+0000","last_change":"2024-09-10T11:40:39.508905+0000","last_active":"2024-09-10T11:42:23.422869+0000","last_peered":"2024-09-10T11:42:23.422869+0000","last_clean":"2024-09-10T11:42:23.422869+0000","last_became_active":"2024-09-10T11:40:39.508489+0000","last_became_peered":"2024-09-10T11:40:39.508489+0000","last_unstale":"2024-09-10T11:42:23.422869+0000","last_undegraded":"2024-09-10T11:42:23.422869+0000","last_fullsized":"2024-09-10T11:42:23.422869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:00.956245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420187+0000","last_change":"2024-09-10T11:40:39.501058+0000","last_active":"2024-09-10T11:42:23.420187+0000","last_peered":"2024-09-10T11:42:23.420187+0000","last_clean":"2024-09-10T11:42:23.420187+0000","last_became_active":"2024-09-10T11:40:39.500485+0000","last_became_peered":"2024-09-10T11:40:39.500485+0000","last_unstale":"2024-09-10T11:42:23.420187+0000","last_undegraded":"2024-09-10T11:42:23.420187+0000","last_fullsized":"2024-09-10T11:42:23.420187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:13.590478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414331+0000","last_change":"2024-09-10T11:40:39.504067+0000","last_active":"2024-09-10T11:42:23.414331+0000","last_peered":"2024-09-10T11:42:23.414331+0000","last_clean":"2024-09-10T11:42:23.414331+0000","last_became_active":"2024-09-10T11:40:39.503733+0000","last_became_peered":"2024-09-10T11:40:39.503733+0000","last_unstale":"2024-09-10T11:42:23.414331+0000","last_undegraded":"2024-09-10T11:42:23.414331+0000","last_fullsized":"2024-09-10T11:42:23.414331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.573232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432151+0000","last_change":"2024-09-10T11:40:39.507497+0000","last_active":"2024-09-10T11:42:23.432151+0000","last_peered":"2024-09-10T11:42:23.432151+0000","last_clean":"2024-09-10T11:42:23.432151+0000","last_became_active":"2024-09-10T11:40:39.506892+0000","last_became_peered":"2024-09-10T11:40:39.506892+0000","last_unstale":"2024-09-10T11:42:23.432151+0000","last_undegraded":"2024-09-10T11:42:23.432151+0000","last_fullsized":"2024-09-10T11:42:23.432151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:45.114133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.419427+0000","last_change":"2024-09-10T11:40:39.506735+0000","last_active":"2024-09-10T11:42:23.419427+0000","last_peered":"2024-09-10T11:42:23.419427+0000","last_clean":"2024-09-10T11:42:23.419427+0000","last_became_active":"2024-09-10T11:40:39.503799+0000","last_became_peered":"2024-09-10T11:40:39.503799+0000","last_unstale":"2024-09-10T11:42:23.419427+0000","last_undegraded":"2024-09-10T11:42:23.419427+0000","last_fullsized":"2024-09-10T11:42:23.419427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:54.429239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430276+0000","last_change":"2024-09-10T11:40:39.505248+0000","last_active":"2024-09-10T11:42:23.430276+0000","last_peered":"2024-09-10T11:42:23.430276+0000","last_clean":"2024-09-10T11:42:23.430276+0000","last_became_active":"2024-09-10T11:40:39.504883+0000","last_became_peered":"2024-09-10T11:40:39.504883+0000","last_unstale":"2024-09-10T11:42:23.430276+0000","last_undegraded":"2024-09-10T11:42:23.430276+0000","last_fullsized":"2024-09-10T11:42:23.430276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:32.043620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431042+0000","last_change":"2024-09-10T11:40:39.504462+0000","last_active":"2024-09-10T11:42:23.431042+0000","last_peered":"2024-09-10T11:42:23.431042+0000","last_clean":"2024-09-10T11:42:23.431042+0000","last_became_active":"2024-09-10T11:40:39.504016+0000","last_became_peered":"2024-09-10T11:40:39.504016+0000","last_unstale":"2024-09-10T11:42:23.431042+0000","last_undegraded":"2024-09-10T11:42:23.431042+0000","last_fullsized":"2024-09-10T11:42:23.431042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:45.063470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.503048+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.502200+0000","last_became_peered":"2024-09-10T11:40:39.502200+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:27.032172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426662+0000","last_change":"2024-09-10T11:40:39.508626+0000","last_active":"2024-09-10T11:42:23.426662+0000","last_peered":"2024-09-10T11:42:23.426662+0000","last_clean":"2024-09-10T11:42:23.426662+0000","last_became_active":"2024-09-10T11:40:39.507198+0000","last_became_peered":"2024-09-10T11:40:39.507198+0000","last_unstale":"2024-09-10T11:42:23.426662+0000","last_undegraded":"2024-09-10T11:42:23.426662+0000","last_fullsized":"2024-09-10T11:42:23.426662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:42.941420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421278+0000","last_change":"2024-09-10T11:40:39.505406+0000","last_active":"2024-09-10T11:42:23.421278+0000","last_peered":"2024-09-10T11:42:23.421278+0000","last_clean":"2024-09-10T11:42:23.421278+0000","last_became_active":"2024-09-10T11:40:39.505087+0000","last_became_peered":"2024-09-10T11:40:39.505087+0000","last_unstale":"2024-09-10T11:42:23.421278+0000","last_undegraded":"2024-09-10T11:42:23.421278+0000","last_fullsized":"2024-09-10T11:42:23.421278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:13.832157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418911+0000","last_change":"2024-09-10T11:40:39.504455+0000","last_active":"2024-09-10T11:42:23.418911+0000","last_peered":"2024-09-10T11:42:23.418911+0000","last_clean":"2024-09-10T11:42:23.418911+0000","last_became_active":"2024-09-10T11:40:39.503994+0000","last_became_peered":"2024-09-10T11:40:39.503994+0000","last_unstale":"2024-09-10T11:42:23.418911+0000","last_undegraded":"2024-09-10T11:42:23.418911+0000","last_fullsized":"2024-09-10T11:42:23.418911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:56.294657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.421710+0000","last_change":"2024-09-10T11:40:39.502510+0000","last_active":"2024-09-10T11:42:23.421710+0000","last_peered":"2024-09-10T11:42:23.421710+0000","last_clean":"2024-09-10T11:42:23.421710+0000","last_became_active":"2024-09-10T11:40:39.502124+0000","last_became_peered":"2024-09-10T11:40:39.502124+0000","last_unstale":"2024-09-10T11:42:23.421710+0000","last_undegraded":"2024-09-10T11:42:23.421710+0000","last_fullsized":"2024-09-10T11:42:23.421710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:33:23.704998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434563+0000","last_change":"2024-09-10T11:40:39.496156+0000","last_active":"2024-09-10T11:42:23.434563+0000","last_peered":"2024-09-10T11:42:23.434563+0000","last_clean":"2024-09-10T11:42:23.434563+0000","last_became_active":"2024-09-10T11:40:39.495788+0000","last_became_peered":"2024-09-10T11:40:39.495788+0000","last_unstale":"2024-09-10T11:42:23.434563+0000","last_undegraded":"2024-09-10T11:42:23.434563+0000","last_fullsized":"2024-09-10T11:42:23.434563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:47.803253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429338+0000","last_change":"2024-09-10T11:40:39.498547+0000","last_active":"2024-09-10T11:42:23.429338+0000","last_peered":"2024-09-10T11:42:23.429338+0000","last_clean":"2024-09-10T11:42:23.429338+0000","last_became_active":"2024-09-10T11:40:39.498200+0000","last_became_peered":"2024-09-10T11:40:39.498200+0000","last_unstale":"2024-09-10T11:42:23.429338+0000","last_undegraded":"2024-09-10T11:42:23.429338+0000","last_fullsized":"2024-09-10T11:42:23.429338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:08.120247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426188+0000","last_change":"2024-09-10T11:40:39.496630+0000","last_active":"2024-09-10T11:42:23.426188+0000","last_peered":"2024-09-10T11:42:23.426188+0000","last_clean":"2024-09-10T11:42:23.426188+0000","last_became_active":"2024-09-10T11:40:39.496273+0000","last_became_peered":"2024-09-10T11:40:39.496273+0000","last_unstale":"2024-09-10T11:42:23.426188+0000","last_undegraded":"2024-09-10T11:42:23.426188+0000","last_fullsized":"2024-09-10T11:42:23.426188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:40.427331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416649+0000","last_change":"2024-09-10T11:40:39.492214+0000","last_active":"2024-09-10T11:42:23.416649+0000","last_peered":"2024-09-10T11:42:23.416649+0000","last_clean":"2024-09-10T11:42:23.416649+0000","last_became_active":"2024-09-10T11:40:39.491844+0000","last_became_peered":"2024-09-10T11:40:39.491844+0000","last_unstale":"2024-09-10T11:42:23.416649+0000","last_undegraded":"2024-09-10T11:42:23.416649+0000","last_fullsized":"2024-09-10T11:42:23.416649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:39.858370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426528+0000","last_change":"2024-09-10T11:40:39.510354+0000","last_active":"2024-09-10T11:42:23.426528+0000","last_peered":"2024-09-10T11:42:23.426528+0000","last_clean":"2024-09-10T11:42:23.426528+0000","last_became_active":"2024-09-10T11:40:39.510025+0000","last_became_peered":"2024-09-10T11:40:39.510025+0000","last_unstale":"2024-09-10T11:42:23.426528+0000","last_undegraded":"2024-09-10T11:42:23.426528+0000","last_fullsized":"2024-09-10T11:42:23.426528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.290404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.431087+0000","last_change":"2024-09-10T11:40:39.494496+0000","last_active":"2024-09-10T11:42:23.431087+0000","last_peered":"2024-09-10T11:42:23.431087+0000","last_clean":"2024-09-10T11:42:23.431087+0000","last_became_active":"2024-09-10T11:40:39.494163+0000","last_became_peered":"2024-09-10T11:40:39.494163+0000","last_unstale":"2024-09-10T11:42:23.431087+0000","last_undegraded":"2024-09-10T11:42:23.431087+0000","last_fullsized":"2024-09-10T11:42:23.431087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:05.937092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434978+0000","last_change":"2024-09-10T11:40:39.502291+0000","last_active":"2024-09-10T11:42:23.434978+0000","last_peered":"2024-09-10T11:42:23.434978+0000","last_clean":"2024-09-10T11:42:23.434978+0000","last_became_active":"2024-09-10T11:40:39.501856+0000","last_became_peered":"2024-09-10T11:40:39.501856+0000","last_unstale":"2024-09-10T11:42:23.434978+0000","last_undegraded":"2024-09-10T11:42:23.434978+0000","last_fullsized":"2024-09-10T11:42:23.434978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:47.692689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415943+0000","last_change":"2024-09-10T11:40:39.494517+0000","last_active":"2024-09-10T11:42:23.415943+0000","last_peered":"2024-09-10T11:42:23.415943+0000","last_clean":"2024-09-10T11:42:23.415943+0000","last_became_active":"2024-09-10T11:40:39.494218+0000","last_became_peered":"2024-09-10T11:40:39.494218+0000","last_unstale":"2024-09-10T11:42:23.415943+0000","last_undegraded":"2024-09-10T11:42:23.415943+0000","last_fullsized":"2024-09-10T11:42:23.415943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:19.602197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422864+0000","last_change":"2024-09-10T11:40:39.503117+0000","last_active":"2024-09-10T11:42:23.422864+0000","last_peered":"2024-09-10T11:42:23.422864+0000","last_clean":"2024-09-10T11:42:23.422864+0000","last_became_active":"2024-09-10T11:40:39.502555+0000","last_became_peered":"2024-09-10T11:40:39.502555+0000","last_unstale":"2024-09-10T11:42:23.422864+0000","last_undegraded":"2024-09-10T11:42:23.422864+0000","last_fullsized":"2024-09-10T11:42:23.422864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:08.571761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.405282+0000","last_change":"2024-09-10T11:40:39.504158+0000","last_active":"2024-09-10T11:42:23.405282+0000","last_peered":"2024-09-10T11:42:23.405282+0000","last_clean":"2024-09-10T11:42:23.405282+0000","last_became_active":"2024-09-10T11:40:39.503285+0000","last_became_peered":"2024-09-10T11:40:39.503285+0000","last_unstale":"2024-09-10T11:42:23.405282+0000","last_undegraded":"2024-09-10T11:42:23.405282+0000","last_fullsized":"2024-09-10T11:42:23.405282+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:44.489172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428751+0000","last_change":"2024-09-10T11:40:39.498087+0000","last_active":"2024-09-10T11:42:23.428751+0000","last_peered":"2024-09-10T11:42:23.428751+0000","last_clean":"2024-09-10T11:42:23.428751+0000","last_became_active":"2024-09-10T11:40:39.497753+0000","last_became_peered":"2024-09-10T11:40:39.497753+0000","last_unstale":"2024-09-10T11:42:23.428751+0000","last_undegraded":"2024-09-10T11:42:23.428751+0000","last_fullsized":"2024-09-10T11:42:23.428751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:16.045340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426208+0000","last_change":"2024-09-10T11:40:39.504323+0000","last_active":"2024-09-10T11:42:23.426208+0000","last_peered":"2024-09-10T11:42:23.426208+0000","last_clean":"2024-09-10T11:42:23.426208+0000","last_became_active":"2024-09-10T11:40:39.504018+0000","last_became_peered":"2024-09-10T11:40:39.504018+0000","last_unstale":"2024-09-10T11:42:23.426208+0000","last_undegraded":"2024-09-10T11:42:23.426208+0000","last_fullsized":"2024-09-10T11:42:23.426208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:06.273199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420466+0000","last_change":"2024-09-10T11:40:54.553544+0000","last_active":"2024-09-10T11:42:23.420466+0000","last_peered":"2024-09-10T11:42:23.420466+0000","last_clean":"2024-09-10T11:42:23.420466+0000","last_became_active":"2024-09-10T11:40:54.553197+0000","last_became_peered":"2024-09-10T11:40:54.553197+0000","last_unstale":"2024-09-10T11:42:23.420466+0000","last_undegraded":"2024-09-10T11:42:23.420466+0000","last_fullsized":"2024-09-10T11:42:23.420466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:59.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420513+0000","last_change":"2024-09-10T11:40:54.559961+0000","last_active":"2024-09-10T11:42:23.420513+0000","last_peered":"2024-09-10T11:42:23.420513+0000","last_clean":"2024-09-10T11:42:23.420513+0000","last_became_active":"2024-09-10T11:40:54.559549+0000","last_became_peered":"2024-09-10T11:40:54.559549+0000","last_unstale":"2024-09-10T11:42:23.420513+0000","last_undegraded":"2024-09-10T11:42:23.420513+0000","last_fullsized":"2024-09-10T11:42:23.420513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:30.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.422634+0000","last_change":"2024-09-10T11:40:54.553618+0000","last_active":"2024-09-10T11:42:23.422634+0000","last_peered":"2024-09-10T11:42:23.422634+0000","last_clean":"2024-09-10T11:42:23.422634+0000","last_became_active":"2024-09-10T11:40:54.553235+0000","last_became_peered":"2024-09-10T11:40:54.553235+0000","last_unstale":"2024-09-10T11:42:23.422634+0000","last_undegraded":"2024-09-10T11:42:23.422634+0000","last_fullsized":"2024-09-10T11:42:23.422634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:20.565133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425047+0000","last_change":"2024-09-10T11:40:39.507558+0000","last_active":"2024-09-10T11:42:23.425047+0000","last_peered":"2024-09-10T11:42:23.425047+0000","last_clean":"2024-09-10T11:42:23.425047+0000","last_became_active":"2024-09-10T11:40:39.507108+0000","last_became_peered":"2024-09-10T11:40:39.507108+0000","last_unstale":"2024-09-10T11:42:23.425047+0000","last_undegraded":"2024-09-10T11:42:23.425047+0000","last_fullsized":"2024-09-10T11:42:23.425047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:34.130275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425372+0000","last_change":"2024-09-10T11:40:39.503573+0000","last_active":"2024-09-10T11:42:23.425372+0000","last_peered":"2024-09-10T11:42:23.425372+0000","last_clean":"2024-09-10T11:42:23.425372+0000","last_became_active":"2024-09-10T11:40:39.503205+0000","last_became_peered":"2024-09-10T11:40:39.503205+0000","last_unstale":"2024-09-10T11:42:23.425372+0000","last_undegraded":"2024-09-10T11:42:23.425372+0000","last_fullsized":"2024-09-10T11:42:23.425372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:47.295342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415080+0000","last_change":"2024-09-10T11:40:54.555100+0000","last_active":"2024-09-10T11:42:23.415080+0000","last_peered":"2024-09-10T11:42:23.415080+0000","last_clean":"2024-09-10T11:42:23.415080+0000","last_became_active":"2024-09-10T11:40:54.554401+0000","last_became_peered":"2024-09-10T11:40:54.554401+0000","last_unstale":"2024-09-10T11:42:23.415080+0000","last_undegraded":"2024-09-10T11:42:23.415080+0000","last_fullsized":"2024-09-10T11:42:23.415080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:19.948170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:27.688909+0000","last_change":"2024-09-10T11:40:37.487101+0000","last_active":"2024-09-10T11:42:27.688909+0000","last_peered":"2024-09-10T11:42:27.688909+0000","last_clean":"2024-09-10T11:42:27.688909+0000","last_became_active":"2024-09-10T11:40:37.486309+0000","last_became_peered":"2024-09-10T11:40:37.486309+0000","last_unstale":"2024-09-10T11:42:27.688909+0000","last_undegraded":"2024-09-10T11:42:27.688909+0000","last_fullsized":"2024-09-10T11:42:27.688909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:40.073359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.429245+0000","last_change":"2024-09-10T11:40:39.508909+0000","last_active":"2024-09-10T11:42:23.429245+0000","last_peered":"2024-09-10T11:42:23.429245+0000","last_clean":"2024-09-10T11:42:23.429245+0000","last_became_active":"2024-09-10T11:40:39.508509+0000","last_became_peered":"2024-09-10T11:40:39.508509+0000","last_unstale":"2024-09-10T11:42:23.429245+0000","last_undegraded":"2024-09-10T11:42:23.429245+0000","last_fullsized":"2024-09-10T11:42:23.429245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:31.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.561535+0000","last_change":"2024-09-10T11:40:37.482248+0000","last_active":"2024-09-10T11:40:54.561535+0000","last_peered":"2024-09-10T11:40:54.561535+0000","last_clean":"2024-09-10T11:40:54.561535+0000","last_became_active":"2024-09-10T11:40:37.481900+0000","last_became_peered":"2024-09-10T11:40:37.481900+0000","last_unstale":"2024-09-10T11:40:54.561535+0000","last_undegraded":"2024-09-10T11:40:54.561535+0000","last_fullsized":"2024-09-10T11:40:54.561535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:25.266778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550150+0000","last_change":"2024-09-10T11:40:37.481419+0000","last_active":"2024-09-10T11:40:54.550150+0000","last_peered":"2024-09-10T11:40:54.550150+0000","last_clean":"2024-09-10T11:40:54.550150+0000","last_became_active":"2024-09-10T11:40:37.481055+0000","last_became_peered":"2024-09-10T11:40:37.481055+0000","last_unstale":"2024-09-10T11:40:54.550150+0000","last_undegraded":"2024-09-10T11:40:54.550150+0000","last_fullsized":"2024-09-10T11:40:54.550150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:51.915602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416384+0000","last_change":"2024-09-10T11:40:39.494715+0000","last_active":"2024-09-10T11:42:23.416384+0000","last_peered":"2024-09-10T11:42:23.416384+0000","last_clean":"2024-09-10T11:42:23.416384+0000","last_became_active":"2024-09-10T11:40:39.494398+0000","last_became_peered":"2024-09-10T11:40:39.494398+0000","last_unstale":"2024-09-10T11:42:23.416384+0000","last_undegraded":"2024-09-10T11:42:23.416384+0000","last_fullsized":"2024-09-10T11:42:23.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:21.728423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546986+0000","last_change":"2024-09-10T11:40:37.483035+0000","last_active":"2024-09-10T11:40:54.546986+0000","last_peered":"2024-09-10T11:40:54.546986+0000","last_clean":"2024-09-10T11:40:54.546986+0000","last_became_active":"2024-09-10T11:40:37.482425+0000","last_became_peered":"2024-09-10T11:40:37.482425+0000","last_unstale":"2024-09-10T11:40:54.546986+0000","last_undegraded":"2024-09-10T11:40:54.546986+0000","last_fullsized":"2024-09-10T11:40:54.546986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:24.696719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420739+0000","last_change":"2024-09-10T11:40:39.495437+0000","last_active":"2024-09-10T11:42:23.420739+0000","last_peered":"2024-09-10T11:42:23.420739+0000","last_clean":"2024-09-10T11:42:23.420739+0000","last_became_active":"2024-09-10T11:40:39.495125+0000","last_became_peered":"2024-09-10T11:40:39.495125+0000","last_unstale":"2024-09-10T11:42:23.420739+0000","last_undegraded":"2024-09-10T11:42:23.420739+0000","last_fullsized":"2024-09-10T11:42:23.420739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:00.250800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":227,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692336+0000","last_change":"2024-09-10T11:40:37.483008+0000","last_active":"2024-09-10T11:42:30.692336+0000","last_peered":"2024-09-10T11:42:30.692336+0000","last_clean":"2024-09-10T11:42:30.692336+0000","last_became_active":"2024-09-10T11:40:37.482616+0000","last_became_peered":"2024-09-10T11:40:37.482616+0000","last_unstale":"2024-09-10T11:42:30.692336+0000","last_undegraded":"2024-09-10T11:42:30.692336+0000","last_fullsized":"2024-09-10T11:42:30.692336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:38.101118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432288+0000","last_change":"2024-09-10T11:40:39.497838+0000","last_active":"2024-09-10T11:42:23.432288+0000","last_peered":"2024-09-10T11:42:23.432288+0000","last_clean":"2024-09-10T11:42:23.432288+0000","last_became_active":"2024-09-10T11:40:39.497473+0000","last_became_peered":"2024-09-10T11:40:39.497473+0000","last_unstale":"2024-09-10T11:42:23.432288+0000","last_undegraded":"2024-09-10T11:42:23.432288+0000","last_fullsized":"2024-09-10T11:42:23.432288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:09.687830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558813+0000","last_change":"2024-09-10T11:40:37.488002+0000","last_active":"2024-09-10T11:40:54.558813+0000","last_peered":"2024-09-10T11:40:54.558813+0000","last_clean":"2024-09-10T11:40:54.558813+0000","last_became_active":"2024-09-10T11:40:37.487569+0000","last_became_peered":"2024-09-10T11:40:37.487569+0000","last_unstale":"2024-09-10T11:40:54.558813+0000","last_undegraded":"2024-09-10T11:40:54.558813+0000","last_fullsized":"2024-09-10T11:40:54.558813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:07.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417659+0000","last_change":"2024-09-10T11:40:39.504945+0000","last_active":"2024-09-10T11:42:23.417659+0000","last_peered":"2024-09-10T11:42:23.417659+0000","last_clean":"2024-09-10T11:42:23.417659+0000","last_became_active":"2024-09-10T11:40:39.504511+0000","last_became_peered":"2024-09-10T11:40:39.504511+0000","last_unstale":"2024-09-10T11:42:23.417659+0000","last_undegraded":"2024-09-10T11:42:23.417659+0000","last_fullsized":"2024-09-10T11:42:23.417659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:18.681708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547547+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.547547+0000","last_peered":"2024-09-10T11:40:54.547547+0000","last_clean":"2024-09-10T11:40:54.547547+0000","last_became_active":"2024-09-10T11:40:37.797772+0000","last_became_peered":"2024-09-10T11:40:37.797772+0000","last_unstale":"2024-09-10T11:40:54.547547+0000","last_undegraded":"2024-09-10T11:40:54.547547+0000","last_fullsized":"2024-09-10T11:40:54.547547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:38.657334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430925+0000","last_change":"2024-09-10T11:40:39.501615+0000","last_active":"2024-09-10T11:42:23.430925+0000","last_peered":"2024-09-10T11:42:23.430925+0000","last_clean":"2024-09-10T11:42:23.430925+0000","last_became_active":"2024-09-10T11:40:39.501273+0000","last_became_peered":"2024-09-10T11:40:39.501273+0000","last_unstale":"2024-09-10T11:42:23.430925+0000","last_undegraded":"2024-09-10T11:42:23.430925+0000","last_fullsized":"2024-09-10T11:42:23.430925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'38","reported_seq":272,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:30.692691+0000","last_change":"2024-09-10T11:40:37.485630+0000","last_active":"2024-09-10T11:42:30.692691+0000","last_peered":"2024-09-10T11:42:30.692691+0000","last_clean":"2024-09-10T11:42:30.692691+0000","last_became_active":"2024-09-10T11:40:37.485233+0000","last_became_peered":"2024-09-10T11:40:37.485233+0000","last_unstale":"2024-09-10T11:42:30.692691+0000","last_undegraded":"2024-09-10T11:42:30.692691+0000","last_fullsized":"2024-09-10T11:42:30.692691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:41.329161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.424458+0000","last_change":"2024-09-10T11:40:39.500766+0000","last_active":"2024-09-10T11:42:23.424458+0000","last_peered":"2024-09-10T11:42:23.424458+0000","last_clean":"2024-09-10T11:42:23.424458+0000","last_became_active":"2024-09-10T11:40:39.500306+0000","last_became_peered":"2024-09-10T11:40:39.500306+0000","last_unstale":"2024-09-10T11:42:23.424458+0000","last_undegraded":"2024-09-10T11:42:23.424458+0000","last_fullsized":"2024-09-10T11:42:23.424458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:31.638915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548726+0000","last_change":"2024-09-10T11:40:37.488145+0000","last_active":"2024-09-10T11:40:54.548726+0000","last_peered":"2024-09-10T11:40:54.548726+0000","last_clean":"2024-09-10T11:40:54.548726+0000","last_became_active":"2024-09-10T11:40:37.487612+0000","last_became_peered":"2024-09-10T11:40:37.487612+0000","last_unstale":"2024-09-10T11:40:54.548726+0000","last_undegraded":"2024-09-10T11:40:54.548726+0000","last_fullsized":"2024-09-10T11:40:54.548726+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:10:20.201627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.430680+0000","last_change":"2024-09-10T11:40:39.500026+0000","last_active":"2024-09-10T11:42:23.430680+0000","last_peered":"2024-09-10T11:42:23.430680+0000","last_clean":"2024-09-10T11:42:23.430680+0000","last_became_active":"2024-09-10T11:40:39.499621+0000","last_became_peered":"2024-09-10T11:40:39.499621+0000","last_unstale":"2024-09-10T11:42:23.430680+0000","last_undegraded":"2024-09-10T11:42:23.430680+0000","last_fullsized":"2024-09-10T11:42:23.430680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:53.378219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546952+0000","last_change":"2024-09-10T11:40:37.486972+0000","last_active":"2024-09-10T11:40:54.546952+0000","last_peered":"2024-09-10T11:40:54.546952+0000","last_clean":"2024-09-10T11:40:54.546952+0000","last_became_active":"2024-09-10T11:40:37.486411+0000","last_became_peered":"2024-09-10T11:40:37.486411+0000","last_unstale":"2024-09-10T11:40:54.546952+0000","last_undegraded":"2024-09-10T11:40:54.546952+0000","last_fullsized":"2024-09-10T11:40:54.546952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:57.691917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433173+0000","last_change":"2024-09-10T11:40:39.510850+0000","last_active":"2024-09-10T11:42:23.433173+0000","last_peered":"2024-09-10T11:42:23.433173+0000","last_clean":"2024-09-10T11:42:23.433173+0000","last_became_active":"2024-09-10T11:40:39.510374+0000","last_became_peered":"2024-09-10T11:40:39.510374+0000","last_unstale":"2024-09-10T11:42:23.433173+0000","last_undegraded":"2024-09-10T11:42:23.433173+0000","last_fullsized":"2024-09-10T11:42:23.433173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:33.693357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.674357+0000","last_change":"2024-09-10T11:40:37.480319+0000","last_active":"2024-09-10T11:42:26.674357+0000","last_peered":"2024-09-10T11:42:26.674357+0000","last_clean":"2024-09-10T11:42:26.674357+0000","last_became_active":"2024-09-10T11:40:37.479980+0000","last_became_peered":"2024-09-10T11:40:37.479980+0000","last_unstale":"2024-09-10T11:42:26.674357+0000","last_undegraded":"2024-09-10T11:42:26.674357+0000","last_fullsized":"2024-09-10T11:42:26.674357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:48.854375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432214+0000","last_change":"2024-09-10T11:40:39.506864+0000","last_active":"2024-09-10T11:42:23.432214+0000","last_peered":"2024-09-10T11:42:23.432214+0000","last_clean":"2024-09-10T11:42:23.432214+0000","last_became_active":"2024-09-10T11:40:39.506536+0000","last_became_peered":"2024-09-10T11:40:39.506536+0000","last_unstale":"2024-09-10T11:42:23.432214+0000","last_undegraded":"2024-09-10T11:42:23.432214+0000","last_fullsized":"2024-09-10T11:42:23.432214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.994017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550381+0000","last_change":"2024-09-10T11:40:37.798234+0000","last_active":"2024-09-10T11:40:54.550381+0000","last_peered":"2024-09-10T11:40:54.550381+0000","last_clean":"2024-09-10T11:40:54.550381+0000","last_became_active":"2024-09-10T11:40:37.797861+0000","last_became_peered":"2024-09-10T11:40:37.797861+0000","last_unstale":"2024-09-10T11:40:54.550381+0000","last_undegraded":"2024-09-10T11:40:54.550381+0000","last_fullsized":"2024-09-10T11:40:54.550381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:28.761119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.434847+0000","last_change":"2024-09-10T11:40:39.505625+0000","last_active":"2024-09-10T11:42:23.434847+0000","last_peered":"2024-09-10T11:42:23.434847+0000","last_clean":"2024-09-10T11:42:23.434847+0000","last_became_active":"2024-09-10T11:40:39.505281+0000","last_became_peered":"2024-09-10T11:40:39.505281+0000","last_unstale":"2024-09-10T11:42:23.434847+0000","last_undegraded":"2024-09-10T11:42:23.434847+0000","last_fullsized":"2024-09-10T11:42:23.434847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:23.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.559715+0000","last_change":"2024-09-10T11:40:54.559212+0000","last_active":"2024-09-10T11:40:54.559715+0000","last_peered":"2024-09-10T11:40:54.559715+0000","last_clean":"2024-09-10T11:40:54.559715+0000","last_became_active":"2024-09-10T11:40:54.553249+0000","last_became_peered":"2024-09-10T11:40:54.553249+0000","last_unstale":"2024-09-10T11:40:54.559715+0000","last_undegraded":"2024-09-10T11:40:54.559715+0000","last_fullsized":"2024-09-10T11:40:54.559715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:29.699339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.426167+0000","last_change":"2024-09-10T11:40:54.554828+0000","last_active":"2024-09-10T11:42:23.426167+0000","last_peered":"2024-09-10T11:42:23.426167+0000","last_clean":"2024-09-10T11:42:23.426167+0000","last_became_active":"2024-09-10T11:40:54.554410+0000","last_became_peered":"2024-09-10T11:40:54.554410+0000","last_unstale":"2024-09-10T11:42:23.426167+0000","last_undegraded":"2024-09-10T11:42:23.426167+0000","last_fullsized":"2024-09-10T11:42:23.426167+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:29.044625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549115+0000","last_change":"2024-09-10T11:40:37.485287+0000","last_active":"2024-09-10T11:40:54.549115+0000","last_peered":"2024-09-10T11:40:54.549115+0000","last_clean":"2024-09-10T11:40:54.549115+0000","last_became_active":"2024-09-10T11:40:37.484975+0000","last_became_peered":"2024-09-10T11:40:37.484975+0000","last_unstale":"2024-09-10T11:40:54.549115+0000","last_undegraded":"2024-09-10T11:40:54.549115+0000","last_fullsized":"2024-09-10T11:40:54.549115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:48.338591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.433839+0000","last_change":"2024-09-10T11:40:39.503124+0000","last_active":"2024-09-10T11:42:23.433839+0000","last_peered":"2024-09-10T11:42:23.433839+0000","last_clean":"2024-09-10T11:42:23.433839+0000","last_became_active":"2024-09-10T11:40:39.502715+0000","last_became_peered":"2024-09-10T11:40:39.502715+0000","last_unstale":"2024-09-10T11:42:23.433839+0000","last_undegraded":"2024-09-10T11:42:23.433839+0000","last_fullsized":"2024-09-10T11:42:23.433839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:11.040549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547220+0000","last_change":"2024-09-10T11:40:37.485502+0000","last_active":"2024-09-10T11:40:54.547220+0000","last_peered":"2024-09-10T11:40:54.547220+0000","last_clean":"2024-09-10T11:40:54.547220+0000","last_became_active":"2024-09-10T11:40:37.485178+0000","last_became_peered":"2024-09-10T11:40:37.485178+0000","last_unstale":"2024-09-10T11:40:54.547220+0000","last_undegraded":"2024-09-10T11:40:54.547220+0000","last_fullsized":"2024-09-10T11:40:54.547220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:54.709777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432616+0000","last_change":"2024-09-10T11:40:39.505426+0000","last_active":"2024-09-10T11:42:23.432616+0000","last_peered":"2024-09-10T11:42:23.432616+0000","last_clean":"2024-09-10T11:42:23.432616+0000","last_became_active":"2024-09-10T11:40:39.505027+0000","last_became_peered":"2024-09-10T11:40:39.505027+0000","last_unstale":"2024-09-10T11:42:23.432616+0000","last_undegraded":"2024-09-10T11:42:23.432616+0000","last_fullsized":"2024-09-10T11:42:23.432616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:40.317697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.687353+0000","last_change":"2024-09-10T11:40:37.796226+0000","last_active":"2024-09-10T11:42:26.687353+0000","last_peered":"2024-09-10T11:42:26.687353+0000","last_clean":"2024-09-10T11:42:26.687353+0000","last_became_active":"2024-09-10T11:40:37.795814+0000","last_became_peered":"2024-09-10T11:40:37.795814+0000","last_unstale":"2024-09-10T11:42:26.687353+0000","last_undegraded":"2024-09-10T11:42:26.687353+0000","last_fullsized":"2024-09-10T11:42:26.687353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:42.818575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435382+0000","last_change":"2024-09-10T11:40:39.497562+0000","last_active":"2024-09-10T11:42:23.435382+0000","last_peered":"2024-09-10T11:42:23.435382+0000","last_clean":"2024-09-10T11:42:23.435382+0000","last_became_active":"2024-09-10T11:40:39.497198+0000","last_became_peered":"2024-09-10T11:40:39.497198+0000","last_unstale":"2024-09-10T11:42:23.435382+0000","last_undegraded":"2024-09-10T11:42:23.435382+0000","last_fullsized":"2024-09-10T11:42:23.435382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.438845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558595+0000","last_change":"2024-09-10T11:39:29.173023+0000","last_active":"2024-09-10T11:40:54.558595+0000","last_peered":"2024-09-10T11:40:54.558595+0000","last_clean":"2024-09-10T11:40:54.558595+0000","last_became_active":"2024-09-10T11:39:29.172485+0000","last_became_peered":"2024-09-10T11:39:29.172485+0000","last_unstale":"2024-09-10T11:40:54.558595+0000","last_undegraded":"2024-09-10T11:40:54.558595+0000","last_fullsized":"2024-09-10T11:40:54.558595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:36:10.088210+0000","last_clean_scrub_stamp":"2024-09-10T11:36:10.088210+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.573217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546621+0000","last_change":"2024-09-10T11:40:37.479367+0000","last_active":"2024-09-10T11:40:54.546621+0000","last_peered":"2024-09-10T11:40:54.546621+0000","last_clean":"2024-09-10T11:40:54.546621+0000","last_became_active":"2024-09-10T11:40:37.479002+0000","last_became_peered":"2024-09-10T11:40:37.479002+0000","last_unstale":"2024-09-10T11:40:54.546621+0000","last_undegraded":"2024-09-10T11:40:54.546621+0000","last_fullsized":"2024-09-10T11:40:54.546621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:15:00.438501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418491+0000","last_change":"2024-09-10T11:40:39.503696+0000","last_active":"2024-09-10T11:42:23.418491+0000","last_peered":"2024-09-10T11:42:23.418491+0000","last_clean":"2024-09-10T11:42:23.418491+0000","last_became_active":"2024-09-10T11:40:39.503372+0000","last_became_peered":"2024-09-10T11:40:39.503372+0000","last_unstale":"2024-09-10T11:42:23.418491+0000","last_undegraded":"2024-09-10T11:42:23.418491+0000","last_fullsized":"2024-09-10T11:42:23.418491+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:16:56.397217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.558517+0000","last_change":"2024-09-10T11:40:37.483469+0000","last_active":"2024-09-10T11:40:54.558517+0000","last_peered":"2024-09-10T11:40:54.558517+0000","last_clean":"2024-09-10T11:40:54.558517+0000","last_became_active":"2024-09-10T11:40:37.483104+0000","last_became_peered":"2024-09-10T11:40:37.483104+0000","last_unstale":"2024-09-10T11:40:54.558517+0000","last_undegraded":"2024-09-10T11:40:54.558517+0000","last_fullsized":"2024-09-10T11:40:54.558517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.175233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417447+0000","last_change":"2024-09-10T11:40:39.501532+0000","last_active":"2024-09-10T11:42:23.417447+0000","last_peered":"2024-09-10T11:42:23.417447+0000","last_clean":"2024-09-10T11:42:23.417447+0000","last_became_active":"2024-09-10T11:40:39.501256+0000","last_became_peered":"2024-09-10T11:40:39.501256+0000","last_unstale":"2024-09-10T11:42:23.417447+0000","last_undegraded":"2024-09-10T11:42:23.417447+0000","last_fullsized":"2024-09-10T11:42:23.417447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.460891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:26.673871+0000","last_change":"2024-09-10T11:40:37.796137+0000","last_active":"2024-09-10T11:42:26.673871+0000","last_peered":"2024-09-10T11:42:26.673871+0000","last_clean":"2024-09-10T11:42:26.673871+0000","last_became_active":"2024-09-10T11:40:37.795824+0000","last_became_peered":"2024-09-10T11:40:37.795824+0000","last_unstale":"2024-09-10T11:42:26.673871+0000","last_undegraded":"2024-09-10T11:42:26.673871+0000","last_fullsized":"2024-09-10T11:42:26.673871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:29.256027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.428767+0000","last_change":"2024-09-10T11:40:39.507678+0000","last_active":"2024-09-10T11:42:23.428767+0000","last_peered":"2024-09-10T11:42:23.428767+0000","last_clean":"2024-09-10T11:42:23.428767+0000","last_became_active":"2024-09-10T11:40:39.507324+0000","last_became_peered":"2024-09-10T11:40:39.507324+0000","last_unstale":"2024-09-10T11:42:23.428767+0000","last_undegraded":"2024-09-10T11:42:23.428767+0000","last_fullsized":"2024-09-10T11:42:23.428767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:46.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'7","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:25.672538+0000","last_change":"2024-09-10T11:40:37.482539+0000","last_active":"2024-09-10T11:42:25.672538+0000","last_peered":"2024-09-10T11:42:25.672538+0000","last_clean":"2024-09-10T11:42:25.672538+0000","last_became_active":"2024-09-10T11:40:37.482178+0000","last_became_peered":"2024-09-10T11:40:37.482178+0000","last_unstale":"2024-09-10T11:42:25.672538+0000","last_undegraded":"2024-09-10T11:42:25.672538+0000","last_fullsized":"2024-09-10T11:42:25.672538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:31.915054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.415667+0000","last_change":"2024-09-10T11:40:39.505040+0000","last_active":"2024-09-10T11:42:23.415667+0000","last_peered":"2024-09-10T11:42:23.415667+0000","last_clean":"2024-09-10T11:42:23.415667+0000","last_became_active":"2024-09-10T11:40:39.504688+0000","last_became_peered":"2024-09-10T11:40:39.504688+0000","last_unstale":"2024-09-10T11:42:23.415667+0000","last_undegraded":"2024-09-10T11:42:23.415667+0000","last_fullsized":"2024-09-10T11:42:23.415667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.738709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.547724+0000","last_change":"2024-09-10T11:40:37.796547+0000","last_active":"2024-09-10T11:40:54.547724+0000","last_peered":"2024-09-10T11:40:54.547724+0000","last_clean":"2024-09-10T11:40:54.547724+0000","last_became_active":"2024-09-10T11:40:37.796218+0000","last_became_peered":"2024-09-10T11:40:37.796218+0000","last_unstale":"2024-09-10T11:40:54.547724+0000","last_undegraded":"2024-09-10T11:40:54.547724+0000","last_fullsized":"2024-09-10T11:40:54.547724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:11.257261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.420888+0000","last_change":"2024-09-10T11:40:39.496756+0000","last_active":"2024-09-10T11:42:23.420888+0000","last_peered":"2024-09-10T11:42:23.420888+0000","last_clean":"2024-09-10T11:42:23.420888+0000","last_became_active":"2024-09-10T11:40:39.495887+0000","last_became_peered":"2024-09-10T11:40:39.495887+0000","last_unstale":"2024-09-10T11:42:23.420888+0000","last_undegraded":"2024-09-10T11:42:23.420888+0000","last_fullsized":"2024-09-10T11:42:23.420888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:52.885551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.551031+0000","last_change":"2024-09-10T11:40:37.798147+0000","last_active":"2024-09-10T11:40:54.551031+0000","last_peered":"2024-09-10T11:40:54.551031+0000","last_clean":"2024-09-10T11:40:54.551031+0000","last_became_active":"2024-09-10T11:40:37.797696+0000","last_became_peered":"2024-09-10T11:40:37.797696+0000","last_unstale":"2024-09-10T11:40:54.551031+0000","last_undegraded":"2024-09-10T11:40:54.551031+0000","last_fullsized":"2024-09-10T11:40:54.551031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:31.968081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418551+0000","last_change":"2024-09-10T11:40:39.492787+0000","last_active":"2024-09-10T11:42:23.418551+0000","last_peered":"2024-09-10T11:42:23.418551+0000","last_clean":"2024-09-10T11:42:23.418551+0000","last_became_active":"2024-09-10T11:40:39.492423+0000","last_became_peered":"2024-09-10T11:40:39.492423+0000","last_unstale":"2024-09-10T11:42:23.418551+0000","last_undegraded":"2024-09-10T11:42:23.418551+0000","last_fullsized":"2024-09-10T11:42:23.418551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:40.099460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:41:05.498359+0000","last_change":"2024-09-10T11:40:37.481560+0000","last_active":"2024-09-10T11:41:05.498359+0000","last_peered":"2024-09-10T11:41:05.498359+0000","last_clean":"2024-09-10T11:41:05.498359+0000","last_became_active":"2024-09-10T11:40:37.481175+0000","last_became_peered":"2024-09-10T11:40:37.481175+0000","last_unstale":"2024-09-10T11:41:05.498359+0000","last_undegraded":"2024-09-10T11:41:05.498359+0000","last_fullsized":"2024-09-10T11:41:05.498359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:56.933498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.416697+0000","last_change":"2024-09-10T11:40:39.506767+0000","last_active":"2024-09-10T11:42:23.416697+0000","last_peered":"2024-09-10T11:42:23.416697+0000","last_clean":"2024-09-10T11:42:23.416697+0000","last_became_active":"2024-09-10T11:40:39.505236+0000","last_became_peered":"2024-09-10T11:40:39.505236+0000","last_unstale":"2024-09-10T11:42:23.416697+0000","last_undegraded":"2024-09-10T11:42:23.416697+0000","last_fullsized":"2024-09-10T11:42:23.416697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:24.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546964+0000","last_change":"2024-09-10T11:40:37.481180+0000","last_active":"2024-09-10T11:40:54.546964+0000","last_peered":"2024-09-10T11:40:54.546964+0000","last_clean":"2024-09-10T11:40:54.546964+0000","last_became_active":"2024-09-10T11:40:37.480872+0000","last_became_peered":"2024-09-10T11:40:37.480872+0000","last_unstale":"2024-09-10T11:40:54.546964+0000","last_undegraded":"2024-09-10T11:40:54.546964+0000","last_fullsized":"2024-09-10T11:40:54.546964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:14.585111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.417486+0000","last_change":"2024-09-10T11:40:39.501318+0000","last_active":"2024-09-10T11:42:23.417486+0000","last_peered":"2024-09-10T11:42:23.417486+0000","last_clean":"2024-09-10T11:42:23.417486+0000","last_became_active":"2024-09-10T11:40:39.500997+0000","last_became_peered":"2024-09-10T11:40:39.500997+0000","last_unstale":"2024-09-10T11:42:23.417486+0000","last_undegraded":"2024-09-10T11:42:23.417486+0000","last_fullsized":"2024-09-10T11:42:23.417486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:33.469670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.557657+0000","last_change":"2024-09-10T11:40:54.557657+0000","last_active":"2024-09-10T11:40:54.557657+0000","last_peered":"2024-09-10T11:40:54.557657+0000","last_clean":"2024-09-10T11:40:54.557657+0000","last_became_active":"2024-09-10T11:40:54.552080+0000","last_became_peered":"2024-09-10T11:40:54.552080+0000","last_unstale":"2024-09-10T11:40:54.557657+0000","last_undegraded":"2024-09-10T11:40:54.557657+0000","last_fullsized":"2024-09-10T11:40:54.557657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:33.789295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.390251+0000","last_change":"2024-09-10T11:40:39.499910+0000","last_active":"2024-09-10T11:42:23.390251+0000","last_peered":"2024-09-10T11:42:23.390251+0000","last_clean":"2024-09-10T11:42:23.390251+0000","last_became_active":"2024-09-10T11:40:39.499533+0000","last_became_peered":"2024-09-10T11:40:39.499533+0000","last_unstale":"2024-09-10T11:42:23.390251+0000","last_undegraded":"2024-09-10T11:42:23.390251+0000","last_fullsized":"2024-09-10T11:42:23.390251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:13.880230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.545918+0000","last_change":"2024-09-10T11:40:37.479380+0000","last_active":"2024-09-10T11:40:54.545918+0000","last_peered":"2024-09-10T11:40:54.545918+0000","last_clean":"2024-09-10T11:40:54.545918+0000","last_became_active":"2024-09-10T11:40:37.479058+0000","last_became_peered":"2024-09-10T11:40:37.479058+0000","last_unstale":"2024-09-10T11:40:54.545918+0000","last_undegraded":"2024-09-10T11:40:54.545918+0000","last_fullsized":"2024-09-10T11:40:54.545918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:32.041697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.425892+0000","last_change":"2024-09-10T11:40:39.500437+0000","last_active":"2024-09-10T11:42:23.425892+0000","last_peered":"2024-09-10T11:42:23.425892+0000","last_clean":"2024-09-10T11:42:23.425892+0000","last_became_active":"2024-09-10T11:40:39.499995+0000","last_became_peered":"2024-09-10T11:40:39.499995+0000","last_unstale":"2024-09-10T11:42:23.425892+0000","last_undegraded":"2024-09-10T11:42:23.425892+0000","last_fullsized":"2024-09-10T11:42:23.425892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:07.731637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.548480+0000","last_change":"2024-09-10T11:40:37.487353+0000","last_active":"2024-09-10T11:40:54.548480+0000","last_peered":"2024-09-10T11:40:54.548480+0000","last_clean":"2024-09-10T11:40:54.548480+0000","last_became_active":"2024-09-10T11:40:37.486561+0000","last_became_peered":"2024-09-10T11:40:37.486561+0000","last_unstale":"2024-09-10T11:40:54.548480+0000","last_undegraded":"2024-09-10T11:40:54.548480+0000","last_fullsized":"2024-09-10T11:40:54.548480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:13.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.414620+0000","last_change":"2024-09-10T11:40:39.497968+0000","last_active":"2024-09-10T11:42:23.414620+0000","last_peered":"2024-09-10T11:42:23.414620+0000","last_clean":"2024-09-10T11:42:23.414620+0000","last_became_active":"2024-09-10T11:40:39.497184+0000","last_became_peered":"2024-09-10T11:40:39.497184+0000","last_unstale":"2024-09-10T11:42:23.414620+0000","last_undegraded":"2024-09-10T11:42:23.414620+0000","last_fullsized":"2024-09-10T11:42:23.414620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:21.669854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549422+0000","last_change":"2024-09-10T11:40:37.488019+0000","last_active":"2024-09-10T11:40:54.549422+0000","last_peered":"2024-09-10T11:40:54.549422+0000","last_clean":"2024-09-10T11:40:54.549422+0000","last_became_active":"2024-09-10T11:40:37.487678+0000","last_became_peered":"2024-09-10T11:40:37.487678+0000","last_unstale":"2024-09-10T11:40:54.549422+0000","last_undegraded":"2024-09-10T11:40:54.549422+0000","last_fullsized":"2024-09-10T11:40:54.549422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:24.860993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435462+0000","last_change":"2024-09-10T11:40:39.500668+0000","last_active":"2024-09-10T11:42:23.435462+0000","last_peered":"2024-09-10T11:42:23.435462+0000","last_clean":"2024-09-10T11:42:23.435462+0000","last_became_active":"2024-09-10T11:40:39.497598+0000","last_became_peered":"2024-09-10T11:40:39.497598+0000","last_unstale":"2024-09-10T11:42:23.435462+0000","last_undegraded":"2024-09-10T11:42:23.435462+0000","last_fullsized":"2024-09-10T11:42:23.435462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:20.597056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.435509+0000","last_change":"2024-09-10T11:40:39.507587+0000","last_active":"2024-09-10T11:42:23.435509+0000","last_peered":"2024-09-10T11:42:23.435509+0000","last_clean":"2024-09-10T11:42:23.435509+0000","last_became_active":"2024-09-10T11:40:39.507321+0000","last_became_peered":"2024-09-10T11:40:39.507321+0000","last_unstale":"2024-09-10T11:42:23.435509+0000","last_undegraded":"2024-09-10T11:42:23.435509+0000","last_fullsized":"2024-09-10T11:42:23.435509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:18.096475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.549839+0000","last_change":"2024-09-10T11:40:37.485935+0000","last_active":"2024-09-10T11:40:54.549839+0000","last_peered":"2024-09-10T11:40:54.549839+0000","last_clean":"2024-09-10T11:40:54.549839+0000","last_became_active":"2024-09-10T11:40:37.485589+0000","last_became_peered":"2024-09-10T11:40:37.485589+0000","last_unstale":"2024-09-10T11:40:54.549839+0000","last_undegraded":"2024-09-10T11:40:54.549839+0000","last_fullsized":"2024-09-10T11:40:54.549839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:37.770691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.432541+0000","last_change":"2024-09-10T11:40:39.497774+0000","last_active":"2024-09-10T11:42:23.432541+0000","last_peered":"2024-09-10T11:42:23.432541+0000","last_clean":"2024-09-10T11:42:23.432541+0000","last_became_active":"2024-09-10T11:40:39.497383+0000","last_became_peered":"2024-09-10T11:40:39.497383+0000","last_unstale":"2024-09-10T11:42:23.432541+0000","last_undegraded":"2024-09-10T11:42:23.432541+0000","last_fullsized":"2024-09-10T11:42:23.432541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.947624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.550843+0000","last_change":"2024-09-10T11:40:37.489071+0000","last_active":"2024-09-10T11:40:54.550843+0000","last_peered":"2024-09-10T11:40:54.550843+0000","last_clean":"2024-09-10T11:40:54.550843+0000","last_became_active":"2024-09-10T11:40:37.487653+0000","last_became_peered":"2024-09-10T11:40:37.487653+0000","last_unstale":"2024-09-10T11:40:54.550843+0000","last_undegraded":"2024-09-10T11:40:54.550843+0000","last_fullsized":"2024-09-10T11:40:54.550843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:53.354491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.427749+0000","last_change":"2024-09-10T11:40:39.499097+0000","last_active":"2024-09-10T11:42:23.427749+0000","last_peered":"2024-09-10T11:42:23.427749+0000","last_clean":"2024-09-10T11:42:23.427749+0000","last_became_active":"2024-09-10T11:40:39.498442+0000","last_became_peered":"2024-09-10T11:40:39.498442+0000","last_unstale":"2024-09-10T11:42:23.427749+0000","last_undegraded":"2024-09-10T11:42:23.427749+0000","last_fullsized":"2024-09-10T11:42:23.427749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:00.626995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.546374+0000","last_change":"2024-09-10T11:40:37.796158+0000","last_active":"2024-09-10T11:40:54.546374+0000","last_peered":"2024-09-10T11:40:54.546374+0000","last_clean":"2024-09-10T11:40:54.546374+0000","last_became_active":"2024-09-10T11:40:37.795788+0000","last_became_peered":"2024-09-10T11:40:37.795788+0000","last_unstale":"2024-09-10T11:40:54.546374+0000","last_undegraded":"2024-09-10T11:40:54.546374+0000","last_fullsized":"2024-09-10T11:40:54.546374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:46.477684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:23.418362+0000","last_change":"2024-09-10T11:40:54.552980+0000","last_active":"2024-09-10T11:42:23.418362+0000","last_peered":"2024-09-10T11:42:23.418362+0000","last_clean":"2024-09-10T11:42:23.418362+0000","last_became_active":"2024-09-10T11:40:54.552555+0000","last_became_peered":"2024-09-10T11:40:54.552555+0000","last_unstale":"2024-09-10T11:42:23.418362+0000","last_undegraded":"2024-09-10T11:42:23.418362+0000","last_fullsized":"2024-09-10T11:42:23.418362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:38.470631+0000","last_clean_scrub_stamp":"2024-09-10T11:40:38.470631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:53.348538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":132,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T11:42:24.670472+0000","last_change":"2024-09-10T11:40:37.482586+0000","last_active":"2024-09-10T11:42:24.670472+0000","last_peered":"2024-09-10T11:42:24.670472+0000","last_clean":"2024-09-10T11:42:24.670472+0000","last_became_active":"2024-09-10T11:40:37.482213+0000","last_became_peered":"2024-09-10T11:40:37.482213+0000","last_unstale":"2024-09-10T11:42:24.670472+0000","last_undegraded":"2024-09-10T11:42:24.670472+0000","last_fullsized":"2024-09-10T11:42:24.670472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:40:36.459264+0000","last_clean_scrub_stamp":"2024-09-10T11:40:36.459264+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:52:05.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74979,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1025,"num_read_kb":598,"num_write":260,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":216001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449123,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":454041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678055,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1646592,"data_stored":1112763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":453949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103218,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":454305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1556480,"data_stored":1047522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":454200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1046440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":454061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":962560,"data_stored":453491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":517974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":517980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":455005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:42:32.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:42:32.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:32 smithi017 ceph-mon[30817]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T11:42:32.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:32 smithi017 ceph-mon[30817]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:32.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:32 smithi017 ceph-mon[30817]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:32 smithi081 ceph-mon[35059]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T11:42:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:32 smithi081 ceph-mon[35059]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:32 smithi081 ceph-mon[35059]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:33.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:32 smithi026 ceph-mon[34817]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T11:42:33.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:32 smithi026 ceph-mon[34817]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:33.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:32 smithi026 ceph-mon[34817]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.256+0000 7f540f1c3640 1 -- 172.21.15.17:0/564467326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5408102d40 msgr2=0x7f5408103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.256+0000 7f540f1c3640 1 --2- 172.21.15.17:0/564467326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5408102d40 0x7f5408103120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009900 tx=0x7f53fc02a480 comp rx=0 tx=0).stop 2024-09-10T11:42:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- 172.21.15.17:0/564467326 shutdown_connections 2024-09-10T11:42:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- 172.21.15.17:0/564467326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408103660 0x7f540810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- 172.21.15.17:0/564467326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540810c170 0x7f540810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- 172.21.15.17:0/564467326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5408102d40 0x7f5408103120 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- 172.21.15.17:0/564467326 >> 172.21.15.17:0/564467326 conn(0x7f54080fc7a0 msgr2=0x7f54080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- 172.21.15.17:0/564467326 shutdown_connections 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- 172.21.15.17:0/564467326 wait complete. 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 Processor -- start 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- start start 2024-09-10T11:42:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408102d40 0x7f5408198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5408103660 0x7f5408198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5408111fd0 con 0x7f540810c170 2024-09-10T11:42:33.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5408111e50 con 0x7f5408103660 2024-09-10T11:42:33.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.257+0000 7f540f1c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5408112150 con 0x7f5408102d40 2024-09-10T11:42:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41682/0 (socket says 172.21.15.17:41682) 2024-09-10T11:42:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 -- 172.21.15.17:0/2522747047 learned_addr learned my addr 172.21.15.17:0/2522747047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540cf5f640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408102d40 0x7f5408198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f5407fff640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5408103660 0x7f5408198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 -- 172.21.15.17:0/2522747047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408102d40 msgr2=0x7f5408198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408102d40 0x7f5408198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 -- 172.21.15.17:0/2522747047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5408103660 msgr2=0x7f5408198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5408103660 0x7f5408198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 -- 172.21.15.17:0/2522747047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540819d4e0 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540d760640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f540000b970 tx=0x7f540000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400019070 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f540000cb40 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540819d7d0 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.258+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400007650 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.259+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54081a50b0 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.260+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5408103120 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.260+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f540001c070 con 0x7f540810c170 2024-09-10T11:42:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.261+0000 7f5405ffb640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 0x7f53f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.261+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f54000ce620 con 0x7f540810c170 2024-09-10T11:42:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.261+0000 7f540cf5f640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 0x7f53f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.262+0000 7f540cf5f640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 0x7f53f80a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53fc000c00 tx=0x7f53fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.265+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f540009af40 con 0x7f540810c170 2024-09-10T11:42:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.478+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5408107240 con 0x7f540810c170 2024-09-10T11:42:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.479+0000 7f5405ffb640 1 -- 172.21.15.17:0/2522747047 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f540009f240 con 0x7f540810c170 2024-09-10T11:42:33.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:33.481 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-10T11:42:28:538585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:42:28.100418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:42:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-10T11:42:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 msgr2=0x7f53f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 0x7f53f80a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53fc000c00 tx=0x7f53fc0058d0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 msgr2=0x7f540819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f540000b970 tx=0x7f540000be30 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 shutdown_connections 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f53f80a2b80 0x7f53f80a5040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540810c170 0x7f540819ce00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5408103660 0x7f5408198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 --2- 172.21.15.17:0/2522747047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5408102d40 0x7f5408198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 >> 172.21.15.17:0/2522747047 conn(0x7f54080fc7a0 msgr2=0x7f54080fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 shutdown_connections 2024-09-10T11:42:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:33.482+0000 7f540f1c3640 1 -- 172.21.15.17:0/2522747047 wait complete. 2024-09-10T11:42:33.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:33 smithi017 ceph-mon[30817]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:33.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:33 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2522747047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:33.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:33 smithi081 ceph-mon[35059]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:33.854 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:33 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2522747047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:34.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:33 smithi026 ceph-mon[34817]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T11:42:34.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:33 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2522747047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:42:34.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:42:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:34.827 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:34 smithi017 ceph-mon[30817]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-10T11:42:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.907+0000 7f89c4573640 1 -- 172.21.15.17:0/528184691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 msgr2=0x7f89bc10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.907+0000 7f89c4573640 1 --2- 172.21.15.17:0/528184691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc10eab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009ca0 tx=0x7f89b402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 -- 172.21.15.17:0/528184691 shutdown_connections 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 --2- 172.21.15.17:0/528184691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc10eab0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 --2- 172.21.15.17:0/528184691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100eb0 0x7f89bc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 --2- 172.21.15.17:0/528184691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100500 0x7f89bc1008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 -- 172.21.15.17:0/528184691 >> 172.21.15.17:0/528184691 conn(0x7f89bc0fc5c0 msgr2=0x7f89bc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 -- 172.21.15.17:0/528184691 shutdown_connections 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 -- 172.21.15.17:0/528184691 wait complete. 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 Processor -- start 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.908+0000 7f89c4573640 1 -- start start 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100500 0x7f89bc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100eb0 0x7f89bc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc111f90 con 0x7f89bc106f70 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc111e10 con 0x7f89bc100500 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c4573640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc112110 con 0x7f89bc100eb0 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41696/0 (socket says 172.21.15.17:41696) 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 -- 172.21.15.17:0/2239964084 learned_addr learned my addr 172.21.15.17:0/2239964084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c230f640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100500 0x7f89bc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c1b0e640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100eb0 0x7f89bc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 -- 172.21.15.17:0/2239964084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100eb0 msgr2=0x7f89bc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100eb0 0x7f89bc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 -- 172.21.15.17:0/2239964084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100500 msgr2=0x7f89bc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100500 0x7f89bc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 -- 172.21.15.17:0/2239964084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc19d400 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.909+0000 7f89c2b10640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89b4031a20 tx=0x7f89b4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.910+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4003c30 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.910+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b4003dd0 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.910+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc19d690 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.910+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b402fcf0 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.910+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc1a4fd0 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.911+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89bc1008e0 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.912+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f89b4004050 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.913+0000 7f89b37fe640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.913+0000 7f89c230f640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.913+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f89b40f02f0 con 0x7f89bc106f70 2024-09-10T11:42:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.913+0000 7f89c230f640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 0x7f89a80a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89bc069fc0 tx=0x7f89b800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:34.917+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89b40bd3b0 con 0x7f89bc106f70 2024-09-10T11:42:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:34 smithi081 ceph-mon[35059]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-10T11:42:35.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:34 smithi026 ceph-mon[34817]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-10T11:42:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.096+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89bc109b50 con 0x7f89bc106f70 2024-09-10T11:42:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.097+0000 7f89b37fe640 1 -- 172.21.15.17:0/2239964084 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7f89b402fe90 con 0x7f89bc106f70 2024-09-10T11:42:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:42:35.099 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 msgr2=0x7f89a80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 0x7f89a80a50c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89bc069fc0 tx=0x7f89b800a2d0 comp rx=0 tx=0).stop 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 msgr2=0x7f89bc19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89b4031a20 tx=0x7f89b4031a50 comp rx=0 tx=0).stop 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 shutdown_connections 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f89a80a2c00 0x7f89a80a50c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc100eb0 0x7f89bc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc106f70 0x7f89bc19cd20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 --2- 172.21.15.17:0/2239964084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89bc100500 0x7f89bc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 >> 172.21.15.17:0/2239964084 conn(0x7f89bc0fc5c0 msgr2=0x7f89bc105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 shutdown_connections 2024-09-10T11:42:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:35.100+0000 7f89c4573640 1 -- 172.21.15.17:0/2239964084 wait complete. 2024-09-10T11:42:35.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:35 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2239964084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:35.911 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T11:42:35.912 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T11:42:35.926 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:42:35.926 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T11:42:35.926 INFO:tasks.workunit:timeout=3h 2024-09-10T11:42:35.926 INFO:tasks.workunit:cleanup=True 2024-09-10T11:42:35.927 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:35.927 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T11:42:35.927 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:42:35.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:42:35.947 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 11:40:57.861361866 +0000 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 11:40:57.861361866 +0000 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 11:42:27.411403969 +0000 2024-09-10T11:42:35.948 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 11:40:57.861361866 +0000 2024-09-10T11:42:35.948 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T11:42:35.949 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T11:42:35.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:35 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2239964084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:36.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:35 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2239964084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:42:36.025 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T11:42:36.082 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T11:42:36.201 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- 172.21.15.17:0/27221641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 msgr2=0x7f288010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 --2- 172.21.15.17:0/27221641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f288010ec40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2878009930 tx=0x7f287802a420 comp rx=0 tx=0).stop 2024-09-10T11:42:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- 172.21.15.17:0/27221641 shutdown_connections 2024-09-10T11:42:36.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 --2- 172.21.15.17:0/27221641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f288010ec40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 --2- 172.21.15.17:0/27221641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f28801036e0 0x7f2880107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 --2- 172.21.15.17:0/27221641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2880102d30 0x7f2880103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- 172.21.15.17:0/27221641 >> 172.21.15.17:0/27221641 conn(0x7f28800fc7d0 msgr2=0x7f28800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- 172.21.15.17:0/27221641 shutdown_connections 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- 172.21.15.17:0/27221641 wait complete. 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 Processor -- start 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.748+0000 7f28879fe640 1 -- start start 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880102d30 0x7f2880100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 0x7f2880100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28801120a0 con 0x7f28801082a0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2880111f20 con 0x7f2880102d30 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f28879fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2880112220 con 0x7f28801036e0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41710/0 (socket says 172.21.15.17:41710) 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 -- 172.21.15.17:0/4285547016 learned_addr learned my addr 172.21.15.17:0/4285547016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f288579a640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880102d30 0x7f2880100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2884f99640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 0x7f2880100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 -- 172.21.15.17:0/4285547016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 msgr2=0x7f2880100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 0x7f2880100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 -- 172.21.15.17:0/4285547016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880102d30 msgr2=0x7f2880100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880102d30 0x7f2880100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 -- 172.21.15.17:0/4285547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28801a6a30 con 0x7f28801082a0 2024-09-10T11:42:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2884f99640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 0x7f2880100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f2885f9b640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2878005ab0 tx=0x7f28780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.749+0000 7f287e7fc640 1 -- 172.21.15.17:0/4285547016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287803f030 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.750+0000 7f287e7fc640 1 -- 172.21.15.17:0/4285547016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2878003ce0 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.750+0000 7f287e7fc640 1 -- 172.21.15.17:0/4285547016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878035070 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.750+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28801a6cc0 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.750+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28801a71a0 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.752+0000 7f287e7fc640 1 -- 172.21.15.17:0/4285547016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2878042030 con 0x7f28801082a0 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.752+0000 7f2889dd7740 1 Processor -- start 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.752+0000 7f2889dd7740 1 -- start start 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.752+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e5fb60 0x561cc8e5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.752+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2889dd7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561cc8dc5280 con 0x561cc8e60480 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2889dd7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561cc8d6cb10 con 0x561cc8e6ad40 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2889dd7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561cc8dc1240 con 0x561cc8e5fb60 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f287e7fc640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 0x7f28680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41722/0 (socket says 172.21.15.17:41722) 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 -- 172.21.15.17:0/4264367048 learned_addr learned my addr 172.21.15.17:0/4264367048 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2884f99640 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e5fb60 0x561cc8e5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2885f9b640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 0x7f28680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f287e7fc640 1 -- 172.21.15.17:0/4285547016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f28780ef490 con 0x7f28801082a0 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2884f99640 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 -- 172.21.15.17:0/4264367048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e5fb60 msgr2=0x561cc8e5ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e5fb60 0x561cc8e5ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 -- 172.21.15.17:0/4264367048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 msgr2=0x561cc8e6d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 -- 172.21.15.17:0/4264367048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc8d791f0 con 0x561cc8e60480 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f288579a640 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f28700103f0 tx=0x7f28700108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb2f9915f756091 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f2885f9b640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 0x7f28680a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28780bba00 tx=0x7f2878086980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f28677fe640 1 -- 172.21.15.17:0/4264367048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870016070 con 0x561cc8e60480 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.753+0000 7f28677fe640 1 -- 172.21.15.17:0/4264367048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2870004d20 con 0x561cc8e60480 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f28677fe640 1 -- 172.21.15.17:0/4264367048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870005480 con 0x561cc8e60480 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 -- 172.21.15.17:0/4264367048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 msgr2=0x561cc8e6a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f28700103f0 tx=0x7f28700108b0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 -- 172.21.15.17:0/4264367048 shutdown_connections 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e6a800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 --2- 172.21.15.17:0/4264367048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e5fb60 0x561cc8e5ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 -- 172.21.15.17:0/4264367048 >> 172.21.15.17:0/4264367048 conn(0x561cc8e5c0f0 msgr2=0x561cc8e5c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 -- 172.21.15.17:0/4264367048 shutdown_connections 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.754+0000 7f2889dd7740 1 -- 172.21.15.17:0/4264367048 wait complete. 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 -- start start 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 Processor -- start 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e5fb60 0x561cc8e67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e6ad40 0x561cc8e68600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561cc8e6d910 con 0x561cc8e60480 2024-09-10T11:42:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561cc8d7ff10 con 0x561cc8e5fb60 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561cc8e6da90 con 0x561cc8e6ad40 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2889dd7740 10 client.0 _ll_register_callbacks cb 0x561cc8d48a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f288579a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f288579a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41724/0 (socket says 172.21.15.17:41724) 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f288579a640 1 -- 172.21.15.17:0/2040676792 learned_addr learned my addr 172.21.15.17:0/2040676792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2884f99640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e5fb60 0x561cc8e67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.755+0000 7f2884f99640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e6ad40 0x561cc8e68600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 -- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e6ad40 msgr2=0x561cc8e68600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e6ad40 0x561cc8e68600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 -- 172.21.15.17:0/2040676792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e5fb60 msgr2=0x561cc8e67b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e5fb60 0x561cc8e67b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 -- 172.21.15.17:0/2040676792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc8b366a0 con 0x561cc8e60480 2024-09-10T11:42:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f288579a640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2870004c70 tx=0x7f2870009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6390a6fbce0891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2864ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870029060 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2870003d80 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2870004d20 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2870016070 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2889dd7740 10 client.15288 fetch_fsmap learned FSMap version 28 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561cc8e794e0 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.756+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2870004d20 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f287000f040 con 0x561cc8e60480 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 10 client.15288 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 10 client.15288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 20 client.15288 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8e7a9a0 0x561cc8e7cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 4 client.15288 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc8dd27f0 con 0x561cc8e7a9a0 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2884f99640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8e7a9a0 0x561cc8e7cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2884f99640 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8e7a9a0 0x561cc8e7cd90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1e66fa9d7c40f68 server_cookie=901885a7b37db844 in_seq=0 out_seq=0 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.757+0000 7f2864ff9640 10 client.15288 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2864ff9640 1 -- 172.21.15.17:0/2040676792 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cc8dd27f0 con 0x561cc8e7a9a0 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2864ff9640 10 client.15288 handle_command_reply: tid=0 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 client.15288 shutdown 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 msgr2=0x561cc8e680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2870004c70 tx=0x7f2870009df0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 shutdown_connections 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8e7a9a0 0x561cc8e7cd90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e6ad40 0x561cc8e68600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e60480 0x561cc8e680c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 --2- 172.21.15.17:0/2040676792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e5fb60 0x561cc8e67b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 >> 172.21.15.17:0/2040676792 conn(0x561cc8e5c0f0 msgr2=0x561cc8e5b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2864ff9640 0 client.15288 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 shutdown_connections 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 1 -- 172.21.15.17:0/2040676792 wait complete. 2024-09-10T11:42:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.758+0000 7f2889dd7740 20 client.15288 trim_cache size 0 max 16384 2024-09-10T11:42:36.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 Processor -- start 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 -- start start 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e82330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e82870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28801af750 con 0x561cc8e5fb60 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f28801b1290 con 0x561cc8e6ad40 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2889dd7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28801afe20 con 0x561cc8e60480 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2884f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2884f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41736/0 (socket says 172.21.15.17:41736) 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f2884f99640 1 -- 172.21.15.17:0/1344001678 learned_addr learned my addr 172.21.15.17:0/1344001678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.776+0000 7f288579a640 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e82330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 -- 172.21.15.17:0/1344001678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 msgr2=0x561cc8e82330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e82330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 -- 172.21.15.17:0/1344001678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 msgr2=0x561cc8e82870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e82870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 -- 172.21.15.17:0/1344001678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc8e57830 con 0x561cc8e5fb60 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f288579a640 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e82330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2884f99640 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f288006a370 tx=0x7f287400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3710ca95848357 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2866ffd640 1 -- 172.21.15.17:0/1344001678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874025070 con 0x561cc8e5fb60 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2866ffd640 1 -- 172.21.15.17:0/1344001678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28740213d0 con 0x561cc8e5fb60 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.777+0000 7f2866ffd640 1 -- 172.21.15.17:0/1344001678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874000e60 con 0x561cc8e5fb60 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- 172.21.15.17:0/1344001678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 msgr2=0x561cc8e699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f288006a370 tx=0x7f287400cb70 comp rx=0 tx=0).stop 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- 172.21.15.17:0/1344001678 shutdown_connections 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e82330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e82870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 --2- 172.21.15.17:0/1344001678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e699e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- 172.21.15.17:0/1344001678 >> 172.21.15.17:0/1344001678 conn(0x561cc8e5c0f0 msgr2=0x561cc8e692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- 172.21.15.17:0/1344001678 shutdown_connections 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- 172.21.15.17:0/1344001678 wait complete. 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 -- start start 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 Processor -- start 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.778+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e6ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28801b0bc0 con 0x561cc8e5fb60 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f28801b04f0 con 0x561cc8e6ad40 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28801ad730 con 0x561cc8e60480 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 10 client.0 _ll_register_callbacks cb 0x7f287400ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41738/0 (socket says 172.21.15.17:41738) 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 -- 172.21.15.17:0/3011251758 learned_addr learned my addr 172.21.15.17:0/3011251758 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f288579a640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e6ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 -- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 msgr2=0x561cc8e6ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e6ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 -- 172.21.15.17:0/3011251758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 msgr2=0x561cc8e6f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 -- 172.21.15.17:0/3011251758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc8ee4300 con 0x561cc8e5fb60 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2884f99640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f287400d010 tx=0x7f28740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2957d21c63e7ff72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2864ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874034020 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2874021780 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.779+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28740213d0 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2874025030 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 10 client.15294 fetch_fsmap learned FSMap version 28 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561cc8ee5470 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28740213d0 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f287402a420 con 0x561cc8e5fb60 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 10 client.15294 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 10 client.15294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 20 client.15294 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8ee5ae0 0x561cc8ee7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 4 client.15294 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:42:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561cc8dccd00 con 0x561cc8ee5ae0 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.780+0000 7f288579a640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8ee5ae0 0x561cc8ee7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.781+0000 7f2864ff9640 10 client.15294 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.781+0000 7f288579a640 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8ee5ae0 0x561cc8ee7f00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a781f6db6ce666f6 server_cookie=2811cd1cb11cd47 in_seq=0 out_seq=0 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2864ff9640 1 -- 172.21.15.17:0/3011251758 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561cc8dccd00 con 0x561cc8ee5ae0 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2864ff9640 10 client.15294 handle_command_reply: tid=0 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 client.15294 shutdown 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 msgr2=0x561cc8e73640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f287400d010 tx=0x7f28740046c0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 shutdown_connections 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x561cc8ee5ae0 0x561cc8ee7f00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561cc8e60480 0x561cc8e6ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2864ff9640 0 client.15294 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561cc8e6ad40 0x561cc8e6f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 --2- 172.21.15.17:0/3011251758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561cc8e5fb60 0x561cc8e73640 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 >> 172.21.15.17:0/3011251758 conn(0x561cc8e5c0f0 msgr2=0x561cc8e5b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 shutdown_connections 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 1 -- 172.21.15.17:0/3011251758 wait complete. 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.782+0000 7f2889dd7740 20 client.15294 trim_cache size 0 max 16384 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "6a6aede5-62b0-43f7-9fcd-75f00f6bb832", 2024-09-10T11:42:36.791 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:42:36.792 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 msgr2=0x7f28680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 0x7f28680a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28780bba00 tx=0x7f2878086980 comp rx=0 tx=0).stop 2024-09-10T11:42:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 msgr2=0x7f2880101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2878005ab0 tx=0x7f28780042f0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 shutdown_connections 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f28680a2b80 0x7f28680a5040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28801036e0 0x7f2880100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28801082a0 0x7f2880101410 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 --2- 172.21.15.17:0/4285547016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2880102d30 0x7f2880100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 >> 172.21.15.17:0/4285547016 conn(0x7f28800fc7d0 msgr2=0x7f2880105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 shutdown_connections 2024-09-10T11:42:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:36.783+0000 7f28879fe640 1 -- 172.21.15.17:0/4285547016 wait complete. 2024-09-10T11:42:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:36 smithi081 ceph-mon[35059]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T11:42:37.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:36 smithi026 ceph-mon[34817]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T11:42:37.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:36 smithi017 ceph-mon[30817]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T11:42:37.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:42:37.627 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:37 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:42:37.627 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:37.628 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:42:37.628 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:37.860 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:42:37.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:37 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:42:37.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:37.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:42:37.906 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:37 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:42:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:42:37.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:42:38.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 -- 172.21.15.17:0/1982823126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820112b90 msgr2=0x7f3820114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 --2- 172.21.15.17:0/1982823126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820112b90 0x7f3820114f80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3818009ca0 tx=0x7f381802a950 comp rx=0 tx=0).stop 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 -- 172.21.15.17:0/1982823126 shutdown_connections 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 --2- 172.21.15.17:0/1982823126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820112b90 0x7f3820114f80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 --2- 172.21.15.17:0/1982823126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820074eb0 0x7f3820112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 --2- 172.21.15.17:0/1982823126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 0x7f3820074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.311+0000 7f3827d4b640 1 -- 172.21.15.17:0/1982823126 >> 172.21.15.17:0/1982823126 conn(0x7f38200fd8c0 msgr2=0x7f38200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- 172.21.15.17:0/1982823126 shutdown_connections 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- 172.21.15.17:0/1982823126 wait complete. 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 Processor -- start 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- start start 2024-09-10T11:42:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 0x7f38201a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820112b90 0x7f382019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3820118560 con 0x7f3820074eb0 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f38201183e0 con 0x7f3820112b90 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f3827d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38201186e0 con 0x7f3820074590 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.312+0000 7f38252e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41764/0 (socket says 172.21.15.17:41764) 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 -- 172.21.15.17:0/952110576 learned_addr learned my addr 172.21.15.17:0/952110576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38262e8640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820112b90 0x7f382019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3825ae7640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 0x7f38201a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 -- 172.21.15.17:0/952110576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 msgr2=0x7f38201a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 0x7f38201a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 -- 172.21.15.17:0/952110576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820112b90 msgr2=0x7f382019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820112b90 0x7f382019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 -- 172.21.15.17:0/952110576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382019efa0 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f38252e6640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f381000d950 tx=0x7f381000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3816ffd640 1 -- 172.21.15.17:0/952110576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810017070 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3816ffd640 1 -- 172.21.15.17:0/952110576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3810009c30 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382019f290 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3816ffd640 1 -- 172.21.15.17:0/952110576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381000f6b0 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.313+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38201ab580 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.315+0000 7f3816ffd640 1 -- 172.21.15.17:0/952110576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f38100109d0 con 0x7f3820074eb0 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 Processor -- start 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 -- start start 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 0x55f31f0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f31f02e2e0 con 0x55f31f0c8dc0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f31efd5ce0 con 0x55f31f0c84a0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f382a124740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f31f02a2a0 con 0x55f31f0d3680 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f3816ffd640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 0x7f380c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41772/0 (socket says 172.21.15.17:41772) 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.316+0000 7f3825ae7640 1 -- 172.21.15.17:0/3903881550 learned_addr learned my addr 172.21.15.17:0/3903881550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f38252e6640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f38262e8640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 0x55f31f0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3816ffd640 1 -- 172.21.15.17:0/952110576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f38100ceb30 con 0x7f3820074eb0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f38262e8640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 0x7f380c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 -- 172.21.15.17:0/3903881550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 msgr2=0x55f31f0d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0d5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 -- 172.21.15.17:0/3903881550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 msgr2=0x55f31f0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 0x55f31f0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 -- 172.21.15.17:0/3903881550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31efba440 con 0x55f31f0c8dc0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f38262e8640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 0x55f31f0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f381c00abe0 tx=0x7f381c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75cbcf9d5860c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f380bfff640 1 -- 172.21.15.17:0/3903881550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c005220 con 0x55f31f0c8dc0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f38262e8640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 0x7f380c0a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3818005e30 tx=0x7f3818005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f380bfff640 1 -- 172.21.15.17:0/3903881550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c004c80 con 0x55f31f0c8dc0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.317+0000 7f380bfff640 1 -- 172.21.15.17:0/3903881550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c018820 con 0x55f31f0c8dc0 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- 172.21.15.17:0/3903881550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 msgr2=0x55f31f0d3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f381c00abe0 tx=0x7f381c00f790 comp rx=0 tx=0).stop 2024-09-10T11:42:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- 172.21.15.17:0/3903881550 shutdown_connections 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d3140 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 --2- 172.21.15.17:0/3903881550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c84a0 0x55f31f0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- 172.21.15.17:0/3903881550 >> 172.21.15.17:0/3903881550 conn(0x55f31f0c4a30 msgr2=0x55f31f0c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- 172.21.15.17:0/3903881550 shutdown_connections 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- 172.21.15.17:0/3903881550 wait complete. 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.318+0000 7f382a124740 1 -- start start 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 Processor -- start 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 0x55f31f0d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f31f0d6250 con 0x55f31f0d3680 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f31efe9050 con 0x55f31f0c8dc0 2024-09-10T11:42:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f31f0d63d0 con 0x55f31f0c84a0 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f382a124740 10 client.0 _ll_register_callbacks cb 0x55f31f029160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f38262e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f38262e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41774/0 (socket says 172.21.15.17:41774) 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f38262e8640 1 -- 172.21.15.17:0/283853867 learned_addr learned my addr 172.21.15.17:0/283853867 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f38252e6640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.319+0000 7f3825ae7640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 0x55f31f0d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 -- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 msgr2=0x55f31f0d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 0x55f31f0d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 -- 172.21.15.17:0/283853867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 msgr2=0x55f31f0d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 -- 172.21.15.17:0/283853867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31ed9f3c0 con 0x55f31f0d3680 2024-09-10T11:42:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f3825ae7640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 0x55f31f0d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38262e8640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3820076600 tx=0x7f38180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975213f03df03bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38097fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381804d030 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f381c004c80 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f38180043d0 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3818034040 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f382a124740 10 client.15306 fetch_fsmap learned FSMap version 28 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f31f0e1b70 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.320+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c004c80 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3818048040 con 0x55f31f0d3680 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:42:38.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 20 client.15306 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f0e3030 0x55f31f0e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 4 client.15306 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f31f03b850 con 0x55f31f0e3030 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f3825ae7640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f0e3030 0x55f31f0e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f3825ae7640 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f0e3030 0x55f31f0e54d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b214e5e62e2194 server_cookie=7ad0f394ed0d6e4b in_seq=0 out_seq=0 2024-09-10T11:42:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.321+0000 7f38097fa640 10 client.15306 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f38097fa640 1 -- 172.21.15.17:0/283853867 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f31f03b850 con 0x55f31f0e3030 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f38097fa640 10 client.15306 handle_command_reply: tid=0 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 client.15306 shutdown 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 msgr2=0x55f31f0d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3820076600 tx=0x7f38180095c0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 shutdown_connections 2024-09-10T11:42:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f0e3030 0x55f31f0e54d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0d3680 0x55f31f0d06c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 --2- 172.21.15.17:0/283853867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c84a0 0x55f31f0d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f38097fa640 0 client.15306 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 >> 172.21.15.17:0/283853867 conn(0x55f31f0c4a30 msgr2=0x55f31f0c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 shutdown_connections 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.322+0000 7f382a124740 1 -- 172.21.15.17:0/283853867 wait complete. 2024-09-10T11:42:38.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.323+0000 7f382a124740 20 client.15306 trim_cache size 0 max 16384 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 Processor -- start 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 -- start start 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b3a70 con 0x55f31f0c84a0 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b55b0 con 0x55f31f0c8dc0 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f382a124740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b4140 con 0x55f31f0d3680 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41782/0 (socket says 172.21.15.17:41782) 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 -- 172.21.15.17:0/2259940076 learned_addr learned my addr 172.21.15.17:0/2259940076 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f38262e8640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f38252e6640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 -- 172.21.15.17:0/2259940076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 msgr2=0x55f31f0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 -- 172.21.15.17:0/2259940076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 msgr2=0x55f31f0c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f3825ae7640 1 -- 172.21.15.17:0/2259940076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f31f0d3240 con 0x55f31f0c84a0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.340+0000 7f38262e8640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f3825ae7640 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f381c00abe0 tx=0x7f381c00ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12f262f782e6d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f380b7fe640 1 -- 172.21.15.17:0/2259940076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c00a650 con 0x55f31f0c84a0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f380b7fe640 1 -- 172.21.15.17:0/2259940076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c004b40 con 0x55f31f0c84a0 2024-09-10T11:42:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f380b7fe640 1 -- 172.21.15.17:0/2259940076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c018660 con 0x55f31f0c84a0 2024-09-10T11:42:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 -- 172.21.15.17:0/2259940076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 msgr2=0x55f31f0df4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f381c00abe0 tx=0x7f381c00ffc0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 -- 172.21.15.17:0/2259940076 shutdown_connections 2024-09-10T11:42:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0d3680 0x55f31f0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0c8dc0 0x55f31f0c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 --2- 172.21.15.17:0/2259940076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0df4b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 -- 172.21.15.17:0/2259940076 >> 172.21.15.17:0/2259940076 conn(0x55f31f0c4a30 msgr2=0x55f31f0cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 -- 172.21.15.17:0/2259940076 shutdown_connections 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.341+0000 7f382a124740 1 -- 172.21.15.17:0/2259940076 wait complete. 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 -- start start 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 Processor -- start 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c8dc0 0x55f31f0dbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0d3680 0x55f31f0d6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b4ee0 con 0x55f31f0c84a0 2024-09-10T11:42:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b4810 con 0x55f31f0d3680 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38201b1a50 con 0x55f31f0c8dc0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f382a124740 10 client.0 _ll_register_callbacks cb 0x7f381802f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f3825ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41798/0 (socket says 172.21.15.17:41798) 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.342+0000 7f3825ae7640 1 -- 172.21.15.17:0/3627042694 learned_addr learned my addr 172.21.15.17:0/3627042694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38262e8640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0d3680 0x55f31f0d6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38252e6640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c8dc0 0x55f31f0dbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 -- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c8dc0 msgr2=0x55f31f0dbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c8dc0 0x55f31f0dbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 -- 172.21.15.17:0/3627042694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0d3680 msgr2=0x55f31f0d6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0d3680 0x55f31f0d6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 -- 172.21.15.17:0/3627042694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31f0d7760 con 0x55f31f0c84a0 2024-09-10T11:42:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f3825ae7640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f381c0058c0 tx=0x7f381c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e2c961029c34a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38097fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c038030 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f381c02a040 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f381c004b40 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f381c00a650 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f382a124740 10 client.15312 fetch_fsmap learned FSMap version 28 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.343+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f31f14da50 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c004b40 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f381c018a80 con 0x55f31f0c84a0 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 10 client.15312 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 20 client.15312 populate_metadata read hostname 'smithi017' 2024-09-10T11:42:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f14df10 0x55f31f150300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 4 client.15312 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f31f035d60 con 0x55f31f14df10 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.344+0000 7f38252e6640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f14df10 0x55f31f150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f38252e6640 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f14df10 0x55f31f150300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b95120a7152bb08d server_cookie=8ce1b8aebac309fe in_seq=0 out_seq=0 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f38097fa640 10 client.15312 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f38097fa640 1 -- 172.21.15.17:0/3627042694 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f31f035d60 con 0x55f31f14df10 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f38097fa640 10 client.15312 handle_command_reply: tid=0 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 client.15312 shutdown 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 msgr2=0x55f31f0db9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f381c0058c0 tx=0x7f381c00fc90 comp rx=0 tx=0).stop 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 shutdown_connections 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f31f14df10 0x55f31f150300 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f31f0c8dc0 0x55f31f0dbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f31f0d3680 0x55f31f0d6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 --2- 172.21.15.17:0/3627042694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f31f0c84a0 0x55f31f0db9e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f38097fa640 0 client.15312 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 >> 172.21.15.17:0/3627042694 conn(0x55f31f0c4a30 msgr2=0x55f31f0cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 shutdown_connections 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 1 -- 172.21.15.17:0/3627042694 wait complete. 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.345+0000 7f382a124740 20 client.15312 trim_cache size 0 max 16384 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:42:38.352 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "6a6aede5-62b0-43f7-9fcd-75f00f6bb832": { 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "6a6aede5-62b0-43f7-9fcd-75f00f6bb832", 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:42:38.353 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 msgr2=0x7f380c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 0x7f380c0a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3818005e30 tx=0x7f3818005c50 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 msgr2=0x7f38201a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f381000d950 tx=0x7f381000de10 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 shutdown_connections 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f380c0a2c00 0x7f380c0a50c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3820112b90 0x7f382019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820074eb0 0x7f38201a4bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 --2- 172.21.15.17:0/952110576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820074590 0x7f38201a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 >> 172.21.15.17:0/952110576 conn(0x7f38200fd8c0 msgr2=0x7f38200fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 shutdown_connections 2024-09-10T11:42:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:42:38.346+0000 7f3827d4b640 1 -- 172.21.15.17:0/952110576 wait complete. 2024-09-10T11:42:38.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:38 smithi017 ceph-mon[30817]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-10T11:42:38.952 INFO:tasks.cephfs.filesystem:scrub status for tag:6a6aede5-62b0-43f7-9fcd-75f00f6bb832 - {'path': '/', 'tag': '6a6aede5-62b0-43f7-9fcd-75f00f6bb832', 'options': 'recursive,force'} 2024-09-10T11:42:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:38 smithi081 ceph-mon[35059]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-10T11:42:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:38 smithi026 ceph-mon[34817]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-10T11:42:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:40 smithi081 ceph-mon[35059]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T11:42:41.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:40 smithi026 ceph-mon[34817]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T11:42:41.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:40 smithi017 ceph-mon[30817]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T11:42:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:42 smithi081 ceph-mon[35059]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:42:43.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:42 smithi026 ceph-mon[34817]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:42:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:42 smithi017 ceph-mon[30817]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T11:42:44.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:44 smithi081 ceph-mon[35059]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T11:42:44.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:44 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:42:45.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:44 smithi026 ceph-mon[34817]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T11:42:45.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:44 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:42:45.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:44 smithi017 ceph-mon[30817]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-10T11:42:45.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:44 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:42:47.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:42:47.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:46 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T11:42:47.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:42:47.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:46 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:42:47.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:46 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:42:49.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:48 smithi081 ceph-mon[35059]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:49.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:48 smithi026 ceph-mon[34817]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:49.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:48 smithi017 ceph-mon[30817]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-10T11:42:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:50 smithi081 ceph-mon[35059]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:42:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:50 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:42:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:50 smithi026 ceph-mon[34817]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:42:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:50 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:42:51.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:50 smithi017 ceph-mon[30817]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:42:51.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:50 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:42:53.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:52 smithi081 ceph-mon[35059]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T11:42:53.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:52 smithi026 ceph-mon[34817]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T11:42:53.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:52 smithi017 ceph-mon[30817]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T11:42:55.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:55 smithi081 ceph-mon[35059]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-10T11:42:55.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:55 smithi026 ceph-mon[34817]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-10T11:42:55.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:55 smithi017 ceph-mon[30817]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-10T11:42:57.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:57 smithi081 ceph-mon[35059]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:57.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:57 smithi026 ceph-mon[34817]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:57.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:57 smithi017 ceph-mon[30817]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:42:59.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:42:59 smithi026 ceph-mon[34817]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:59.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:42:59 smithi017 ceph-mon[30817]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:42:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:42:59 smithi081 ceph-mon[35059]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:43:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:01 smithi026 ceph-mon[34817]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:01 smithi017 ceph-mon[30817]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:01.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:01 smithi081 ceph-mon[35059]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:03.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:03 smithi026 ceph-mon[34817]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:43:03.505 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:03 smithi081 ceph-mon[35059]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:43:03.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:03 smithi017 ceph-mon[30817]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:43:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:05 smithi026 ceph-mon[34817]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:43:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:05 smithi017 ceph-mon[30817]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:43:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:05 smithi081 ceph-mon[35059]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T11:43:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:07 smithi026 ceph-mon[34817]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:07 smithi017 ceph-mon[30817]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:07.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:07 smithi081 ceph-mon[35059]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:08.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:43:09.254 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:09.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:09 smithi017 ceph-mon[30817]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:43:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:09 smithi026 ceph-mon[34817]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:43:09.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:09 smithi081 ceph-mon[35059]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.780+0000 7f25cb06f640 1 -- 172.21.15.17:0/3512747652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 msgr2=0x7f25c4103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.780+0000 7f25cb06f640 1 --2- 172.21.15.17:0/3512747652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4103100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009900 tx=0x7f25b802a480 comp rx=0 tx=0).stop 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 -- 172.21.15.17:0/3512747652 shutdown_connections 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 --2- 172.21.15.17:0/3512747652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c410c150 0x7f25c410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 --2- 172.21.15.17:0/3512747652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25c4103640 0x7f25c410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 --2- 172.21.15.17:0/3512747652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4103100 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 -- 172.21.15.17:0/3512747652 >> 172.21.15.17:0/3512747652 conn(0x7f25c40fc780 msgr2=0x7f25c40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 -- 172.21.15.17:0/3512747652 shutdown_connections 2024-09-10T11:43:09.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 -- 172.21.15.17:0/3512747652 wait complete. 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 Processor -- start 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.781+0000 7f25cb06f640 1 -- start start 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c4103640 0x7f25c4100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25c410c150 0x7f25c4101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25c4111f50 con 0x7f25c4102d20 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25c4111dd0 con 0x7f25c410c150 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25cb06f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41120d0 con 0x7f25c4103640 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37328/0 (socket says 172.21.15.17:37328) 2024-09-10T11:43:09.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 -- 172.21.15.17:0/1767922865 learned_addr learned my addr 172.21.15.17:0/1767922865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c4103640 0x7f25c4100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 -- 172.21.15.17:0/1767922865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c4103640 msgr2=0x7f25c4100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c4103640 0x7f25c4100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 -- 172.21.15.17:0/1767922865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25c410c150 msgr2=0x7f25c4101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25c410c150 0x7f25c4101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.782+0000 7f25c8e0b640 1 -- 172.21.15.17:0/1767922865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c41a6950 con 0x7f25c4102d20 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006010 tx=0x7f25b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25c1ffb640 1 -- 172.21.15.17:0/1767922865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b803f030 con 0x7f25c4102d20 2024-09-10T11:43:09.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25c1ffb640 1 -- 172.21.15.17:0/1767922865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b8003ce0 con 0x7f25c4102d20 2024-09-10T11:43:09.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c41a6be0 con 0x7f25c4102d20 2024-09-10T11:43:09.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25c1ffb640 1 -- 172.21.15.17:0/1767922865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8035070 con 0x7f25c4102d20 2024-09-10T11:43:09.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.783+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c41a7110 con 0x7f25c4102d20 2024-09-10T11:43:09.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.786+0000 7f25c1ffb640 1 -- 172.21.15.17:0/1767922865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25b8042030 con 0x7f25c4102d20 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25c1ffb640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 0x7f25b40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 Processor -- start 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 -- start start 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25c1ffb640 1 -- 172.21.15.17:0/1767922865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f25b80ef570 con 0x7f25c4102d20 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 0x7f25b40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9eb2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9ebd680 0x5606c9ebfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5606c9e182e0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5606c9dbfce0 con 0x5606c9eb24a0 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25cd448740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606c9e142a0 con 0x5606c9ebd680 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.787+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37344/0 (socket says 172.21.15.17:37344) 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c3fff640 1 -- 172.21.15.17:0/3668789641 learned_addr learned my addr 172.21.15.17:0/3668789641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9eb2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c960c640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9ebd680 0x5606c9ebfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 -- 172.21.15.17:0/3668789641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9ebd680 msgr2=0x5606c9ebfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9ebd680 0x5606c9ebfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 -- 172.21.15.17:0/3668789641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 msgr2=0x5606c9ebd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 -- 172.21.15.17:0/3668789641 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c9da4440 con 0x5606c9eb24a0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c3fff640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9eb2880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ed3f0 tx=0x7f25b8031a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a3c6c6c412c89e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 0x7f25b40a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25b0013570 tx=0x7f25b0013970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.788+0000 7f25aeffd640 1 -- 172.21.15.17:0/3668789641 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b80d9070 con 0x5606c9eb24a0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25aeffd640 1 -- 172.21.15.17:0/3668789641 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b80bc5a0 con 0x5606c9eb24a0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25aeffd640 1 -- 172.21.15.17:0/3668789641 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8049040 con 0x5606c9eb24a0 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 -- 172.21.15.17:0/3668789641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 msgr2=0x5606c9eb2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9eb2880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ed3f0 tx=0x7f25b8031a60 comp rx=0 tx=0).stop 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 -- 172.21.15.17:0/3668789641 shutdown_connections 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9ebd680 0x5606c9ebfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ebd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 --2- 172.21.15.17:0/3668789641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9eb2880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 -- 172.21.15.17:0/3668789641 >> 172.21.15.17:0/3668789641 conn(0x5606c9eaea30 msgr2=0x5606c9eaee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.789+0000 7f25cd448740 1 -- 172.21.15.17:0/3668789641 shutdown_connections 2024-09-10T11:43:09.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 -- 172.21.15.17:0/3668789641 wait complete. 2024-09-10T11:43:09.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 -- start start 2024-09-10T11:43:09.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 Processor -- start 2024-09-10T11:43:09.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9ebd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9eba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.790+0000 7f25cd448740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25cd448740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5606c9ec0010 con 0x5606c9ebd680 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25cd448740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5606c9dd3050 con 0x5606c9eb24a0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25cd448740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606c9ec0190 con 0x5606c9eb2dc0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37360/0 (socket says 172.21.15.17:37360) 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 -- 172.21.15.17:0/900924054 learned_addr learned my addr 172.21.15.17:0/900924054 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9ebd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c3fff640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9eba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25cd448740 10 client.0 _ll_register_callbacks cb 0x5606c9e13160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 -- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 msgr2=0x5606c9eba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9eba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 -- 172.21.15.17:0/900924054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 msgr2=0x5606c9ebd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9ebd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 -- 172.21.15.17:0/900924054 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c9b893c0 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b80bc5a0 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25c960c640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25bc010650 tx=0x7f25bc010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78cdfe88550725b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.791+0000 7f25a3fff640 10 client.15324 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25a3fff640 1 -- 172.21.15.17:0/900924054 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc004d20 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25a3fff640 1 -- 172.21.15.17:0/900924054 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f25bc003970 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25a3fff640 1 -- 172.21.15.17:0/900924054 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25bc003bb0 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 10 client.15324 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5606c9ecb9f0 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25a3fff640 1 -- 172.21.15.17:0/900924054 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25bc024020 con 0x5606c9ebd680 2024-09-10T11:43:09.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 10 client.15324 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 10 client.15324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 20 client.15324 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9ecf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 4 client.15324 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.792+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606c9e25850 con 0x5606c9eccdf0 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.793+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9ecf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.793+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9ecf230 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acbbc1f9828b7cfe server_cookie=851e9a5823d5f987 in_seq=0 out_seq=0 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.793+0000 7f25a3fff640 10 client.15324 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25a3fff640 1 -- 172.21.15.17:0/900924054 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606c9e25850 con 0x5606c9eccdf0 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25a3fff640 10 client.15324 handle_command_reply: tid=0 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 client.15324 shutdown 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 msgr2=0x5606c9eba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25bc010650 tx=0x7f25bc010b10 comp rx=0 tx=0).stop 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 shutdown_connections 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9ecf230 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9eba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25a3fff640 0 client.15324 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9ebd680 0x5606c9eba920 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 --2- 172.21.15.17:0/900924054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9eb24a0 0x5606c9ebd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.794+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 >> 172.21.15.17:0/900924054 conn(0x5606c9eaea30 msgr2=0x5606c9eb4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.795+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 shutdown_connections 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.795+0000 7f25cd448740 1 -- 172.21.15.17:0/900924054 wait complete. 2024-09-10T11:43:09.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.795+0000 7f25cd448740 20 client.15324 trim_cache size 0 max 16384 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.828+0000 7f25cd448740 1 Processor -- start 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.828+0000 7f25cd448740 1 -- start start 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 0x5606c9eba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ed5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41af6f0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41b1230 con 0x5606c9ebd680 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25cd448740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41afdc0 con 0x5606c9eb24a0 2024-09-10T11:43:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37366/0 (socket says 172.21.15.17:37366) 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 -- 172.21.15.17:0/682682705 learned_addr learned my addr 172.21.15.17:0/682682705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 0x5606c9eba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c960c640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ed5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 -- 172.21.15.17:0/682682705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 msgr2=0x5606c9eba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 0x5606c9eba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 -- 172.21.15.17:0/682682705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 msgr2=0x5606c9ed5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ed5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c3fff640 1 -- 172.21.15.17:0/682682705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c9eaf6c0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.829+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 0x5606c9eba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.830+0000 7f25c3fff640 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009b60 tx=0x7f25b001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cc884c02e07bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.830+0000 7f25ae7fc640 1 -- 172.21.15.17:0/682682705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0003b40 con 0x5606c9eb2dc0 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.830+0000 7f25ae7fc640 1 -- 172.21.15.17:0/682682705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b0003ce0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.830+0000 7f25ae7fc640 1 -- 172.21.15.17:0/682682705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b00107b0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- 172.21.15.17:0/682682705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 msgr2=0x5606c9ed4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009b60 tx=0x7f25b001f000 comp rx=0 tx=0).stop 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- 172.21.15.17:0/682682705 shutdown_connections 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ed5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb2dc0 0x5606c9ed4b00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 --2- 172.21.15.17:0/682682705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb24a0 0x5606c9eba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- 172.21.15.17:0/682682705 >> 172.21.15.17:0/682682705 conn(0x5606c9eaea30 msgr2=0x5606c9ebc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- 172.21.15.17:0/682682705 shutdown_connections 2024-09-10T11:43:09.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- 172.21.15.17:0/682682705 wait complete. 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.831+0000 7f25cd448740 1 -- start start 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25cd448740 1 Processor -- start 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25cd448740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25cd448740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9ec2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25c8e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25c8e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37382/0 (socket says 172.21.15.17:37382) 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25cd448740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ec3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25c8e0b640 1 -- 172.21.15.17:0/1529971727 learned_addr learned my addr 172.21.15.17:0/1529971727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:09.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.832+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9ec2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41b0b60 con 0x5606c9eb24a0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41b0490 con 0x5606c9ebd680 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25c41ad6d0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c960c640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ec3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 -- 172.21.15.17:0/1529971727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 msgr2=0x5606c9ec3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ec3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 -- 172.21.15.17:0/1529971727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 msgr2=0x5606c9ec5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c9f36ae0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:43:09.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25cd448740 10 client.0 _ll_register_callbacks cb 0x7f25bc009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25c3fff640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9ec2e90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5606c9eb9b60 tx=0x7f25b000fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d9546f3f087f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b0003ce0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.833+0000 7f25a3fff640 1 -- 172.21.15.17:0/1529971727 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0038050 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25a3fff640 1 -- 172.21.15.17:0/1529971727 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f25b000f7d0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25a3fff640 1 -- 172.21.15.17:0/1529971727 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25b0003b40 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 10 client.25021 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5606c9f379b0 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25a3fff640 1 -- 172.21.15.17:0/1529971727 <== mon.1 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25b001f070 con 0x5606c9eb2dc0 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 10 client.25021 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 10 client.25021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 20 client.25021 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9f3a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 4 client.25021 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:43:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.834+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f25b0003ce0 con 0x5606c9eccdf0 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9f3a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25a3fff640 10 client.25021 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25c8e0b640 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9f3a200 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3110f315de512b server_cookie=72a4cad4f76f5e69 in_seq=0 out_seq=0 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25a3fff640 1 -- 172.21.15.17:0/1529971727 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f25b0003ce0 con 0x5606c9eccdf0 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25a3fff640 10 client.25021 handle_command_reply: tid=0 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25cd448740 1 client.25021 shutdown 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 msgr2=0x5606c9ec2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.835+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9ec2e90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5606c9eb9b60 tx=0x7f25b000fec0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 shutdown_connections 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5606c9eccdf0 0x5606c9f3a200 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5606c9eb2dc0 0x5606c9ec2e90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25a3fff640 0 client.25021 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5606c9ebd680 0x5606c9ec3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 --2- 172.21.15.17:0/1529971727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606c9eb24a0 0x5606c9ec5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 >> 172.21.15.17:0/1529971727 conn(0x5606c9eaea30 msgr2=0x5606c9eba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 shutdown_connections 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 1 -- 172.21.15.17:0/1529971727 wait complete. 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.836+0000 7f25cd448740 20 client.25021 trim_cache size 0 max 16384 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:43:09.843 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 msgr2=0x7f25b40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 0x7f25b40a50c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25b0013570 tx=0x7f25b0013970 comp rx=0 tx=0).stop 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 msgr2=0x7f25c4100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f25b8006010 tx=0x7f25b80042f0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 shutdown_connections 2024-09-10T11:43:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25b40a2c00 0x7f25b40a50c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c4103640 0x7f25c4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25c410c150 0x7f25c4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 --2- 172.21.15.17:0/1767922865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c4102d20 0x7f25c4100980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 >> 172.21.15.17:0/1767922865 conn(0x7f25c40fc780 msgr2=0x7f25c40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 shutdown_connections 2024-09-10T11:43:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:09.837+0000 7f25cb06f640 1 -- 172.21.15.17:0/1767922865 wait complete. 2024-09-10T11:43:10.580 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:43:10.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:43:10.931 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:11.409 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:11 smithi017 ceph-mon[30817]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:11.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:11 smithi026 ceph-mon[34817]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:11.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.518+0000 7f7799055640 1 -- 172.21.15.17:0/1798923065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c02c040 con 0x7f7794102ef0 2024-09-10T11:43:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.518+0000 7f779c2bb640 1 -- 172.21.15.17:0/1798923065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102ef0 msgr2=0x7f779410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.518+0000 7f779c2bb640 1 --2- 172.21.15.17:0/1798923065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102ef0 0x7f779410da40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f778c009ca0 tx=0x7f778c02a950 comp rx=0 tx=0).stop 2024-09-10T11:43:11.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 -- 172.21.15.17:0/1798923065 shutdown_connections 2024-09-10T11:43:11.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 --2- 172.21.15.17:0/1798923065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794102570 0x7f77941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 --2- 172.21.15.17:0/1798923065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102ef0 0x7f779410da40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 --2- 172.21.15.17:0/1798923065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794100e20 0x7f7794101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 -- 172.21.15.17:0/1798923065 >> 172.21.15.17:0/1798923065 conn(0x7f77940fc7d0 msgr2=0x7f77940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 -- 172.21.15.17:0/1798923065 shutdown_connections 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.519+0000 7f779c2bb640 1 -- 172.21.15.17:0/1798923065 wait complete. 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 Processor -- start 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 -- start start 2024-09-10T11:43:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794100e20 0x7f77941962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102570 0x7f7794196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f779410fe70 con 0x7f7794102570 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f779410fcf0 con 0x7f7794102ef0 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779c2bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f779410fff0 con 0x7f7794100e20 2024-09-10T11:43:11.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.520+0000 7f779a858640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45432/0 (socket says 172.21.15.17:45432) 2024-09-10T11:43:11.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 -- 172.21.15.17:0/3998994635 learned_addr learned my addr 172.21.15.17:0/3998994635 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:11.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a057640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794100e20 0x7f77941962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 -- 172.21.15.17:0/3998994635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794100e20 msgr2=0x7f77941962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794100e20 0x7f77941962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 -- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102570 msgr2=0x7f7794196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102570 0x7f7794196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 -- 172.21.15.17:0/3998994635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779419b2a0 con 0x7f7794102ef0 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779a858640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f778c004af0 tx=0x7f778c02f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c034040 con 0x7f7794102ef0 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.521+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779419b530 con 0x7f7794102ef0 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.522+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941a7280 con 0x7f7794102ef0 2024-09-10T11:43:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.522+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c030920 con 0x7f7794102ef0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.522+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c004630 con 0x7f7794102ef0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.524+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7778005290 con 0x7f7794102ef0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.524+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f778c037020 con 0x7f7794102ef0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.525+0000 7f778b7fe640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 0x7f77800a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.525+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f778c0efce0 con 0x7f7794102ef0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.525+0000 7f779a057640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 0x7f77800a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.526+0000 7f779a057640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 0x7f77800a5140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7790009b60 tx=0x7f7790005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:11.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.530+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f778c0bcbf0 con 0x7f7794102ef0 2024-09-10T11:43:11.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:11 smithi081 ceph-mon[35059]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.745+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7778005580 con 0x7f7794102ef0 2024-09-10T11:43:11.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.745+0000 7f778b7fe640 1 -- 172.21.15.17:0/3998994635 <== mon.2 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7f778c0bc4f0 con 0x7f7794102ef0 2024-09-10T11:43:11.748 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:43:11.748 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-10T11:42:28:538585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:42:28.100418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:43:11.748 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 msgr2=0x7f77800a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 0x7f77800a5140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7790009b60 tx=0x7f7790005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 msgr2=0x7f779419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f778c004af0 tx=0x7f778c02f3a0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 shutdown_connections 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f77800a2c80 0x7f77800a5140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794102ef0 0x7f779419abc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794102570 0x7f7794196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 --2- 172.21.15.17:0/3998994635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7794100e20 0x7f77941962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.748+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 >> 172.21.15.17:0/3998994635 conn(0x7f77940fc7d0 msgr2=0x7f7794105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:11.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.749+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 shutdown_connections 2024-09-10T11:43:11.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:11.749+0000 7f779c2bb640 1 -- 172.21.15.17:0/3998994635 wait complete. 2024-09-10T11:43:12.372 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:12 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3998994635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:43:12.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:43:12.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:12 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3998994635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:43:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:12.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:12 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3998994635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:43:13.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 -- 172.21.15.17:0/3352494119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 msgr2=0x7fee081095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 --2- 172.21.15.17:0/3352494119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081095d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009900 tx=0x7fedf802a480 comp rx=0 tx=0).stop 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 -- 172.21.15.17:0/3352494119 shutdown_connections 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 --2- 172.21.15.17:0/3352494119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee08116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 --2- 172.21.15.17:0/3352494119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee08114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 --2- 172.21.15.17:0/3352494119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081095d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 -- 172.21.15.17:0/3352494119 >> 172.21.15.17:0/3352494119 conn(0x7fee0806e140 msgr2=0x7fee0806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 -- 172.21.15.17:0/3352494119 shutdown_connections 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.219+0000 7fee0df01640 1 -- 172.21.15.17:0/3352494119 wait complete. 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.220+0000 7fee0df01640 1 Processor -- start 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.220+0000 7fee0df01640 1 -- start start 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee081a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee081a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee0811a7f0 con 0x7fee081091f0 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fee0811a670 con 0x7fee08109b10 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee0df01640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee0811a970 con 0x7fee08114ab0 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34374/0 (socket says 172.21.15.17:34374) 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee077fe640 1 -- 172.21.15.17:0/1454132257 learned_addr learned my addr 172.21.15.17:0/1454132257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee081a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee07fff640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee081a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.221+0000 7fee077fe640 1 -- 172.21.15.17:0/1454132257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 msgr2=0x7fee081a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee077fe640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee081a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee077fe640 1 -- 172.21.15.17:0/1454132257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 msgr2=0x7fee081a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee077fe640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee081a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee077fe640 1 -- 172.21.15.17:0/1454132257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee081a1170 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee081a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee07fff640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee081a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee077fe640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fedf8004770 tx=0x7fedf8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee04ff9640 1 -- 172.21.15.17:0/1454132257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf803f070 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee081a1400 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee081ad750 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee04ff9640 1 -- 172.21.15.17:0/1454132257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf8031ca0 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.222+0000 7fee04ff9640 1 -- 172.21.15.17:0/1454132257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8035030 con 0x7fee081091f0 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 Processor -- start 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 -- start start 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658c120 0x55917658c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 0x5591765a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5591764f22f0 con 0x55917658cb80 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559176499cf0 con 0x55917658d840 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.226+0000 7fee102da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5591764ee2b0 con 0x55917658c120 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45462/0 (socket says 172.21.15.17:45462) 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 -- 172.21.15.17:0/112712221 learned_addr learned my addr 172.21.15.17:0/112712221 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee077fe640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658c120 0x55917658c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee06ffd640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 0x5591765a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 -- 172.21.15.17:0/112712221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658c120 msgr2=0x55917658c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658c120 0x55917658c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 -- 172.21.15.17:0/112712221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 msgr2=0x5591765a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 0x5591765a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 -- 172.21.15.17:0/112712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55917647e3a0 con 0x55917658d840 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee06ffd640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 0x5591765a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.227+0000 7fee07fff640 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee00009ee0 tx=0x7fee0000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1bb87a3b6a092d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fededffb640 1 -- 172.21.15.17:0/112712221 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee00003b70 con 0x55917658d840 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fededffb640 1 -- 172.21.15.17:0/112712221 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee00003d10 con 0x55917658d840 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fededffb640 1 -- 172.21.15.17:0/112712221 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee00011a30 con 0x55917658d840 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fee04ff9640 1 -- 172.21.15.17:0/1454132257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fedf8042070 con 0x7fee081091f0 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fee102da740 1 -- 172.21.15.17:0/112712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 msgr2=0x55917658dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.228+0000 7fee102da740 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee00009ee0 tx=0x7fee0000f730 comp rx=0 tx=0).stop 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee102da740 1 -- 172.21.15.17:0/112712221 shutdown_connections 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee102da740 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658c120 0x55917658c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee102da740 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658cb80 0x5591765a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee102da740 1 --2- 172.21.15.17:0/112712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917658dc20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee102da740 1 -- 172.21.15.17:0/112712221 >> 172.21.15.17:0/112712221 conn(0x559176555310 msgr2=0x559176588c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee04ff9640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 0x7fedf00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.229+0000 7fee04ff9640 1 -- 172.21.15.17:0/1454132257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fedf80f6610 con 0x7fee081091f0 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee102da740 1 -- 172.21.15.17:0/112712221 shutdown_connections 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee102da740 1 -- 172.21.15.17:0/112712221 wait complete. 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 0x7fedf00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee102da740 1 -- start start 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee102da740 1 Processor -- start 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.230+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 0x7fedf00a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005fd0 tx=0x7fedfc005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917659efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917659f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5591765a2930 con 0x55917658c120 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5591764ad060 con 0x55917658d840 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5591765a2ab0 con 0x55917658cb80 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34394/0 (socket says 172.21.15.17:34394) 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee077fe640 1 -- 172.21.15.17:0/3286489350 learned_addr learned my addr 172.21.15.17:0/3286489350 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee102da740 10 client.0 _ll_register_callbacks cb 0x5591762008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917659efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.231+0000 7fee07fff640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917659f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 -- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 msgr2=0x55917659f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917659f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 -- 172.21.15.17:0/3286489350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 msgr2=0x5591765a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 -- 172.21.15.17:0/3286489350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591762633c0 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee07fff640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917659f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917659efd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee081a2230 tx=0x7fedfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89288217604c8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fede6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc01acd0 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee00003d10 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.232+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fedfc025480 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedfc025680 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fee102da740 10 client.25036 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591765ae360 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee00003d10 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedfc01c7c0 con 0x55917658cb80 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fee102da740 10 client.25036 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fee102da740 10 client.25036 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:43:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.233+0000 7fee102da740 20 client.25036 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x5591765b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fee102da740 4 client.25036 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591764ff860 con 0x5591765af810 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fee077fe640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x5591765b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fee077fe640 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x5591765b1c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4013ca89265deeed server_cookie=50073d38d66d362a in_seq=0 out_seq=0 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.234+0000 7fede6ffd640 10 client.25036 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.235+0000 7fede6ffd640 1 -- 172.21.15.17:0/3286489350 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591764ff860 con 0x5591765af810 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.235+0000 7fede6ffd640 10 client.25036 handle_command_reply: tid=0 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.235+0000 7fee102da740 1 client.25036 shutdown 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 msgr2=0x55917659efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917659efd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee081a2230 tx=0x7fedfc0046c0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 shutdown_connections 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x5591765b1c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fede6ffd640 0 client.25036 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917659efd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x55917659f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 --2- 172.21.15.17:0/3286489350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 >> 172.21.15.17:0/3286489350 conn(0x559176555310 msgr2=0x55917658e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 shutdown_connections 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 1 -- 172.21.15.17:0/3286489350 wait complete. 2024-09-10T11:43:13.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.236+0000 7fee102da740 20 client.25036 trim_cache size 0 max 16384 2024-09-10T11:43:13.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.262+0000 7fee102da740 1 Processor -- start 2024-09-10T11:43:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 -- start start 2024-09-10T11:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917658ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x5591765a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400e400 con 0x55917658c120 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400ff40 con 0x55917658d840 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee102da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400ead0 con 0x55917658cb80 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34400/0 (socket says 172.21.15.17:34400) 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee077fe640 1 -- 172.21.15.17:0/1983364566 learned_addr learned my addr 172.21.15.17:0/1983364566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917658ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee07fff640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x5591765a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.263+0000 7fee077fe640 1 -- 172.21.15.17:0/1983364566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 msgr2=0x55917658ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee077fe640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917658ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee077fe640 1 -- 172.21.15.17:0/1983364566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 msgr2=0x5591765a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee077fe640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x5591765a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee077fe640 1 -- 172.21.15.17:0/1983364566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559176589960 con 0x55917658c120 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee06ffd640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917658ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee07fff640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x5591765a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7fee077fe640 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c2b20 tx=0x7fedf80f3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3a5d585ca3f4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7feded7fa640 1 -- 172.21.15.17:0/1983364566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf803b460 con 0x55917658c120 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7feded7fa640 1 -- 172.21.15.17:0/1983364566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf803aea0 con 0x55917658c120 2024-09-10T11:43:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.264+0000 7feded7fa640 1 -- 172.21.15.17:0/1983364566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf80bf400 con 0x55917658c120 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 -- 172.21.15.17:0/1983364566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 msgr2=0x5591765abc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c2b20 tx=0x7fedf80f3f90 comp rx=0 tx=0).stop 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 -- 172.21.15.17:0/1983364566 shutdown_connections 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x55917658ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658d840 0x5591765a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 --2- 172.21.15.17:0/1983364566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658c120 0x5591765abc60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.265+0000 7fee102da740 1 -- 172.21.15.17:0/1983364566 >> 172.21.15.17:0/1983364566 conn(0x559176555310 msgr2=0x5591765a0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.266+0000 7fee102da740 1 -- 172.21.15.17:0/1983364566 shutdown_connections 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.266+0000 7fee102da740 1 -- 172.21.15.17:0/1983364566 wait complete. 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.266+0000 7fee102da740 1 -- start start 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.266+0000 7fee102da740 1 Processor -- start 2024-09-10T11:43:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x5591765b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 0x5591765b7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400f870 con 0x55917658d840 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400f1a0 con 0x55917658c120 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedf400c3e0 con 0x55917658cb80 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee102da740 10 client.0 _ll_register_callbacks cb 0x7fedfc00c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45502/0 (socket says 172.21.15.17:45502) 2024-09-10T11:43:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 -- 172.21.15.17:0/3755017666 learned_addr learned my addr 172.21.15.17:0/3755017666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x5591765b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee07fff640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 0x5591765b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 -- 172.21.15.17:0/3755017666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 msgr2=0x5591765b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x5591765b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 -- 172.21.15.17:0/3755017666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 msgr2=0x5591765b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 0x5591765b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee077fe640 1 -- 172.21.15.17:0/3755017666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591765b7c90 con 0x55917658c120 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.267+0000 7fee07fff640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 0x5591765b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x5591765b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fee077fe640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedf803b750 tx=0x7fedf8076f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca739ef1b002307 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf803aea0 con 0x55917658c120 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fede6ffd640 10 client.25058 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fede6ffd640 1 -- 172.21.15.17:0/3755017666 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf80c3520 con 0x55917658c120 2024-09-10T11:43:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fede6ffd640 1 -- 172.21.15.17:0/3755017666 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fedf80bf400 con 0x55917658c120 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fede6ffd640 1 -- 172.21.15.17:0/3755017666 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedf80cba90 con 0x55917658c120 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fee102da740 10 client.25058 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.268+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55917661a490 con 0x55917658c120 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fede6ffd640 1 -- 172.21.15.17:0/3755017666 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedf80cbce0 con 0x55917658c120 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 10 client.25058 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 10 client.25058 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 20 client.25058 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x55917661ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 4 client.25058 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:43:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55917659f8a0 con 0x5591765af810 2024-09-10T11:43:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x55917661ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fede6ffd640 10 client.25058 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.269+0000 7fee06ffd640 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x55917661ca00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=69feb0ce781a7c29 server_cookie=94ebcf55b7455529 in_seq=0 out_seq=0 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fede6ffd640 1 -- 172.21.15.17:0/3755017666 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55917659f8a0 con 0x5591765af810 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fede6ffd640 10 client.25058 handle_command_reply: tid=0 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 client.25058 shutdown 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 msgr2=0x5591765a85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedf803b750 tx=0x7fedf8076f90 comp rx=0 tx=0).stop 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 shutdown_connections 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5591765af810 0x55917661ca00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55917658cb80 0x5591765b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55917658d840 0x5591765b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 --2- 172.21.15.17:0/3755017666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55917658c120 0x5591765a85f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 >> 172.21.15.17:0/3755017666 conn(0x559176555310 msgr2=0x5591765a1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fede6ffd640 0 client.25058 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:43:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 shutdown_connections 2024-09-10T11:43:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.270+0000 7fee102da740 1 -- 172.21.15.17:0/3755017666 wait complete. 2024-09-10T11:43:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee102da740 20 client.25058 trim_cache size 0 max 16384 2024-09-10T11:43:13.277 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 msgr2=0x7fedf00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 0x7fedf00a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fedfc005fd0 tx=0x7fedfc005d40 comp rx=0 tx=0).stop 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 msgr2=0x7fee081a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fedf8004770 tx=0x7fedf8003c10 comp rx=0 tx=0).stop 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 shutdown_connections 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fedf00a2c00 0x7fedf00a50c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee08114ab0 0x7fee081a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee08109b10 0x7fee081a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 --2- 172.21.15.17:0/1454132257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee081091f0 0x7fee081a6880 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.271+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 >> 172.21.15.17:0/1454132257 conn(0x7fee0806e140 msgr2=0x7fee08070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.272+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 shutdown_connections 2024-09-10T11:43:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:13.272+0000 7fee0df01640 1 -- 172.21.15.17:0/1454132257 wait complete. 2024-09-10T11:43:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:13 smithi026 ceph-mon[34817]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T11:43:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:13 smithi017 ceph-mon[30817]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T11:43:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:13 smithi081 ceph-mon[35059]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T11:43:13.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:43:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 -- 172.21.15.17:0/3711867541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 msgr2=0x7f5f70101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 --2- 172.21.15.17:0/3711867541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f70101200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009900 tx=0x7f5f6c02a480 comp rx=0 tx=0).stop 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 -- 172.21.15.17:0/3711867541 shutdown_connections 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 --2- 172.21.15.17:0/3711867541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 --2- 172.21.15.17:0/3711867541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 0x7f5f7010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 --2- 172.21.15.17:0/3711867541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f70101200 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.814+0000 7f5f77646640 1 -- 172.21.15.17:0/3711867541 >> 172.21.15.17:0/3711867541 conn(0x7f5f700fc7d0 msgr2=0x7f5f700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.815+0000 7f5f77646640 1 -- 172.21.15.17:0/3711867541 shutdown_connections 2024-09-10T11:43:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.815+0000 7f5f77646640 1 -- 172.21.15.17:0/3711867541 wait complete. 2024-09-10T11:43:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.815+0000 7f5f77646640 1 Processor -- start 2024-09-10T11:43:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 -- start start 2024-09-10T11:43:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f7019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 0x7f5f7019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7010fe30 con 0x7f5f70100e20 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7010fcb0 con 0x7f5f70102ef0 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f77646640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7010ffb0 con 0x7f5f70102570 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f753e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f753e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34426/0 (socket says 172.21.15.17:34426) 2024-09-10T11:43:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f753e2640 1 -- 172.21.15.17:0/4285893631 learned_addr learned my addr 172.21.15.17:0/4285893631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f74be1640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f7019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f75be3640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 0x7f5f7019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.816+0000 7f5f753e2640 1 -- 172.21.15.17:0/4285893631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 msgr2=0x7f5f7019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f753e2640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f7019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f753e2640 1 -- 172.21.15.17:0/4285893631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 msgr2=0x7f5f7019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f753e2640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 0x7f5f7019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f753e2640 1 -- 172.21.15.17:0/4285893631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7019f660 con 0x7f5f70100e20 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f74be1640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f7019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f753e2640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c006010 tx=0x7f5f6c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.817+0000 7f5f667fc640 1 -- 172.21.15.17:0/4285893631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c035030 con 0x7f5f70100e20 2024-09-10T11:43:14.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.818+0000 7f5f667fc640 1 -- 172.21.15.17:0/4285893631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f6c045070 con 0x7f5f70100e20 2024-09-10T11:43:14.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.818+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7019f8f0 con 0x7f5f70100e20 2024-09-10T11:43:14.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.818+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f70110840 con 0x7f5f70100e20 2024-09-10T11:43:14.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.818+0000 7f5f667fc640 1 -- 172.21.15.17:0/4285893631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c04a760 con 0x7f5f70100e20 2024-09-10T11:43:14.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.821+0000 7f5f79a1f740 1 Processor -- start 2024-09-10T11:43:14.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.821+0000 7f5f79a1f740 1 -- start start 2024-09-10T11:43:14.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572947352f0 con 0x5572947cf5d0 2024-09-10T11:43:14.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572946dccf0 con 0x5572947da370 2024-09-10T11:43:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572947312b0 con 0x5572947d0b40 2024-09-10T11:43:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f667fc640 1 -- 172.21.15.17:0/4285893631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5f6c0533f0 con 0x7f5f70100e20 2024-09-10T11:43:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f753e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51284/0 (socket says 172.21.15.17:51284) 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 -- 172.21.15.17:0/1684531282 learned_addr learned my addr 172.21.15.17:0/1684531282 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f74be1640 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 -- 172.21.15.17:0/1684531282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 msgr2=0x5572947dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 -- 172.21.15.17:0/1684531282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 msgr2=0x5572947cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.822+0000 7f5f75be3640 1 -- 172.21.15.17:0/1684531282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572946c13a0 con 0x5572947d0b40 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.823+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f68007f40 tx=0x7f5f6800f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d77b9ecc8e280b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.823+0000 7f5f667fc640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 0x7f5f5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.824+0000 7f5f5b7fe640 1 -- 172.21.15.17:0/1684531282 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68010900 con 0x5572947d0b40 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.824+0000 7f5f753e2640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 0x7f5f5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.824+0000 7f5f5b7fe640 1 -- 172.21.15.17:0/1684531282 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f680183f0 con 0x5572947d0b40 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.824+0000 7f5f5b7fe640 1 -- 172.21.15.17:0/1684531282 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f680175e0 con 0x5572947d0b40 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.824+0000 7f5f667fc640 1 -- 172.21.15.17:0/4285893631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5f6c0f7ea0 con 0x7f5f70100e20 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1684531282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 msgr2=0x5572947cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f68007f40 tx=0x7f5f6800f850 comp rx=0 tx=0).stop 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f753e2640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 0x7f5f5c0a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0f5d20 tx=0x7f5f6c0fb490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1684531282 shutdown_connections 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1684531282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947d0b40 0x5572947cf090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1684531282 >> 172.21.15.17:0/1684531282 conn(0x557294798310 msgr2=0x5572947cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1684531282 shutdown_connections 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1684531282 wait complete. 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 -- start start 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.825+0000 7f5f79a1f740 1 Processor -- start 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 0x5572947d7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947d7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572947dd070 con 0x5572947d0b40 2024-09-10T11:43:14.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572946f0060 con 0x5572947da370 2024-09-10T11:43:14.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572947dd1f0 con 0x5572947cf5d0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51290/0 (socket says 172.21.15.17:51290) 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f75be3640 1 -- 172.21.15.17:0/1256450103 learned_addr learned my addr 172.21.15.17:0/1256450103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.826+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f74be1640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 0x5572947d7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f79a1f740 10 client.0 _ll_register_callbacks cb 0x5572944438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 -- 172.21.15.17:0/1256450103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 msgr2=0x5572947d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 -- 172.21.15.17:0/1256450103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 msgr2=0x5572947d7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 0x5572947d7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 -- 172.21.15.17:0/1256450103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572944a63c0 con 0x5572947cf5d0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f680183f0 con 0x5572947cf5d0 2024-09-10T11:43:14.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f74be1640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 0x5572947d7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f75be3640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000f80 tx=0x7f5f68018e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9daa19bf9e94d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f58ff9640 10 client.25054 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f58ff9640 1 -- 172.21.15.17:0/1256450103 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6802b060 con 0x5572947cf5d0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f58ff9640 1 -- 172.21.15.17:0/1256450103 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5f68003e00 con 0x5572947cf5d0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f58ff9640 1 -- 172.21.15.17:0/1256450103 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f68004a40 con 0x5572947cf5d0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f79a1f740 10 client.25054 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.827+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5572947e8ad0 con 0x5572947cf5d0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f58ff9640 1 -- 172.21.15.17:0/1256450103 <== mon.1 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f68004be0 con 0x5572947cf5d0 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 10 client.25054 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 10 client.25054 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 20 client.25054 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x5572947ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 4 client.25054 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557294742860 con 0x5572947e9e20 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.828+0000 7f5f74be1640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x5572947ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.829+0000 7f5f74be1640 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x5572947ec210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d939de53e782af97 server_cookie=dfa3a15160dd90f in_seq=0 out_seq=0 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.829+0000 7f5f58ff9640 10 client.25054 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.829+0000 7f5f58ff9640 1 -- 172.21.15.17:0/1256450103 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557294742860 con 0x5572947e9e20 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.829+0000 7f5f58ff9640 10 client.25054 handle_command_reply: tid=0 2024-09-10T11:43:14.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.829+0000 7f5f79a1f740 1 client.25054 shutdown 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.830+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 msgr2=0x5572947d9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.830+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000f80 tx=0x7f5f68018e80 comp rx=0 tx=0).stop 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 shutdown_connections 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x5572947ec210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947da370 0x5572947d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f58ff9640 0 client.25054 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947d0b40 0x5572947d7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/1256450103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d9dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 >> 172.21.15.17:0/1256450103 conn(0x557294798310 msgr2=0x5572947d1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 shutdown_connections 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.832+0000 7f5f79a1f740 1 -- 172.21.15.17:0/1256450103 wait complete. 2024-09-10T11:43:14.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.833+0000 7f5f79a1f740 20 client.25054 trim_cache size 0 max 16384 2024-09-10T11:43:14.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.859+0000 7f5f79a1f740 1 Processor -- start 2024-09-10T11:43:14.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.859+0000 7f5f79a1f740 1 -- start start 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 0x5572947f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701ab290 con 0x5572947da370 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701acdd0 con 0x5572947d0b40 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.860+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701ab960 con 0x5572947cf5d0 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45556/0 (socket says 172.21.15.17:45556) 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 -- 172.21.15.17:0/2884595527 learned_addr learned my addr 172.21.15.17:0/2884595527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f75be3640 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 0x5572947f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 -- 172.21.15.17:0/2884595527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 msgr2=0x5572947d6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 -- 172.21.15.17:0/2884595527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 msgr2=0x5572947f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 0x5572947f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f74be1640 1 -- 172.21.15.17:0/2884595527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572947ec540 con 0x5572947d0b40 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.861+0000 7f5f75be3640 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 0x5572947f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.862+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5572947d0070 tx=0x7f5f60014900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e33ca293b6d13b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.862+0000 7f5f5affd640 1 -- 172.21.15.17:0/2884595527 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60005020 con 0x5572947d0b40 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.862+0000 7f5f5affd640 1 -- 172.21.15.17:0/2884595527 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f600047a0 con 0x5572947d0b40 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.862+0000 7f5f5affd640 1 -- 172.21.15.17:0/2884595527 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6001e700 con 0x5572947d0b40 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2884595527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 msgr2=0x5572947f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5572947d0070 tx=0x7f5f60014900 comp rx=0 tx=0).stop 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2884595527 shutdown_connections 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947da370 0x5572947f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947f1810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2884595527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947cf5d0 0x5572947d6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.863+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2884595527 >> 172.21.15.17:0/2884595527 conn(0x557294798310 msgr2=0x5572947d5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.864+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2884595527 shutdown_connections 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.864+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2884595527 wait complete. 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.864+0000 7f5f79a1f740 1 -- start start 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.864+0000 7f5f79a1f740 1 Processor -- start 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947da370 0x5572947d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701ac700 con 0x5572947cf5d0 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701ac030 con 0x5572947d0b40 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701a9310 con 0x5572947da370 2024-09-10T11:43:14.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f79a1f740 10 client.0 _ll_register_callbacks cb 0x7f5f68007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f75be3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34470/0 (socket says 172.21.15.17:34470) 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f75be3640 1 -- 172.21.15.17:0/2201457320 learned_addr learned my addr 172.21.15.17:0/2201457320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.865+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 -- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947da370 msgr2=0x5572947d4260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947da370 0x5572947d4260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 -- 172.21.15.17:0/2201457320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 msgr2=0x5572947d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 -- 172.21.15.17:0/2201457320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572947d4a40 con 0x5572947cf5d0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f75be3640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f68007cd0 tx=0x7f5f6800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ca3bee3758c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6803d060 con 0x5572947cf5d0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5f680045d0 con 0x5572947cf5d0 2024-09-10T11:43:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f600047a0 con 0x5572947cf5d0 2024-09-10T11:43:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.866+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f68007630 con 0x5572947cf5d0 2024-09-10T11:43:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.867+0000 7f5f79a1f740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.867+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557294854790 con 0x5572947cf5d0 2024-09-10T11:43:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.867+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f600047a0 con 0x5572947cf5d0 2024-09-10T11:43:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f68004fa0 con 0x5572947cf5d0 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 10 client.15363 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 20 client.15363 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x557294856eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 4 client.15363 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55729473cd70 con 0x5572947e9e20 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x557294856eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f58ff9640 10 client.15363 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.868+0000 7f5f74be1640 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x557294856eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c2021dbaa9d65ee7 server_cookie=180fe8681886c065 in_seq=0 out_seq=0 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.869+0000 7f5f58ff9640 1 -- 172.21.15.17:0/2201457320 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55729473cd70 con 0x5572947e9e20 2024-09-10T11:43:14.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.869+0000 7f5f58ff9640 10 client.15363 handle_command_reply: tid=0 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.869+0000 7f5f79a1f740 1 client.15363 shutdown 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 msgr2=0x5572947e2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f68007cd0 tx=0x7f5f6800f850 comp rx=0 tx=0).stop 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 shutdown_connections 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5572947e9e20 0x557294856eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572947da370 0x5572947d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572947d0b40 0x5572947d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 --2- 172.21.15.17:0/2201457320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572947cf5d0 0x5572947e2ba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f58ff9640 0 client.15363 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.870+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 >> 172.21.15.17:0/2201457320 conn(0x557294798310 msgr2=0x5572947d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 shutdown_connections 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f79a1f740 1 -- 172.21.15.17:0/2201457320 wait complete. 2024-09-10T11:43:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f79a1f740 20 client.15363 trim_cache size 0 max 16384 2024-09-10T11:43:14.878 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 msgr2=0x7f5f5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 0x7f5f5c0a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0f5d20 tx=0x7f5f6c0fb490 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 msgr2=0x7f5f7019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.871+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c006010 tx=0x7f5f6c003c10 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 shutdown_connections 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5f5c0a2c00 0x7f5f5c0a50c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f70102570 0x7f5f7019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f70102ef0 0x7f5f7019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 --2- 172.21.15.17:0/4285893631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f70100e20 0x7f5f7019a6b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 >> 172.21.15.17:0/4285893631 conn(0x7f5f700fc7d0 msgr2=0x7f5f700fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 shutdown_connections 2024-09-10T11:43:14.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:14.874+0000 7f5f77646640 1 -- 172.21.15.17:0/4285893631 wait complete. 2024-09-10T11:43:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:15 smithi026 ceph-mon[34817]: pgmap v356: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:15.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:15 smithi017 ceph-mon[30817]: pgmap v356: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:15.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:43:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:15 smithi081 ceph-mon[35059]: pgmap v356: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.386+0000 7f9312ffd640 1 -- 172.21.15.17:0/2999982351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304031940 con 0x7f9314100e20 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 -- 172.21.15.17:0/2999982351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9314100e20 msgr2=0x7f9314101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 --2- 172.21.15.17:0/2999982351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9314100e20 0x7f9314101200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9304009900 tx=0x7f930402a480 comp rx=0 tx=0).stop 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 -- 172.21.15.17:0/2999982351 shutdown_connections 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 --2- 172.21.15.17:0/2999982351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102570 0x7f93141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 --2- 172.21.15.17:0/2999982351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102ef0 0x7f931410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 --2- 172.21.15.17:0/2999982351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9314100e20 0x7f9314101200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 -- 172.21.15.17:0/2999982351 >> 172.21.15.17:0/2999982351 conn(0x7f93140fc7d0 msgr2=0x7f93140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 -- 172.21.15.17:0/2999982351 shutdown_connections 2024-09-10T11:43:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.387+0000 7f931a352640 1 -- 172.21.15.17:0/2999982351 wait complete. 2024-09-10T11:43:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.388+0000 7f931a352640 1 Processor -- start 2024-09-10T11:43:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 -- start start 2024-09-10T11:43:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 0x7f93141964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102ef0 0x7f93141969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f931410fe70 con 0x7f931419ad80 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f931410fcf0 con 0x7f9314102570 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f931a352640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f931410fff0 con 0x7f9314102ef0 2024-09-10T11:43:16.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f93188ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f93188ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34492/0 (socket says 172.21.15.17:34492) 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f93188ef640 1 -- 172.21.15.17:0/705005467 learned_addr learned my addr 172.21.15.17:0/705005467 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.389+0000 7f9313fff640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 0x7f93141964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f93137fe640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102ef0 0x7f93141969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 -- 172.21.15.17:0/705005467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102ef0 msgr2=0x7f93141969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102ef0 0x7f93141969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 -- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 msgr2=0x7f931419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 -- 172.21.15.17:0/705005467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931419b840 con 0x7f9314102570 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f93188ef640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f9313fff640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 0x7f93141964b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9304008000 tx=0x7f930403ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f93117fa640 1 -- 172.21.15.17:0/705005467 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304035070 con 0x7f9314102570 2024-09-10T11:43:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.390+0000 7f93117fa640 1 -- 172.21.15.17:0/705005467 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9304003ce0 con 0x7f9314102570 2024-09-10T11:43:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.391+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931419bad0 con 0x7f9314102570 2024-09-10T11:43:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.391+0000 7f93117fa640 1 -- 172.21.15.17:0/705005467 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304044420 con 0x7f9314102570 2024-09-10T11:43:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.391+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93141a3200 con 0x7f9314102570 2024-09-10T11:43:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.394+0000 7f93117fa640 1 -- 172.21.15.17:0/705005467 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93040315d0 con 0x7f9314102570 2024-09-10T11:43:16.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.394+0000 7f931c72b740 1 Processor -- start 2024-09-10T11:43:16.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.394+0000 7f931c72b740 1 -- start start 2024-09-10T11:43:16.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f93117fa640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 0x7f92fc0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f519a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f526760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f47f2f0 con 0x55ff6f51ab40 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f426cf0 con 0x55ff6f524370 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f931c72b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f47b2b0 con 0x55ff6f5195d0 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34494/0 (socket says 172.21.15.17:34494) 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 -- 172.21.15.17:0/1955853067 learned_addr learned my addr 172.21.15.17:0/1955853067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f93188ef640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 0x7f92fc0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f93188ef640 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f526760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 -- 172.21.15.17:0/1955853067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 msgr2=0x55ff6f519a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:43:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f519a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 -- 172.21.15.17:0/1955853067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 msgr2=0x55ff6f526760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f526760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.395+0000 7f9313fff640 1 -- 172.21.15.17:0/1955853067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff6f40b3a0 con 0x55ff6f51ab40 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f93117fa640 1 -- 172.21.15.17:0/705005467 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f93040f3230 con 0x7f9314102570 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f9313fff640 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f93040f0c20 tx=0x7f930409d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a1cb2be9bea6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f93188ef640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 0x7f92fc0a50b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f930c0094f0 tx=0x7f930c013680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f92fa7fc640 1 -- 172.21.15.17:0/1955853067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930409cca0 con 0x55ff6f51ab40 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f92fa7fc640 1 -- 172.21.15.17:0/1955853067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93040bfa40 con 0x55ff6f51ab40 2024-09-10T11:43:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.396+0000 7f92fa7fc640 1 -- 172.21.15.17:0/1955853067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040c3df0 con 0x55ff6f51ab40 2024-09-10T11:43:16.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 -- 172.21.15.17:0/1955853067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 msgr2=0x55ff6f519090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f93040f0c20 tx=0x7f930409d1e0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 -- 172.21.15.17:0/1955853067 shutdown_connections 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f519a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f526760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 --2- 172.21.15.17:0/1955853067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f519090 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.397+0000 7f931c72b740 1 -- 172.21.15.17:0/1955853067 >> 172.21.15.17:0/1955853067 conn(0x55ff6f4e2310 msgr2=0x55ff6f515c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.398+0000 7f931c72b740 1 -- 172.21.15.17:0/1955853067 shutdown_connections 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.398+0000 7f931c72b740 1 -- 172.21.15.17:0/1955853067 wait complete. 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.398+0000 7f931c72b740 1 -- start start 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 Processor -- start 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f523d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f521030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f526e30 con 0x55ff6f51ab40 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f43a060 con 0x55ff6f524370 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ff6f526fb0 con 0x55ff6f5195d0 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f931c72b740 10 client.0 _ll_register_callbacks cb 0x55ff6f18d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f9313fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f523d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f93188ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f93188ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45598/0 (socket says 172.21.15.17:45598) 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f93137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f521030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.399+0000 7f93188ef640 1 -- 172.21.15.17:0/1218571683 learned_addr learned my addr 172.21.15.17:0/1218571683 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 -- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 msgr2=0x55ff6f523d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f523d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 -- 172.21.15.17:0/1218571683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 msgr2=0x55ff6f521030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f521030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 -- 172.21.15.17:0/1218571683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff6f1f03c0 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93137fe640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f521030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f93188ef640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f930c013f70 tx=0x7f930c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e823a3935a554e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f92f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c02a470 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f930c02a610 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.400+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93040bfa40 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f930c02a810 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 10 client.25082 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ff6f53b0a0 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93040bfa40 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f930c00f040 con 0x55ff6f524370 2024-09-10T11:43:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 10 client.25082 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 10 client.25082 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 20 client.25082 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f53ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 4 client.25082 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.401+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff6f48c860 con 0x55ff6f53c890 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.402+0000 7f9313fff640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f53ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.402+0000 7f9313fff640 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f53ed10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7dd0df4f40a804c8 server_cookie=41c3b278a6e68a63 in_seq=0 out_seq=0 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.402+0000 7f92f37fe640 10 client.25082 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f92f37fe640 1 -- 172.21.15.17:0/1218571683 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff6f48c860 con 0x55ff6f53c890 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f92f37fe640 10 client.25082 handle_command_reply: tid=0 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 client.25082 shutdown 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 msgr2=0x55ff6f521640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f930c013f70 tx=0x7f930c01b000 comp rx=0 tx=0).stop 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 shutdown_connections 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f53ed10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f521640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f92f37fe640 0 client.25082 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f51ab40 0x55ff6f521030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.403+0000 7f931c72b740 1 --2- 172.21.15.17:0/1218571683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f5195d0 0x55ff6f523d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.404+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 >> 172.21.15.17:0/1218571683 conn(0x55ff6f4e2310 msgr2=0x55ff6f51b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.404+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 shutdown_connections 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.404+0000 7f931c72b740 1 -- 172.21.15.17:0/1218571683 wait complete. 2024-09-10T11:43:16.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.404+0000 7f931c72b740 20 client.25082 trim_cache size 0 max 16384 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.429+0000 7f931c72b740 1 Processor -- start 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.429+0000 7f931c72b740 1 -- start start 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f51ab40 0x55ff6f5445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f524370 0x55ff6f544b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93141ab740 con 0x55ff6f5195d0 2024-09-10T11:43:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f93141ad280 con 0x55ff6f51ab40 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f931c72b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93141abe10 con 0x55ff6f524370 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34500/0 (socket says 172.21.15.17:34500) 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 -- 172.21.15.17:0/1277550209 learned_addr learned my addr 172.21.15.17:0/1277550209 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 -- 172.21.15.17:0/1277550209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f524370 msgr2=0x55ff6f544b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f524370 0x55ff6f544b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 -- 172.21.15.17:0/1277550209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f51ab40 msgr2=0x55ff6f5445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f51ab40 0x55ff6f5445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 -- 172.21.15.17:0/1277550209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff6f51f580 con 0x55ff6f5195d0 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.430+0000 7f9313fff640 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9304006010 tx=0x7f9304000e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52daece6fa840b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.431+0000 7f92f9ffb640 1 -- 172.21.15.17:0/1277550209 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040bfa40 con 0x55ff6f5195d0 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.431+0000 7f92f9ffb640 1 -- 172.21.15.17:0/1277550209 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93040c86b0 con 0x55ff6f5195d0 2024-09-10T11:43:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.431+0000 7f92f9ffb640 1 -- 172.21.15.17:0/1277550209 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040bc0b0 con 0x55ff6f5195d0 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- 172.21.15.17:0/1277550209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 msgr2=0x55ff6f5388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9304006010 tx=0x7f9304000e80 comp rx=0 tx=0).stop 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- 172.21.15.17:0/1277550209 shutdown_connections 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f524370 0x55ff6f544b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f51ab40 0x55ff6f5445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 --2- 172.21.15.17:0/1277550209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f5388a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- 172.21.15.17:0/1277550209 >> 172.21.15.17:0/1277550209 conn(0x55ff6f4e2310 msgr2=0x55ff6f51f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- 172.21.15.17:0/1277550209 shutdown_connections 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- 172.21.15.17:0/1277550209 wait complete. 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.432+0000 7f931c72b740 1 -- start start 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 Processor -- start 2024-09-10T11:43:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f534e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f51ab40 0x55ff6f535340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f530380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f534e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f9313fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f534e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34508/0 (socket says 172.21.15.17:34508) 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f9313fff640 1 -- 172.21.15.17:0/5454155 learned_addr learned my addr 172.21.15.17:0/5454155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93141acbb0 con 0x55ff6f5195d0 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f93188ef640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f530380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f93137fe640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f51ab40 0x55ff6f535340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f93141ac4e0 con 0x55ff6f524370 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.433+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93141a9720 con 0x55ff6f51ab40 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f931c72b740 10 client.0 _ll_register_callbacks cb 0x7f930c0139d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 -- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f51ab40 msgr2=0x55ff6f535340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f51ab40 0x55ff6f535340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 -- 172.21.15.17:0/5454155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 msgr2=0x55ff6f534e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f534e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff6f530bb0 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f93188ef640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f530380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f930c021e00 tx=0x7f930c00ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a047a8bb00327f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f92f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.434+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c013040 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f930c0131e0 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93040c86b0 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f930c045050 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f931c72b740 10 client.25085 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ff6f5a7220 con 0x55ff6f524370 2024-09-10T11:43:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.435+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f930c039070 con 0x55ff6f524370 2024-09-10T11:43:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f930c0214c0 con 0x55ff6f524370 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 10 client.25085 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 10 client.25085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 20 client.25085 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f5a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 4 client.25085 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.436+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f93040c86b0 con 0x55ff6f53c890 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f9313fff640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f5a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f9313fff640 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f5a9890 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2379977b79e2ccf server_cookie=b20f3c44c4417ec8 in_seq=0 out_seq=0 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f92f37fe640 10 client.25085 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f92f37fe640 1 -- 172.21.15.17:0/5454155 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f93040c86b0 con 0x55ff6f53c890 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f92f37fe640 10 client.25085 handle_command_reply: tid=0 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.437+0000 7f931c72b740 1 client.25085 shutdown 2024-09-10T11:43:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.438+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 msgr2=0x55ff6f530380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.438+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f530380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f930c021e00 tx=0x7f930c00ff60 comp rx=0 tx=0).stop 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.438+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 shutdown_connections 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55ff6f53c890 0x55ff6f5a9890 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff6f51ab40 0x55ff6f535340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f92f37fe640 0 client.25085 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ff6f524370 0x55ff6f530380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 --2- 172.21.15.17:0/5454155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff6f5195d0 0x55ff6f534e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 >> 172.21.15.17:0/5454155 conn(0x55ff6f4e2310 msgr2=0x55ff6f522890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 shutdown_connections 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 1 -- 172.21.15.17:0/5454155 wait complete. 2024-09-10T11:43:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.439+0000 7f931c72b740 20 client.25085 trim_cache size 0 max 16384 2024-09-10T11:43:16.445 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:43:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 msgr2=0x7f92fc0a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 0x7f92fc0a50b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f930c0094f0 tx=0x7f930c013680 comp rx=0 tx=0).stop 2024-09-10T11:43:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 msgr2=0x7f93141964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 0x7f93141964b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9304008000 tx=0x7f930403ac10 comp rx=0 tx=0).stop 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 shutdown_connections 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f92fc0a2bf0 0x7f92fc0a50b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9314102ef0 0x7f93141969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f931419ad80 0x7f931419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 --2- 172.21.15.17:0/705005467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9314102570 0x7f93141964b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.440+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 >> 172.21.15.17:0/705005467 conn(0x7f93140fc7d0 msgr2=0x7f93140fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.441+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 shutdown_connections 2024-09-10T11:43:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:16.441+0000 7f931a352640 1 -- 172.21.15.17:0/705005467 wait complete. 2024-09-10T11:43:17.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:43:17.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:17 smithi017 ceph-mon[30817]: pgmap v357: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T11:43:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:17 smithi026 ceph-mon[34817]: pgmap v357: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T11:43:17.521 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:17 smithi081 ceph-mon[35059]: pgmap v357: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T11:43:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/3556635612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec4100e20 msgr2=0x7f2ec4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/3556635612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec4100e20 0x7f2ec4101200 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009900 tx=0x7f2ec002a480 comp rx=0 tx=0).stop 2024-09-10T11:43:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/3556635612 shutdown_connections 2024-09-10T11:43:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/3556635612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/3556635612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/3556635612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec4100e20 0x7f2ec4101200 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.060+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/3556635612 >> 172.21.15.17:0/3556635612 conn(0x7f2ec40fc7d0 msgr2=0x7f2ec40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.061+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/3556635612 shutdown_connections 2024-09-10T11:43:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.061+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/3556635612 wait complete. 2024-09-10T11:43:18.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.062+0000 7f2ecb2a0640 1 Processor -- start 2024-09-10T11:43:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.062+0000 7f2ecb2a0640 1 -- start start 2024-09-10T11:43:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec4197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 0x7f2ec419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec4110fd0 con 0x7f2ec419bea0 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec4110e50 con 0x7f2ec4102ef0 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ecb2a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec4111150 con 0x7f2ec4102570 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec903c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec4197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec903c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51368/0 (socket says 172.21.15.17:51368) 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec903c640 1 -- 172.21.15.17:0/1102019680 learned_addr learned my addr 172.21.15.17:0/1102019680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 0x7f2ec419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec883b640 1 -- 172.21.15.17:0/1102019680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 msgr2=0x7f2ec41975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec883b640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec883b640 1 -- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 msgr2=0x7f2ec419c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.063+0000 7f2ec883b640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 0x7f2ec419c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2ec883b640 1 -- 172.21.15.17:0/1102019680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec419c960 con 0x7f2ec4102ef0 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 0x7f2ec419c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2ec883b640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec4197b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e9f0 tx=0x7f2eb400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1102019680 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400ccc0 con 0x7f2ec4102ef0 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec419cc50 con 0x7f2ec4102ef0 2024-09-10T11:43:18.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.064+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1102019680 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eb4005020 con 0x7f2ec4102ef0 2024-09-10T11:43:18.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.065+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1102019680 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40049e0 con 0x7f2ec4102ef0 2024-09-10T11:43:18.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.065+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec41a4430 con 0x7f2ec4102ef0 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.068+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1102019680 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2eb4005560 con 0x7f2ec4102ef0 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.068+0000 7f2ecd679740 1 Processor -- start 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.068+0000 7f2ecd679740 1 -- start start 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba7b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba7bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba88970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55833b9df2f0 con 0x55833ba7cd50 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55833b986cf0 con 0x55833ba86580 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ecd679740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55833b9db2b0 con 0x55833ba7b7e0 2024-09-10T11:43:18.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba7b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba7b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34550/0 (socket says 172.21.15.17:34550) 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ec983d640 1 -- 172.21.15.17:0/1147665368 learned_addr learned my addr 172.21.15.17:0/1147665368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.069+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba7bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 -- 172.21.15.17:0/1147665368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 msgr2=0x55833ba88970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba88970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 -- 172.21.15.17:0/1147665368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 msgr2=0x55833ba7b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba7b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 -- 172.21.15.17:0/1147665368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833b96b3a0 con 0x55833ba7b7e0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2eba7fc640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 0x7f2eb00a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba7bc20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0004770 tx=0x7f2ec0005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fa3a179c1135a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1102019680 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2eb40cf0b0 con 0x7f2ec4102ef0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2eaf7fe640 1 -- 172.21.15.17:0/1147665368 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0035040 con 0x55833ba7b7e0 2024-09-10T11:43:18.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 0x7f2eb00a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.070+0000 7f2eaf7fe640 1 -- 172.21.15.17:0/1147665368 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec00047a0 con 0x55833ba7b7e0 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.071+0000 7f2eaf7fe640 1 -- 172.21.15.17:0/1147665368 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec003da50 con 0x55833ba7b7e0 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.071+0000 7f2ecd679740 1 -- 172.21.15.17:0/1147665368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 msgr2=0x55833ba7bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.071+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba7bc20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0004770 tx=0x7f2ec0005e30 comp rx=0 tx=0).stop 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 0x7f2eb00a4f10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005c40 tx=0x7f2ebc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 -- 172.21.15.17:0/1147665368 shutdown_connections 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba7bc20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba88970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1147665368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba7b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 -- 172.21.15.17:0/1147665368 >> 172.21.15.17:0/1147665368 conn(0x55833ba42310 msgr2=0x55833ba77e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 -- 172.21.15.17:0/1147665368 shutdown_connections 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 -- 172.21.15.17:0/1147665368 wait complete. 2024-09-10T11:43:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.072+0000 7f2ecd679740 1 -- start start 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ecd679740 1 Processor -- start 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba81650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba81b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba81b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.073+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34556/0 (socket says 172.21.15.17:34556) 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec903c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba81650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 -- 172.21.15.17:0/1296367491 learned_addr learned my addr 172.21.15.17:0/1296367491 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55833ba75880 con 0x55833ba86580 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55833b99a060 con 0x55833ba7cd50 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55833ba75a00 con 0x55833ba7b7e0 2024-09-10T11:43:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 -- 172.21.15.17:0/1296367491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 msgr2=0x55833ba81650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba81650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 -- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 msgr2=0x55833ba81b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba81b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55833b7503c0 con 0x55833ba86580 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba81650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ecd679740 10 client.0 _ll_register_callbacks cb 0x55833b6ed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec00047a0 con 0x55833ba86580 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2ec983d640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc010e90 tx=0x7f2ebc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9cdec20b581644 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.074+0000 7f2eacff9640 10 client.15393 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.075+0000 7f2eacff9640 1 -- 172.21.15.17:0/1296367491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc02c060 con 0x55833ba86580 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.075+0000 7f2eacff9640 1 -- 172.21.15.17:0/1296367491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2ebc017030 con 0x55833ba86580 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.075+0000 7f2eacff9640 1 -- 172.21.15.17:0/1296367491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc01fdc0 con 0x55833ba86580 2024-09-10T11:43:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.075+0000 7f2ecd679740 10 client.15393 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.075+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55833ba92930 con 0x55833ba86580 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2eacff9640 1 -- 172.21.15.17:0/1296367491 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ebc02f050 con 0x55833ba86580 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 10 client.15393 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 20 client.15393 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833ba96230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 4 client.15393 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55833b9ec860 con 0x55833ba93da0 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.076+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833ba96230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.077+0000 7f2ec903c640 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833ba96230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=103d763c2546ff4 server_cookie=2f8e3d12885ed2ed in_seq=0 out_seq=0 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.077+0000 7f2eacff9640 10 client.15393 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.077+0000 7f2eacff9640 1 -- 172.21.15.17:0/1296367491 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55833b9ec860 con 0x55833ba93da0 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.077+0000 7f2eacff9640 10 client.15393 handle_command_reply: tid=0 2024-09-10T11:43:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.077+0000 7f2ecd679740 1 client.15393 shutdown 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 msgr2=0x55833ba820d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc010e90 tx=0x7f2ebc004ab0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 shutdown_connections 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833ba96230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833ba820d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba81b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 --2- 172.21.15.17:0/1296367491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba81650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2eacff9640 0 client.15393 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.078+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 >> 172.21.15.17:0/1296367491 conn(0x55833ba42310 msgr2=0x55833ba7db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.079+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 shutdown_connections 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.079+0000 7f2ecd679740 1 -- 172.21.15.17:0/1296367491 wait complete. 2024-09-10T11:43:18.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.079+0000 7f2ecd679740 20 client.15393 trim_cache size 0 max 16384 2024-09-10T11:43:18.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.105+0000 7f2ecd679740 1 Processor -- start 2024-09-10T11:43:18.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.105+0000 7f2ecd679740 1 -- start start 2024-09-10T11:43:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.105+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba78020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba81d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ecd679740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41ab4f0 con 0x55833ba7cd50 2024-09-10T11:43:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ecd679740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41ad030 con 0x55833ba86580 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ecd679740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41abbc0 con 0x55833ba7b7e0 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34562/0 (socket says 172.21.15.17:34562) 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec883b640 1 -- 172.21.15.17:0/4218981850 learned_addr learned my addr 172.21.15.17:0/4218981850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba81d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 -- 172.21.15.17:0/4218981850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 msgr2=0x55833ba78020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba78020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 -- 172.21.15.17:0/4218981850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 msgr2=0x55833ba76cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec983d640 1 -- 172.21.15.17:0/4218981850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833ba75a40 con 0x55833ba86580 2024-09-10T11:43:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.106+0000 7f2ec883b640 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.107+0000 7f2ec983d640 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba81d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc010e60 tx=0x7f2ebc022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652ded0ebf96a1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.107+0000 7f2eaeffd640 1 -- 172.21.15.17:0/4218981850 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc037020 con 0x55833ba86580 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.107+0000 7f2eaeffd640 1 -- 172.21.15.17:0/4218981850 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec00047a0 con 0x55833ba86580 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.107+0000 7f2eaeffd640 1 -- 172.21.15.17:0/4218981850 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0052a0 con 0x55833ba86580 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- 172.21.15.17:0/4218981850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 msgr2=0x55833ba81d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba81d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc010e60 tx=0x7f2ebc022000 comp rx=0 tx=0).stop 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- 172.21.15.17:0/4218981850 shutdown_connections 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba86580 0x55833ba81d20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba7cd50 0x55833ba76cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 --2- 172.21.15.17:0/4218981850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba78020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- 172.21.15.17:0/4218981850 >> 172.21.15.17:0/4218981850 conn(0x55833ba42310 msgr2=0x55833ba81610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- 172.21.15.17:0/4218981850 shutdown_connections 2024-09-10T11:43:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- 172.21.15.17:0/4218981850 wait complete. 2024-09-10T11:43:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.108+0000 7f2ecd679740 1 -- start start 2024-09-10T11:43:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 Processor -- start 2024-09-10T11:43:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba8b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ec883b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45648/0 (socket says 172.21.15.17:45648) 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ec983d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34576/0 (socket says 172.21.15.17:34576) 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41ac960 con 0x55833ba86580 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ec883b640 1 -- 172.21.15.17:0/3849555148 learned_addr learned my addr 172.21.15.17:0/3849555148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec903c640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba8b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.109+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41ac290 con 0x55833ba7cd50 2024-09-10T11:43:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41a94f0 con 0x55833ba7b7e0 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 -- 172.21.15.17:0/3849555148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 msgr2=0x55833ba8b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba8b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 -- 172.21.15.17:0/3849555148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 msgr2=0x55833bb06320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55833bb068e0 con 0x55833ba7cd50 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec983d640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ecd679740 10 client.0 _ll_register_callbacks cb 0x7f2ebc010b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec00047a0 con 0x55833ba7cd50 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2ec883b640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40ccb00 tx=0x7f2eb409c080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05ea458a978314e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.110+0000 7f2eacff9640 10 client.25097 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2eacff9640 1 -- 172.21.15.17:0/3849555148 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb401c040 con 0x55833ba7cd50 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2eacff9640 1 -- 172.21.15.17:0/3849555148 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2eb4086070 con 0x55833ba7cd50 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2eacff9640 1 -- 172.21.15.17:0/3849555148 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2eb4086290 con 0x55833ba7cd50 2024-09-10T11:43:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 10 client.25097 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55833bb07960 con 0x55833ba7cd50 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2eacff9640 1 -- 172.21.15.17:0/3849555148 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2eb4004b80 con 0x55833ba7cd50 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 10 client.25097 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 10 client.25097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 20 client.25097 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833bb0a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 4 client.25097 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.111+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55833b9e6d70 con 0x55833ba93da0 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2ec903c640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833bb0a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2eacff9640 10 client.25097 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2ec903c640 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833bb0a0b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cfc53255f7d8ee8 server_cookie=3d7a4ae7d9af216c in_seq=0 out_seq=0 2024-09-10T11:43:18.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2eacff9640 1 -- 172.21.15.17:0/3849555148 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55833b9e6d70 con 0x55833ba93da0 2024-09-10T11:43:18.119 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:43:18.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2eacff9640 10 client.25097 handle_command_reply: tid=0 2024-09-10T11:43:18.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2ecd679740 1 client.25097 shutdown 2024-09-10T11:43:18.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 msgr2=0x55833ba8bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.112+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40ccb00 tx=0x7f2eb409c080 comp rx=0 tx=0).stop 2024-09-10T11:43:18.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 shutdown_connections 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55833ba93da0 0x55833bb0a0b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55833ba86580 0x55833bb06320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55833ba7cd50 0x55833ba8bcd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2eacff9640 0 client.25097 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 --2- 172.21.15.17:0/3849555148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55833ba7b7e0 0x55833ba8b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 >> 172.21.15.17:0/3849555148 conn(0x55833ba42310 msgr2=0x55833ba74b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 shutdown_connections 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 1 -- 172.21.15.17:0/3849555148 wait complete. 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.113+0000 7f2ecd679740 20 client.25097 trim_cache size 0 max 16384 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 msgr2=0x7f2eb00a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 0x7f2eb00a4f10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005c40 tx=0x7f2ebc009500 comp rx=0 tx=0).stop 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 msgr2=0x7f2ec4197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec4197b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e9f0 tx=0x7f2eb400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 shutdown_connections 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2eb00a2a50 0x7f2eb00a4f10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec419bea0 0x7f2ec419c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec4102ef0 0x7f2ec4197b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 --2- 172.21.15.17:0/1102019680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec4102570 0x7f2ec41975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 >> 172.21.15.17:0/1102019680 conn(0x7f2ec40fc7d0 msgr2=0x7f2ec40fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 shutdown_connections 2024-09-10T11:43:18.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:18.114+0000 7f2ecb2a0640 1 -- 172.21.15.17:0/1102019680 wait complete. 2024-09-10T11:43:18.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:43:19.108 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:19.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:19 smithi017 ceph-mon[30817]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T11:43:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:19 smithi026 ceph-mon[34817]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T11:43:19.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:19 smithi081 ceph-mon[35059]: pgmap v358: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T11:43:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 -- 172.21.15.17:0/2639843703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880101de0 msgr2=0x7f48801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2639843703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880101de0 0x7f48801021c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4870009900 tx=0x7f487002a410 comp rx=0 tx=0).stop 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 -- 172.21.15.17:0/2639843703 shutdown_connections 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2639843703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880102790 0x7f48801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2639843703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 0x7f488010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2639843703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880101de0 0x7f48801021c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 -- 172.21.15.17:0/2639843703 >> 172.21.15.17:0/2639843703 conn(0x7f48800fd8e0 msgr2=0x7f48800ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 -- 172.21.15.17:0/2639843703 shutdown_connections 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.704+0000 7f4884f8d640 1 -- 172.21.15.17:0/2639843703 wait complete. 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 Processor -- start 2024-09-10T11:43:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 -- start start 2024-09-10T11:43:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 0x7f48801a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 0x7f488010db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4880111f70 con 0x7f4880102790 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4880111df0 con 0x7f4880106f10 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f4884f8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48801120f0 con 0x7f4880101de0 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34600/0 (socket says 172.21.15.17:34600) 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f487dd9b640 1 -- 172.21.15.17:0/2981737265 learned_addr learned my addr 172.21.15.17:0/2981737265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f487e59c640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 0x7f48801a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.706+0000 7f487ed9d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 0x7f488010db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 -- 172.21.15.17:0/2981737265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 msgr2=0x7f48801a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 0x7f48801a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 -- 172.21.15.17:0/2981737265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 msgr2=0x7f488010db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 0x7f488010db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 -- 172.21.15.17:0/2981737265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488010e350 con 0x7f4880102790 2024-09-10T11:43:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487e59c640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 0x7f48801a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:19.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f487dd9b640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f487400e9f0 tx=0x7f487400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f486f7fe640 1 -- 172.21.15.17:0/2981737265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487400cd80 con 0x7f4880102790 2024-09-10T11:43:19.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f486f7fe640 1 -- 172.21.15.17:0/2981737265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4874005500 con 0x7f4880102790 2024-09-10T11:43:19.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.707+0000 7f486f7fe640 1 -- 172.21.15.17:0/2981737265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874010690 con 0x7f4880102790 2024-09-10T11:43:19.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.708+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488010e640 con 0x7f4880102790 2024-09-10T11:43:19.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.708+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48801ab540 con 0x7f4880102790 2024-09-10T11:43:19.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.712+0000 7f4887366740 1 Processor -- start 2024-09-10T11:43:19.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.712+0000 7f4887366740 1 -- start start 2024-09-10T11:43:19.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.712+0000 7f486f7fe640 1 -- 172.21.15.17:0/2981737265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48740046c0 con 0x7f4880102790 2024-09-10T11:43:19.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a35c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 0x55646a369760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55646a2c22f0 con 0x55646a35c5d0 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55646a269cf0 con 0x55646a35db40 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f4887366740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55646a2be2b0 con 0x55646a367370 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34602/0 (socket says 172.21.15.17:34602) 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487e59c640 1 -- 172.21.15.17:0/1403413980 learned_addr learned my addr 172.21.15.17:0/1403413980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:19.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a35c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487dd9b640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 0x55646a369760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.713+0000 7f487ed9d640 1 -- 172.21.15.17:0/1403413980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 msgr2=0x55646a369760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 0x55646a369760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487ed9d640 1 -- 172.21.15.17:0/1403413980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 msgr2=0x55646a35ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487ed9d640 1 -- 172.21.15.17:0/1403413980 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646a24e3a0 con 0x55646a35db40 2024-09-10T11:43:19.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a35c090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4878009f00 tx=0x7f4878011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21231b7f8b38d6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487e59c640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:19.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f487dd9b640 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 0x55646a369760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f486cff9640 1 -- 172.21.15.17:0/1403413980 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878004d20 con 0x55646a35db40 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f486cff9640 1 -- 172.21.15.17:0/1403413980 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4878004050 con 0x55646a35db40 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.714+0000 7f486cff9640 1 -- 172.21.15.17:0/1403413980 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878005240 con 0x55646a35db40 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f486f7fe640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 0x7f48680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f486f7fe640 1 -- 172.21.15.17:0/2981737265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f48740cf4b0 con 0x7f4880102790 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f487e59c640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 0x7f48680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 -- 172.21.15.17:0/1403413980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 msgr2=0x55646a35c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a35c090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4878009f00 tx=0x7f4878011810 comp rx=0 tx=0).stop 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 -- 172.21.15.17:0/1403413980 shutdown_connections 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a367370 0x55646a369760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a35c5d0 0x55646a35ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 --2- 172.21.15.17:0/1403413980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a35c090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.715+0000 7f4887366740 1 -- 172.21.15.17:0/1403413980 >> 172.21.15.17:0/1403413980 conn(0x55646a325310 msgr2=0x55646a358c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.716+0000 7f4887366740 1 -- 172.21.15.17:0/1403413980 shutdown_connections 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.716+0000 7f4887366740 1 -- 172.21.15.17:0/1403413980 wait complete. 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.716+0000 7f487e59c640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 0x7f48680a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55646a359ac0 tx=0x7f4870005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.716+0000 7f4887366740 1 -- start start 2024-09-10T11:43:19.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 Processor -- start 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35c5d0 0x55646a366c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 0x55646a363f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55646a36a070 con 0x55646a367370 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55646a27d060 con 0x55646a35c5d0 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55646a36a1f0 con 0x55646a35db40 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f4887366740 10 client.0 _ll_register_callbacks cb 0x556469fd08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34616/0 (socket says 172.21.15.17:34616) 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.717+0000 7f487ed9d640 1 -- 172.21.15.17:0/1568663839 learned_addr learned my addr 172.21.15.17:0/1568663839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:19.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487ed9d640 1 -- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 msgr2=0x55646a363f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487dd9b640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 0x55646a363f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 0x55646a363f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487ed9d640 1 -- 172.21.15.17:0/1568663839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35c5d0 msgr2=0x55646a366c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487e59c640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35c5d0 0x55646a366c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35c5d0 0x55646a366c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487ed9d640 1 -- 172.21.15.17:0/1568663839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646a0333c0 con 0x55646a367370 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.718+0000 7f487dd9b640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 0x55646a363f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f487ed9d640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4878011d10 tx=0x7f4878004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831d5daced6eab65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878029070 con 0x55646a367370 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4878019630 con 0x55646a367370 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4878004050 con 0x55646a367370 2024-09-10T11:43:19.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4878035050 con 0x55646a367370 2024-09-10T11:43:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4887366740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.719+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55646a375a30 con 0x55646a367370 2024-09-10T11:43:19.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4878004050 con 0x55646a367370 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4878022a70 con 0x55646a367370 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 20 client.15411 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a379170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 4 client.15411 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.720+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55646a2cf860 con 0x55646a376d80 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.721+0000 7f487e59c640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a379170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.721+0000 7f487e59c640 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a379170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6badfbe42832329a server_cookie=8ca555334266158d in_seq=0 out_seq=0 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.721+0000 7f4865ffb640 10 client.15411 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4865ffb640 1 -- 172.21.15.17:0/1568663839 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55646a2cf860 con 0x55646a376d80 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4865ffb640 10 client.15411 handle_command_reply: tid=0 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 client.15411 shutdown 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 msgr2=0x55646a3644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4878011d10 tx=0x7f4878004430 comp rx=0 tx=0).stop 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 shutdown_connections 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a379170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4865ffb640 0 client.15411 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35db40 0x55646a363f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a3644b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 --2- 172.21.15.17:0/1568663839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35c5d0 0x55646a366c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 >> 172.21.15.17:0/1568663839 conn(0x55646a325310 msgr2=0x55646a35e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 shutdown_connections 2024-09-10T11:43:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.722+0000 7f4887366740 1 -- 172.21.15.17:0/1568663839 wait complete. 2024-09-10T11:43:19.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.723+0000 7f4887366740 20 client.15411 trim_cache size 0 max 16384 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 Processor -- start 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 -- start start 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a373370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a35f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b3bd0 con 0x55646a367370 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b5710 con 0x55646a35db40 2024-09-10T11:43:19.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.749+0000 7f4887366740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b42a0 con 0x55646a35c5d0 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45696/0 (socket says 172.21.15.17:45696) 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 -- 172.21.15.17:0/368581610 learned_addr learned my addr 172.21.15.17:0/368581610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487e59c640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a373370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487ed9d640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a35f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 -- 172.21.15.17:0/368581610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 msgr2=0x55646a373370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a373370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 -- 172.21.15.17:0/368581610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 msgr2=0x55646a35f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a35f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 -- 172.21.15.17:0/368581610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646a3647e0 con 0x55646a35db40 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487ed9d640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a35f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f487dd9b640 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4874098180 tx=0x7f487409b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=230d84408c95e366 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.750+0000 7f4867fff640 1 -- 172.21.15.17:0/368581610 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487409c420 con 0x55646a35db40 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.751+0000 7f4867fff640 1 -- 172.21.15.17:0/368581610 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487409bd20 con 0x55646a35db40 2024-09-10T11:43:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.751+0000 7f4867fff640 1 -- 172.21.15.17:0/368581610 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487409b170 con 0x55646a35db40 2024-09-10T11:43:19.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.751+0000 7f4887366740 1 -- 172.21.15.17:0/368581610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 msgr2=0x55646a3657d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.751+0000 7f4887366740 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4874098180 tx=0x7f487409b860 comp rx=0 tx=0).stop 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 -- 172.21.15.17:0/368581610 shutdown_connections 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a35f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a3657d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 --2- 172.21.15.17:0/368581610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a373370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 -- 172.21.15.17:0/368581610 >> 172.21.15.17:0/368581610 conn(0x55646a325310 msgr2=0x55646a357b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 -- 172.21.15.17:0/368581610 shutdown_connections 2024-09-10T11:43:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 -- 172.21.15.17:0/368581610 wait complete. 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 -- start start 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.752+0000 7f4887366740 1 Processor -- start 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f4887366740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a36f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f4887366740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a36fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f4887366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a36f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a36fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a36fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45708/0 (socket says 172.21.15.17:45708) 2024-09-10T11:43:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a36f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51456/0 (socket says 172.21.15.17:51456) 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34630/0 (socket says 172.21.15.17:34630) 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f487dd9b640 1 -- 172.21.15.17:0/3009027180 learned_addr learned my addr 172.21.15.17:0/3009027180 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b5040 con 0x55646a367370 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.753+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b4970 con 0x55646a35db40 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48801b1bb0 con 0x55646a35c5d0 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 -- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 msgr2=0x55646a36f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a36f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 -- 172.21.15.17:0/3009027180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 msgr2=0x55646a36fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a36fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646a361e90 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f4887366740 10 client.0 _ll_register_callbacks cb 0x7f48780093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f487409bd20 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f487ed9d640 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f48780213d0 tx=0x7f4878005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dab24b0276a619 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.754+0000 7f4865ffb640 10 client.15417 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.755+0000 7f4865ffb640 1 -- 172.21.15.17:0/3009027180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878029040 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.755+0000 7f4865ffb640 1 -- 172.21.15.17:0/3009027180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4878021950 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.755+0000 7f4865ffb640 1 -- 172.21.15.17:0/3009027180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4878021bd0 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.755+0000 7f4887366740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.755+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55646a3e1b10 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4865ffb640 1 -- 172.21.15.17:0/3009027180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4878022420 con 0x55646a367370 2024-09-10T11:43:19.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 20 client.15417 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a3e4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 4 client.15417 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55646a2c9d70 con 0x55646a376d80 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f487e59c640 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a3e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f4865ffb640 10 client.15417 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.756+0000 7f487e59c640 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a3e4120 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f062e2b1969a2485 server_cookie=51a12b6611cd17d0 in_seq=0 out_seq=0 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4865ffb640 1 -- 172.21.15.17:0/3009027180 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55646a2c9d70 con 0x55646a376d80 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4865ffb640 10 client.15417 handle_command_reply: tid=0 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 client.15417 shutdown 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 msgr2=0x55646a36c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f48780213d0 tx=0x7f4878005f10 comp rx=0 tx=0).stop 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 shutdown_connections 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55646a376d80 0x55646a3e4120 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55646a367370 0x55646a36c4b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4865ffb640 0 client.15417 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55646a35db40 0x55646a36fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 --2- 172.21.15.17:0/3009027180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55646a35c5d0 0x55646a36f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 >> 172.21.15.17:0/3009027180 conn(0x55646a325310 msgr2=0x55646a372360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 shutdown_connections 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.757+0000 7f4887366740 1 -- 172.21.15.17:0/3009027180 wait complete. 2024-09-10T11:43:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.758+0000 7f4887366740 20 client.15417 trim_cache size 0 max 16384 2024-09-10T11:43:19.764 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:43:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.758+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 msgr2=0x7f48680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.758+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 0x7f48680a50c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55646a359ac0 tx=0x7f4870005b50 comp rx=0 tx=0).stop 2024-09-10T11:43:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.758+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 msgr2=0x7f48801a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.758+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f487400e9f0 tx=0x7f487400edf0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 shutdown_connections 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48680a2c00 0x7f48680a50c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4880106f10 0x7f488010db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4880102790 0x7f48801a4cb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 --2- 172.21.15.17:0/2981737265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4880101de0 0x7f48801a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 >> 172.21.15.17:0/2981737265 conn(0x7f48800fd8e0 msgr2=0x7f48800ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 shutdown_connections 2024-09-10T11:43:19.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:19.759+0000 7f4884f8d640 1 -- 172.21.15.17:0/2981737265 wait complete. 2024-09-10T11:43:21.493 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:43:21.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:43:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:21 smithi026 ceph-mon[34817]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:21.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:21 smithi017 ceph-mon[30817]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:21.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:21 smithi081 ceph-mon[35059]: pgmap v359: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:22.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 -- 172.21.15.17:0/1148938590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 msgr2=0x7f1a0410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1148938590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 0x7f1a0410da40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009ca0 tx=0x7f19fc02a950 comp rx=0 tx=0).stop 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 -- 172.21.15.17:0/1148938590 shutdown_connections 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1148938590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 0x7f1a0410da40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1148938590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04102570 0x7f1a041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1148938590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a04100e20 0x7f1a04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 -- 172.21.15.17:0/1148938590 >> 172.21.15.17:0/1148938590 conn(0x7f1a040fc7d0 msgr2=0x7f1a040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 -- 172.21.15.17:0/1148938590 shutdown_connections 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 -- 172.21.15.17:0/1148938590 wait complete. 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.314+0000 7f1a0a901640 1 Processor -- start 2024-09-10T11:43:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 -- start start 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a04102570 0x7f1a041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 0x7f1a041a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04110f80 con 0x7f1a04102ef0 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04110e00 con 0x7f1a04100e20 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a0a901640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04111100 con 0x7f1a04102570 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57690/0 (socket says 172.21.15.17:57690) 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.315+0000 7f1a03fff640 1 -- 172.21.15.17:0/1585476721 learned_addr learned my addr 172.21.15.17:0/1585476721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 -- 172.21.15.17:0/1585476721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a04102570 msgr2=0x7f1a041997d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a04102570 0x7f1a041997d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 -- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 msgr2=0x7f1a041a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 0x7f1a041a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 -- 172.21.15.17:0/1585476721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a041a4850 con 0x7f1a04100e20 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d950 tx=0x7f19f400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a01ffb640 1 -- 172.21.15.17:0/1585476721 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4017070 con 0x7f1a04100e20 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a041a4a20 con 0x7f1a04100e20 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a01ffb640 1 -- 172.21.15.17:0/1585476721 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f4009c30 con 0x7f1a04100e20 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a01ffb640 1 -- 172.21.15.17:0/1585476721 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f400f6b0 con 0x7f1a04100e20 2024-09-10T11:43:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.316+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a04197080 con 0x7f1a04100e20 2024-09-10T11:43:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 Processor -- start 2024-09-10T11:43:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 -- start start 2024-09-10T11:43:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 0x559d2fe59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d2fdbf280 con 0x559d2fe64d40 2024-09-10T11:43:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559d2fd66b10 con 0x559d2fe5a480 2024-09-10T11:43:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d2fdbb240 con 0x559d2fe59b60 2024-09-10T11:43:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.319+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60180/0 (socket says 172.21.15.17:60180) 2024-09-10T11:43:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 -- 172.21.15.17:0/2147488659 learned_addr learned my addr 172.21.15.17:0/2147488659 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 0x559d2fe59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f1a01ffb640 1 -- 172.21.15.17:0/1585476721 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f19f400f850 con 0x7f1a04100e20 2024-09-10T11:43:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 -- 172.21.15.17:0/2147488659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 msgr2=0x559d2fe59f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 0x559d2fe59f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 -- 172.21.15.17:0/2147488659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 msgr2=0x559d2fe64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f1a03fff640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe64800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 -- 172.21.15.17:0/2147488659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2fd731f0 con 0x559d2fe64d40 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 0x559d2fe59f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.320+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009af0 tx=0x7f19ec00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65e385eee1a414 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f1a03fff640 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f1a01ffb640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 0x7f19f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f19fa7fc640 1 -- 172.21.15.17:0/2147488659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec00ed80 con 0x559d2fe64d40 2024-09-10T11:43:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f19fa7fc640 1 -- 172.21.15.17:0/2147488659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec005500 con 0x559d2fe64d40 2024-09-10T11:43:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f1a01ffb640 1 -- 172.21.15.17:0/1585476721 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f19f40ce970 con 0x7f1a04100e20 2024-09-10T11:43:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.321+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 0x7f19f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f19fa7fc640 1 -- 172.21.15.17:0/2147488659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec010690 con 0x559d2fe64d40 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2147488659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 msgr2=0x559d2fe67130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009af0 tx=0x7f19ec00e350 comp rx=0 tx=0).stop 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 0x7f19f00a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f19fc004af0 tx=0x7f19fc043040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2147488659 shutdown_connections 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67130 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2147488659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe59b60 0x559d2fe59f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2147488659 >> 172.21.15.17:0/2147488659 conn(0x559d2fe560f0 msgr2=0x559d2fe564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2147488659 shutdown_connections 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.322+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2147488659 wait complete. 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.323+0000 7f1a0ccda740 1 -- start start 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.323+0000 7f1a0ccda740 1 Processor -- start 2024-09-10T11:43:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.323+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.323+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe61af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe62280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60184/0 (socket says 172.21.15.17:60184) 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a03fff640 1 -- 172.21.15.17:0/1251261849 learned_addr learned my addr 172.21.15.17:0/1251261849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f19fbfff640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe61af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d2fe67960 con 0x559d2fe59b60 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559d2fd79f10 con 0x559d2fe5a480 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d2fe67ae0 con 0x559d2fe64d40 2024-09-10T11:43:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe62280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 -- 172.21.15.17:0/1251261849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 msgr2=0x559d2fe61af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe61af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 -- 172.21.15.17:0/1251261849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 msgr2=0x559d2fe647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a08e9e640 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2fb306a0 con 0x559d2fe64d40 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.324+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f1a0ccda740 10 client.0 _ll_register_callbacks cb 0x559d2fd42a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec005500 con 0x559d2fe64d40 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f1a08e9e640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe62280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19fc005e30 tx=0x7f19fc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c20401e624f842 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f19e37fe640 10 client.25096 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f19e37fe640 1 -- 172.21.15.17:0/1251261849 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc034040 con 0x559d2fe64d40 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f19e37fe640 1 -- 172.21.15.17:0/1251261849 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f19fc003970 con 0x559d2fe64d40 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f19e37fe640 1 -- 172.21.15.17:0/1251261849 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19fc003bb0 con 0x559d2fe64d40 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f1a0ccda740 10 client.25096 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.325+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559d2fe73390 con 0x559d2fe64d40 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f19e37fe640 1 -- 172.21.15.17:0/1251261849 <== mon.1 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19fc04b070 con 0x559d2fe64d40 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 10 client.25096 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 10 client.25096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 20 client.25096 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fe74790 0x559d2fe76c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 4 client.25096 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d2fdcc7f0 con 0x559d2fe74790 2024-09-10T11:43:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.326+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fe74790 0x559d2fe76c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.327+0000 7f19e37fe640 10 client.25096 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.327+0000 7f1a03fff640 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fe74790 0x559d2fe76c00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0e4b7dcac36c478 server_cookie=ffcdae55b1ae3f63 in_seq=0 out_seq=0 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.327+0000 7f19e37fe640 1 -- 172.21.15.17:0/1251261849 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d2fdcc7f0 con 0x559d2fe74790 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.327+0000 7f19e37fe640 10 client.25096 handle_command_reply: tid=0 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.327+0000 7f1a0ccda740 1 client.25096 shutdown 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 msgr2=0x559d2fe62280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe62280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19fc005e30 tx=0x7f19fc0095c0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 shutdown_connections 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fe74790 0x559d2fe76c00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe62280 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe5a480 0x559d2fe61af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/1251261849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe59b60 0x559d2fe647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f19e37fe640 0 client.25096 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 >> 172.21.15.17:0/1251261849 conn(0x559d2fe560f0 msgr2=0x559d2fe5bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 shutdown_connections 2024-09-10T11:43:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 1 -- 172.21.15.17:0/1251261849 wait complete. 2024-09-10T11:43:22.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.328+0000 7f1a0ccda740 20 client.25096 trim_cache size 0 max 16384 2024-09-10T11:43:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 Processor -- start 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 -- start start 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe61ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe7ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400e370 con 0x559d2fe5a480 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400feb0 con 0x559d2fe59b60 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400ea40 con 0x559d2fe64d40 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f19fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60200/0 (socket says 172.21.15.17:60200) 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.346+0000 7f19fbfff640 1 -- 172.21.15.17:0/4263879258 learned_addr learned my addr 172.21.15.17:0/4263879258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f1a03fff640 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe61ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 -- 172.21.15.17:0/4263879258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 msgr2=0x559d2fe7ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe7ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 -- 172.21.15.17:0/4263879258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 msgr2=0x559d2fe61ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe61ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 -- 172.21.15.17:0/4263879258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2fe55f20 con 0x559d2fe5a480 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f1a03fff640 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19fbfff640 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009a90 tx=0x7f19ec004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd9da302fa25308 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.347+0000 7f19f9ffb640 1 -- 172.21.15.17:0/4263879258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec01d040 con 0x559d2fe5a480 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f19f9ffb640 1 -- 172.21.15.17:0/4263879258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec00ed80 con 0x559d2fe5a480 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f19f9ffb640 1 -- 172.21.15.17:0/4263879258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec003db0 con 0x559d2fe5a480 2024-09-10T11:43:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 -- 172.21.15.17:0/4263879258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 msgr2=0x559d2fe7c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009a90 tx=0x7f19ec004db0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 -- 172.21.15.17:0/4263879258 shutdown_connections 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe64d40 0x559d2fe7ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe5a480 0x559d2fe7c4d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/4263879258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.348+0000 7f1a0ccda740 1 -- 172.21.15.17:0/4263879258 >> 172.21.15.17:0/4263879258 conn(0x559d2fe560f0 msgr2=0x559d2fe613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.349+0000 7f1a0ccda740 1 -- 172.21.15.17:0/4263879258 shutdown_connections 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.349+0000 7f1a0ccda740 1 -- 172.21.15.17:0/4263879258 wait complete. 2024-09-10T11:43:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.349+0000 7f1a0ccda740 1 -- start start 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.349+0000 7f1a0ccda740 1 Processor -- start 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.349+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe5a480 0x559d2fe6d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400f7e0 con 0x559d2fe64d40 2024-09-10T11:43:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400f110 con 0x559d2fe59b60 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a08e9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19e400c350 con 0x559d2fe5a480 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a0ccda740 10 client.0 _ll_register_callbacks cb 0x7f19fc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57720/0 (socket says 172.21.15.17:57720) 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 -- 172.21.15.17:0/2889242167 learned_addr learned my addr 172.21.15.17:0/2889242167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe5a480 0x559d2fe6d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 -- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe5a480 msgr2=0x559d2fe6d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe5a480 0x559d2fe6d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 -- 172.21.15.17:0/2889242167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 msgr2=0x559d2fe67dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.350+0000 7f1a03fff640 1 -- 172.21.15.17:0/2889242167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2fe5fa10 con 0x559d2fe59b60 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f1a03fff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19f409ae80 tx=0x7f19f4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73510b3cce2f352a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f19e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f40b3020 con 0x559d2fe59b60 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f19f40977f0 con 0x559d2fe59b60 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec00ed80 con 0x559d2fe59b60 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19f4020040 con 0x559d2fe59b60 2024-09-10T11:43:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f1a0ccda740 10 client.25127 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d2fedf9c0 con 0x559d2fe59b60 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.351+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f40a3df0 con 0x559d2fe59b60 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19f4023060 con 0x559d2fe59b60 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 10 client.25127 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 10 client.25127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 20 client.25127 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fee0090 0x559d2fee24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 4 client.25127 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f19ec00ed80 con 0x559d2fee0090 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.352+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fee0090 0x559d2fee24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.353+0000 7f19fbfff640 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fee0090 0x559d2fee24b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=563af7c819d856dc server_cookie=3b3019d1391e6b12 in_seq=0 out_seq=0 2024-09-10T11:43:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.353+0000 7f19e37fe640 10 client.25127 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f19e37fe640 1 -- 172.21.15.17:0/2889242167 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f19ec00ed80 con 0x559d2fee0090 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f19e37fe640 10 client.25127 handle_command_reply: tid=0 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 client.25127 shutdown 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 msgr2=0x559d2fe6ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19f409ae80 tx=0x7f19f4005880 comp rx=0 tx=0).stop 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 shutdown_connections 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559d2fee0090 0x559d2fee24b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2fe5a480 0x559d2fe6d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d2fe64d40 0x559d2fe67dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 --2- 172.21.15.17:0/2889242167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559d2fe59b60 0x559d2fe6ce20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 >> 172.21.15.17:0/2889242167 conn(0x559d2fe560f0 msgr2=0x559d2fe54a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f19e37fe640 0 client.25127 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.354+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 shutdown_connections 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0ccda740 1 -- 172.21.15.17:0/2889242167 wait complete. 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0ccda740 20 client.25127 trim_cache size 0 max 16384 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "e7bde6a4-9738-4d71-a97d-a5bde834d665", 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:43:22.361 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 msgr2=0x7f19f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 0x7f19f00a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f19fc004af0 tx=0x7f19fc043040 comp rx=0 tx=0).stop 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 msgr2=0x7f1a04199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d950 tx=0x7f19f400de10 comp rx=0 tx=0).stop 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 shutdown_connections 2024-09-10T11:43:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f19f00a2b80 0x7f19f00a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a04102570 0x7f1a041997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a04102ef0 0x7f1a041a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 --2- 172.21.15.17:0/1585476721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a04100e20 0x7f1a04199290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.355+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 >> 172.21.15.17:0/1585476721 conn(0x7f1a040fc7d0 msgr2=0x7f1a04106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.356+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 shutdown_connections 2024-09-10T11:43:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:22.356+0000 7f1a0a901640 1 -- 172.21.15.17:0/1585476721 wait complete. 2024-09-10T11:43:23.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:43:23.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:23 smithi017 ceph-mon[30817]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:23.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:23 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:43:23.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:23 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:23 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:43:23.239 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:23 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:23 smithi026 ceph-mon[34817]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:23 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:43:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:23 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:23 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:43:23.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:23 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:23 smithi081 ceph-mon[35059]: pgmap v360: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T11:43:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:23 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:43:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:23 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:23 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:43:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:23 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:43:23.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.934+0000 7f6700242640 1 -- 172.21.15.17:0/2522315301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81082a0 msgr2=0x7f66f810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.934+0000 7f6700242640 1 --2- 172.21.15.17:0/2522315301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81082a0 0x7f66f810ec40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009cd0 tx=0x7f66f002a8f0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 -- 172.21.15.17:0/2522315301 shutdown_connections 2024-09-10T11:43:23.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 --2- 172.21.15.17:0/2522315301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81082a0 0x7f66f810ec40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 --2- 172.21.15.17:0/2522315301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81036e0 0x7f66f8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 --2- 172.21.15.17:0/2522315301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 0x7f66f8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 -- 172.21.15.17:0/2522315301 >> 172.21.15.17:0/2522315301 conn(0x7f66f80fc7d0 msgr2=0x7f66f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 -- 172.21.15.17:0/2522315301 shutdown_connections 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.935+0000 7f6700242640 1 -- 172.21.15.17:0/2522315301 wait complete. 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 Processor -- start 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 -- start start 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 0x7f66f8196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 0x7f66f819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f66fd7dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66f810fe90 con 0x7f66f81036e0 2024-09-10T11:43:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f66fd7dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60228/0 (socket says 172.21.15.17:60228) 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f66fd7dd640 1 -- 172.21.15.17:0/383017828 learned_addr learned my addr 172.21.15.17:0/383017828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f66fdfde640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 0x7f66f8196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66f810fd10 con 0x7f66f81082a0 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.936+0000 7f66fe7df640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 0x7f66f819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8110010 con 0x7f66f8102d30 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fd7dd640 1 -- 172.21.15.17:0/383017828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 msgr2=0x7f66f8196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 0x7f66f8196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fd7dd640 1 -- 172.21.15.17:0/383017828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 msgr2=0x7f66f819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 0x7f66f819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fd7dd640 1 -- 172.21.15.17:0/383017828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f819b0e0 con 0x7f66f81036e0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.937+0000 7f66fe7df640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 0x7f66f819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d740 tx=0x7f66e800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f66eeffd640 1 -- 172.21.15.17:0/383017828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017070 con 0x7f66f81036e0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f66eeffd640 1 -- 172.21.15.17:0/383017828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66e8010460 con 0x7f66f81036e0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f819b3d0 con 0x7f66f81036e0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f66eeffd640 1 -- 172.21.15.17:0/383017828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e800f620 con 0x7f66f81036e0 2024-09-10T11:43:23.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.938+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f81a2cb0 con 0x7f66f81036e0 2024-09-10T11:43:23.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.941+0000 7f66eeffd640 1 -- 172.21.15.17:0/383017828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f66e801a070 con 0x7f66f81036e0 2024-09-10T11:43:23.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.942+0000 7f66eeffd640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 0x7f66e40a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.942+0000 7f66eeffd640 1 -- 172.21.15.17:0/383017828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66e80ce920 con 0x7f66f81036e0 2024-09-10T11:43:23.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.942+0000 7f670261b740 1 Processor -- start 2024-09-10T11:43:23.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.942+0000 7f66fdfde640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 0x7f66e40a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.942+0000 7f670261b740 1 -- start start 2024-09-10T11:43:23.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4eca0 0x55ef78e4f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e59940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef78dac2e0 con 0x55ef78e59e80 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ef78d53ce0 con 0x55ef78e4f5c0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f670261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef78da82a0 con 0x55ef78e4eca0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fe7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fe7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60238/0 (socket says 172.21.15.17:60238) 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fe7df640 1 -- 172.21.15.17:0/3519452228 learned_addr learned my addr 172.21.15.17:0/3519452228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fdfde640 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4eca0 0x55ef78e4f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e59940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.943+0000 7f66fdfde640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 0x7f66e40a9510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66f400abe0 tx=0x7f66f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 -- 172.21.15.17:0/3519452228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4eca0 msgr2=0x55ef78e4f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4eca0 0x55ef78e4f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 -- 172.21.15.17:0/3519452228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 msgr2=0x55ef78e59940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e59940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 -- 172.21.15.17:0/3519452228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef78d38440 con 0x55ef78e59e80 2024-09-10T11:43:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66fe7df640 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66f0030450 tx=0x7f66f0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34de8c692a6982c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66e3fff640 1 -- 172.21.15.17:0/3519452228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0003970 con 0x55ef78e59e80 2024-09-10T11:43:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66e3fff640 1 -- 172.21.15.17:0/3519452228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66f0036040 con 0x55ef78e59e80 2024-09-10T11:43:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.944+0000 7f66e3fff640 1 -- 172.21.15.17:0/3519452228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0004400 con 0x55ef78e59e80 2024-09-10T11:43:23.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.945+0000 7f670261b740 1 -- 172.21.15.17:0/3519452228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 msgr2=0x55ef78e5c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.945+0000 7f670261b740 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66f0030450 tx=0x7f66f0009a20 comp rx=0 tx=0).stop 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 -- 172.21.15.17:0/3519452228 shutdown_connections 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e5c270 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e59940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 --2- 172.21.15.17:0/3519452228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4eca0 0x55ef78e4f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 -- 172.21.15.17:0/3519452228 >> 172.21.15.17:0/3519452228 conn(0x55ef78e4b230 msgr2=0x55ef78e4b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 -- 172.21.15.17:0/3519452228 shutdown_connections 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 -- 172.21.15.17:0/3519452228 wait complete. 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 -- start start 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.946+0000 7f670261b740 1 Processor -- start 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f670261b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f670261b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f66fdfde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f66fdfde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60254/0 (socket says 172.21.15.17:60254) 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f66fd7dd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f66fd7dd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57770/0 (socket says 172.21.15.17:57770) 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.947+0000 7f670261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 0x55ef78e56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 -- 172.21.15.17:0/2478916847 learned_addr learned my addr 172.21.15.17:0/2478916847 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef78e5ca50 con 0x55ef78e4eca0 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ef78d67050 con 0x55ef78e4f5c0 2024-09-10T11:43:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef78e5cbd0 con 0x55ef78e59e80 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 -- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 msgr2=0x55ef78e56f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fe7df640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 0x55ef78e56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 0x55ef78e56f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 -- 172.21.15.17:0/2478916847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 msgr2=0x55ef78e56a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fdfde640 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef78b1d3c0 con 0x55ef78e4eca0 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fe7df640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 0x55ef78e56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.948+0000 7f670261b740 10 client.0 _ll_register_callbacks cb 0x55ef78da7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f0036040 con 0x55ef78e4eca0 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f66fdfde640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66f401de00 tx=0x7f66f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbb2e6a56deb911 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f66e17fa640 10 client.15444 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f66e17fa640 1 -- 172.21.15.17:0/2478916847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f402a060 con 0x55ef78e4eca0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f66e17fa640 1 -- 172.21.15.17:0/2478916847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66f401b640 con 0x55ef78e4eca0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f66e17fa640 1 -- 172.21.15.17:0/2478916847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66f4016070 con 0x55ef78e4eca0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f670261b740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.949+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ef78e682b0 con 0x55ef78e4eca0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f66e17fa640 1 -- 172.21.15.17:0/2478916847 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f66f4024030 con 0x55ef78e4eca0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 20 client.15444 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78e696d0 0x55ef78e6bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 4 client.15444 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef78db9850 con 0x55ef78e696d0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.950+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78e696d0 0x55ef78e6bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.951+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78e696d0 0x55ef78e6bb60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb8c1b0e885b9ef8 server_cookie=8f51d379cce0edd2 in_seq=0 out_seq=0 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.951+0000 7f66e17fa640 10 client.15444 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.951+0000 7f66e17fa640 1 -- 172.21.15.17:0/2478916847 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef78db9850 con 0x55ef78e696d0 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.951+0000 7f66e17fa640 10 client.15444 handle_command_reply: tid=0 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.951+0000 7f670261b740 1 client.15444 shutdown 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 msgr2=0x55ef78e59760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66f401de00 tx=0x7f66f4004730 comp rx=0 tx=0).stop 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 shutdown_connections 2024-09-10T11:43:23.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78e696d0 0x55ef78e6bb60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f66e17fa640 0 client.15444 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e59e80 0x55ef78e56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4f5c0 0x55ef78e56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 --2- 172.21.15.17:0/2478916847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e59760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 >> 172.21.15.17:0/2478916847 conn(0x55ef78e4b230 msgr2=0x55ef78e41ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 shutdown_connections 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 1 -- 172.21.15.17:0/2478916847 wait complete. 2024-09-10T11:43:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.952+0000 7f670261b740 20 client.15444 trim_cache size 0 max 16384 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.969+0000 7f670261b740 1 Processor -- start 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.969+0000 7f670261b740 1 -- start start 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4eca0 0x55ef78e577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e71470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81ab2c0 con 0x55ef78e59e80 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81ace00 con 0x55ef78e4eca0 2024-09-10T11:43:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f670261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81ab990 con 0x55ef78e4f5c0 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60260/0 (socket says 172.21.15.17:60260) 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 -- 172.21.15.17:0/1824737469 learned_addr learned my addr 172.21.15.17:0/1824737469 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fdfde640 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4eca0 0x55ef78e577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e71470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 -- 172.21.15.17:0/1824737469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 msgr2=0x55ef78e71470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e71470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 -- 172.21.15.17:0/1824737469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4eca0 msgr2=0x55ef78e577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4eca0 0x55ef78e577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.970+0000 7f66fe7df640 1 -- 172.21.15.17:0/1824737469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef78e4f3f0 con 0x55ef78e59e80 2024-09-10T11:43:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.971+0000 7f66fe7df640 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f66f0000f80 tx=0x7f66f0005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a8ce74b072f9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.971+0000 7f66e37fe640 1 -- 172.21.15.17:0/1824737469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0053070 con 0x55ef78e59e80 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.971+0000 7f66e37fe640 1 -- 172.21.15.17:0/1824737469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66f0003e50 con 0x55ef78e59e80 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.971+0000 7f66e37fe640 1 -- 172.21.15.17:0/1824737469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f004a040 con 0x55ef78e59e80 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- 172.21.15.17:0/1824737469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 msgr2=0x55ef78e719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f66f0000f80 tx=0x7f66f0005c10 comp rx=0 tx=0).stop 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- 172.21.15.17:0/1824737469 shutdown_connections 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e71470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e59e80 0x55ef78e719b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 --2- 172.21.15.17:0/1824737469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e4eca0 0x55ef78e577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- 172.21.15.17:0/1824737469 >> 172.21.15.17:0/1824737469 conn(0x55ef78e4b230 msgr2=0x55ef78e52070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- 172.21.15.17:0/1824737469 shutdown_connections 2024-09-10T11:43:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- 172.21.15.17:0/1824737469 wait complete. 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 -- start start 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.972+0000 7f670261b740 1 Processor -- start 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e5e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 0x55ef78e5e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81ac730 con 0x55ef78e4eca0 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81ac060 con 0x55ef78e59e80 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81a92a0 con 0x55ef78e4f5c0 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f670261b740 10 client.0 _ll_register_callbacks cb 0x7f66f401dab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60274/0 (socket says 172.21.15.17:60274) 2024-09-10T11:43:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 -- 172.21.15.17:0/4119471696 learned_addr learned my addr 172.21.15.17:0/4119471696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e5e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fe7df640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 0x55ef78e5e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 -- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 msgr2=0x55ef78e5e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e5e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 -- 172.21.15.17:0/4119471696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 msgr2=0x55ef78e5e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 0x55ef78e5e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fdfde640 1 -- 172.21.15.17:0/4119471696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef78e495b0 con 0x55ef78e4eca0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.973+0000 7f66fe7df640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 0x55ef78e5e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f66fdfde640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f66f4011fd0 tx=0x7f66f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b99e7363bd02468 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f66e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f403e060 con 0x55ef78e4eca0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66f4005240 con 0x55ef78e4eca0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f0003e50 con 0x55ef78e4eca0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66f402a040 con 0x55ef78e4eca0 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f670261b740 10 client.15450 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.974+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef78e4a860 con 0x55ef78e4eca0 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "e7bde6a4-9738-4d71-a97d-a5bde834d665": { 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "e7bde6a4-9738-4d71-a97d-a5bde834d665", 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:43:23.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66f0036040 con 0x55ef78e4eca0 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f66f4036070 con 0x55ef78e4eca0 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 20 client.15450 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78eee760 0x55ef78ef0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 4 client.15450 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f66f0003e50 con 0x55ef78eee760 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78eee760 0x55ef78ef0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f66e17fa640 10 client.15450 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.975+0000 7f66fd7dd640 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78eee760 0x55ef78ef0b50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458a4ea06037e82d server_cookie=e1761e7e9dc34578 in_seq=0 out_seq=0 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f66e17fa640 1 -- 172.21.15.17:0/4119471696 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f66f0003e50 con 0x55ef78eee760 2024-09-10T11:43:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f66e17fa640 10 client.15450 handle_command_reply: tid=0 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 client.15450 shutdown 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 msgr2=0x55ef78e5dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f66f4011fd0 tx=0x7f66f4017000 comp rx=0 tx=0).stop 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 shutdown_connections 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ef78eee760 0x55ef78ef0b50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef78e4f5c0 0x55ef78e5e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ef78e59e80 0x55ef78e5e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 --2- 172.21.15.17:0/4119471696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef78e4eca0 0x55ef78e5dcb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f66e17fa640 0 client.15450 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 >> 172.21.15.17:0/4119471696 conn(0x55ef78e4b230 msgr2=0x55ef78e41380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 shutdown_connections 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 1 -- 172.21.15.17:0/4119471696 wait complete. 2024-09-10T11:43:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.976+0000 7f670261b740 20 client.15450 trim_cache size 0 max 16384 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 msgr2=0x7f66e40a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 0x7f66e40a9510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66f400abe0 tx=0x7f66f400a2d0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 msgr2=0x7f66f8196670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d740 tx=0x7f66e800db40 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 shutdown_connections 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66e40a7050 0x7f66e40a9510 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66f81082a0 0x7f66f819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66f81036e0 0x7f66f8196670 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 --2- 172.21.15.17:0/383017828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f8102d30 0x7f66f8196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 >> 172.21.15.17:0/383017828 conn(0x7f66f80fc7d0 msgr2=0x7f66f80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 shutdown_connections 2024-09-10T11:43:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:23.977+0000 7f6700242640 1 -- 172.21.15.17:0/383017828 wait complete. 2024-09-10T11:43:24.784 INFO:tasks.cephfs.filesystem:scrub status for tag:e7bde6a4-9738-4d71-a97d-a5bde834d665 - {'path': '/', 'tag': 'e7bde6a4-9738-4d71-a97d-a5bde834d665', 'options': 'recursive,force'} 2024-09-10T11:43:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:25 smithi026 ceph-mon[34817]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:43:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:25 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:43:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:25 smithi017 ceph-mon[30817]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:43:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:25 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:43:25.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:25 smithi081 ceph-mon[35059]: pgmap v361: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T11:43:25.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:25 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:43:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:27 smithi026 ceph-mon[34817]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:27 smithi017 ceph-mon[30817]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:27 smithi081 ceph-mon[35059]: pgmap v362: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:43:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:29 smithi026 ceph-mon[34817]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:29 smithi017 ceph-mon[30817]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:29 smithi081 ceph-mon[35059]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:31 smithi026 ceph-mon[34817]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-10T11:43:31.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:31 smithi017 ceph-mon[30817]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-10T11:43:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:31 smithi081 ceph-mon[35059]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-10T11:43:33.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:33 smithi026 ceph-mon[34817]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T11:43:33.505 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:33 smithi081 ceph-mon[35059]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T11:43:33.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:33 smithi017 ceph-mon[30817]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T11:43:35.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:35 smithi026 ceph-mon[34817]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T11:43:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:35 smithi017 ceph-mon[30817]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T11:43:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:35 smithi081 ceph-mon[35059]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T11:43:37.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:37 smithi017 ceph-mon[30817]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T11:43:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:37 smithi081 ceph-mon[35059]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T11:43:37.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:37 smithi026 ceph-mon[34817]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T11:43:38.577 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 92% (11706/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.335 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-10T11:43:39.336 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T11:43:39.341 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T11:43:39.463 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T11:43:39.465 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T11:43:39.465 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T11:43:39.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:39 smithi017 ceph-mon[30817]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:39 smithi081 ceph-mon[35059]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:39 smithi026 ceph-mon[34817]: pgmap v368: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2024-09-10T11:43:40.139 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T11:43:40.212 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T11:43:40.254 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T11:43:40.256 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T11:43:40.256 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T11:43:40.296 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T11:43:40.300 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:43:40.300 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T11:43:40.317 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-10T11:43:40.318 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-10T11:43:40.319 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T11:43:40.379 INFO:tasks.workunit.client.0.smithi017.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T11:43:40.380 INFO:tasks.workunit.client.0.smithi017.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-10T11:43:40.380 INFO:tasks.workunit.client.0.smithi017.stderr:+ trap -- retry EXIT 2024-09-10T11:43:40.380 INFO:tasks.workunit.client.0.smithi017.stderr:+ rm -rf ffsb 2024-09-10T11:43:40.381 INFO:tasks.workunit.client.0.smithi017.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-10T11:43:40.384 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into 'ffsb'... 2024-09-10T11:43:41.219 INFO:tasks.workunit.client.0.smithi017.stderr:+ trap - EXIT 2024-09-10T11:43:41.219 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd ffsb 2024-09-10T11:43:41.219 INFO:tasks.workunit.client.0.smithi017.stderr:+ ./configure 2024-09-10T11:43:41.344 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T11:43:41.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:41 smithi017 ceph-mon[30817]: pgmap v369: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:41.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:41 smithi081 ceph-mon[35059]: pgmap v369: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:41 smithi026 ceph-mon[34817]: pgmap v369: 97 pgs: 97 active+clean; 661 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T11:43:42.352 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether build environment is sane... yes 2024-09-10T11:43:42.362 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T11:43:42.362 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gawk... gawk 2024-09-10T11:43:42.378 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T11:43:42.413 INFO:tasks.workunit.client.0.smithi017.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T11:43:42.413 INFO:tasks.workunit.client.0.smithi017.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T11:43:42.426 INFO:tasks.workunit.client.0.smithi017.stdout:checking for style of include used by make... GNU 2024-09-10T11:43:42.431 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc... gcc 2024-09-10T11:43:42.490 INFO:tasks.workunit.client.0.smithi017.stdout:checking for C compiler default output file name... a.out 2024-09-10T11:43:42.492 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether the C compiler works... yes 2024-09-10T11:43:42.495 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are cross compiling... no 2024-09-10T11:43:42.534 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of executables... 2024-09-10T11:43:42.570 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of object files... o 2024-09-10T11:43:42.605 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T11:43:42.640 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc accepts -g... yes 2024-09-10T11:43:42.712 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T11:43:42.815 INFO:tasks.workunit.client.0.smithi017.stdout:checking dependency style of gcc... gcc3 2024-09-10T11:43:42.881 INFO:tasks.workunit.client.0.smithi017.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T11:43:42.922 INFO:tasks.workunit.client.0.smithi017.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T11:43:42.923 INFO:tasks.workunit.client.0.smithi017.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T11:43:42.932 INFO:tasks.workunit.client.0.smithi017.stdout:checking for AIX... no 2024-09-10T11:43:42.950 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc... (cached) gcc 2024-09-10T11:43:42.959 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T11:43:42.959 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T11:43:42.959 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T11:43:42.959 INFO:tasks.workunit.client.0.smithi017.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T11:43:43.025 INFO:tasks.workunit.client.0.smithi017.stdout:checking for main in -lm... yes 2024-09-10T11:43:43.075 INFO:tasks.workunit.client.0.smithi017.stdout:checking for main in -lpthread... yes 2024-09-10T11:43:43.225 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ANSI C header files... yes 2024-09-10T11:43:43.302 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T11:43:43.346 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/types.h... yes 2024-09-10T11:43:43.390 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/stat.h... yes 2024-09-10T11:43:43.435 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdlib.h... yes 2024-09-10T11:43:43.481 INFO:tasks.workunit.client.0.smithi017.stdout:checking for string.h... yes 2024-09-10T11:43:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:43 smithi017 ceph-mon[30817]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 106 KiB/s wr, 15 op/s 2024-09-10T11:43:43.527 INFO:tasks.workunit.client.0.smithi017.stdout:checking for memory.h... yes 2024-09-10T11:43:43.575 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strings.h... yes 2024-09-10T11:43:43.621 INFO:tasks.workunit.client.0.smithi017.stdout:checking for inttypes.h... yes 2024-09-10T11:43:43.668 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdint.h... yes 2024-09-10T11:43:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:43 smithi081 ceph-mon[35059]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 106 KiB/s wr, 15 op/s 2024-09-10T11:43:43.716 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... yes 2024-09-10T11:43:43.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:43 smithi026 ceph-mon[34817]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 106 KiB/s wr, 15 op/s 2024-09-10T11:43:43.770 INFO:tasks.workunit.client.0.smithi017.stdout:checking pthread.h usability... yes 2024-09-10T11:43:43.792 INFO:tasks.workunit.client.0.smithi017.stdout:checking pthread.h presence... yes 2024-09-10T11:43:43.792 INFO:tasks.workunit.client.0.smithi017.stdout:checking for pthread.h... yes 2024-09-10T11:43:43.843 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h usability... yes 2024-09-10T11:43:43.866 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h presence... yes 2024-09-10T11:43:43.866 INFO:tasks.workunit.client.0.smithi017.stdout:checking for fcntl.h... yes 2024-09-10T11:43:43.923 INFO:tasks.workunit.client.0.smithi017.stdout:checking limits.h usability... yes 2024-09-10T11:43:43.946 INFO:tasks.workunit.client.0.smithi017.stdout:checking limits.h presence... yes 2024-09-10T11:43:43.946 INFO:tasks.workunit.client.0.smithi017.stdout:checking for limits.h... yes 2024-09-10T11:43:43.961 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdint.h... (cached) yes 2024-09-10T11:43:44.012 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h usability... yes 2024-09-10T11:43:44.035 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h presence... yes 2024-09-10T11:43:44.036 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/time.h... yes 2024-09-10T11:43:44.050 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... (cached) yes 2024-09-10T11:43:44.096 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/vfs.h usability... yes 2024-09-10T11:43:44.116 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/vfs.h presence... yes 2024-09-10T11:43:44.117 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/vfs.h... yes 2024-09-10T11:43:44.162 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/limits.h usability... no 2024-09-10T11:43:44.182 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/limits.h presence... no 2024-09-10T11:43:44.183 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/limits.h... no 2024-09-10T11:43:44.215 INFO:tasks.workunit.client.0.smithi017.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T11:43:44.248 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T11:43:44.249 INFO:tasks.workunit.client.0.smithi017.stdout:checking for function prototypes... yes 2024-09-10T11:43:44.276 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether setvbuf arguments are reversed... no 2024-09-10T11:43:44.347 INFO:tasks.workunit.client.0.smithi017.stdout:checking for system... yes 2024-09-10T11:43:44.409 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gettimeofday... yes 2024-09-10T11:43:44.471 INFO:tasks.workunit.client.0.smithi017.stdout:checking for mkdir... yes 2024-09-10T11:43:44.536 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strerror... yes 2024-09-10T11:43:44.603 INFO:tasks.workunit.client.0.smithi017.stdout:checking for open64... yes 2024-09-10T11:43:44.671 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stat64... yes 2024-09-10T11:43:44.732 INFO:tasks.workunit.client.0.smithi017.stdout:checking for fseeko64... yes 2024-09-10T11:43:44.793 INFO:tasks.workunit.client.0.smithi017.stdout:checking for lrand48_r... yes 2024-09-10T11:43:44.853 INFO:tasks.workunit.client.0.smithi017.stdout:checking for srand48_r... yes 2024-09-10T11:43:44.876 INFO:tasks.workunit.client.0.smithi017.stdout:configure: creating ./config.status 2024-09-10T11:43:44.973 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating Makefile 2024-09-10T11:43:44.986 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating config.h 2024-09-10T11:43:45.003 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: executing depfiles commands 2024-09-10T11:43:45.051 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: executing default commands 2024-09-10T11:43:45.091 INFO:tasks.workunit.client.0.smithi017.stderr:+ make 2024-09-10T11:43:45.097 INFO:tasks.workunit.client.0.smithi017.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-10T11:43:45.099 INFO:tasks.workunit.client.0.smithi017.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-10T11:43:45.100 INFO:tasks.workunit.client.0.smithi017.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-10T11:43:45.100 INFO:tasks.workunit.client.0.smithi017.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-10T11:43:45.100 INFO:tasks.workunit.client.0.smithi017.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-10T11:43:45.100 INFO:tasks.workunit.client.0.smithi017.stderr: any GNU archive site. 2024-09-10T11:43:45.102 INFO:tasks.workunit.client.0.smithi017.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-10T11:43:45.103 INFO:tasks.workunit.client.0.smithi017.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-10T11:43:45.104 INFO:tasks.workunit.client.0.smithi017.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-10T11:43:45.104 INFO:tasks.workunit.client.0.smithi017.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-10T11:43:45.104 INFO:tasks.workunit.client.0.smithi017.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-10T11:43:45.104 INFO:tasks.workunit.client.0.smithi017.stderr: Grab them from any GNU archive site. 2024-09-10T11:43:45.144 INFO:tasks.workunit.client.0.smithi017.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-10T11:43:45.422 INFO:tasks.workunit.client.0.smithi017.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-10T11:43:45.423 INFO:tasks.workunit.client.0.smithi017.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-10T11:43:45.423 INFO:tasks.workunit.client.0.smithi017.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-10T11:43:45.423 INFO:tasks.workunit.client.0.smithi017.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-10T11:43:45.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:45 smithi017 ceph-mon[30817]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-10T11:43:45.545 INFO:tasks.workunit.client.0.smithi017.stdout:/bin/sh ./config.status --recheck 2024-09-10T11:43:45.677 INFO:tasks.workunit.client.0.smithi017.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-10T11:43:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:45 smithi081 ceph-mon[35059]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-10T11:43:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:45 smithi026 ceph-mon[34817]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-10T11:43:45.773 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T11:43:46.779 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether build environment is sane... yes 2024-09-10T11:43:46.784 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T11:43:46.784 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gawk... gawk 2024-09-10T11:43:46.811 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T11:43:46.842 INFO:tasks.workunit.client.0.smithi017.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T11:43:46.842 INFO:tasks.workunit.client.0.smithi017.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T11:43:46.856 INFO:tasks.workunit.client.0.smithi017.stdout:checking for style of include used by make... GNU 2024-09-10T11:43:46.861 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc... gcc 2024-09-10T11:43:46.940 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether the C compiler works... yes 2024-09-10T11:43:46.940 INFO:tasks.workunit.client.0.smithi017.stdout:checking for C compiler default output file name... a.out 2024-09-10T11:43:46.978 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of executables... 2024-09-10T11:43:47.019 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are cross compiling... no 2024-09-10T11:43:47.059 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of object files... o 2024-09-10T11:43:47.086 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T11:43:47.113 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc accepts -g... yes 2024-09-10T11:43:47.152 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T11:43:47.267 INFO:tasks.workunit.client.0.smithi017.stdout:checking dependency style of gcc... gcc3 2024-09-10T11:43:47.317 INFO:tasks.workunit.client.0.smithi017.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T11:43:47.369 INFO:tasks.workunit.client.0.smithi017.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T11:43:47.370 INFO:tasks.workunit.client.0.smithi017.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T11:43:47.497 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ANSI C header files... yes 2024-09-10T11:43:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:47 smithi017 ceph-mon[30817]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 107 KiB/s wr, 15 op/s 2024-09-10T11:43:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:43:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.530 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/types.h... yes 2024-09-10T11:43:47.567 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/stat.h... yes 2024-09-10T11:43:47.605 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdlib.h... yes 2024-09-10T11:43:47.645 INFO:tasks.workunit.client.0.smithi017.stdout:checking for string.h... yes 2024-09-10T11:43:47.683 INFO:tasks.workunit.client.0.smithi017.stdout:checking for memory.h... yes 2024-09-10T11:43:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:47 smithi081 ceph-mon[35059]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 107 KiB/s wr, 15 op/s 2024-09-10T11:43:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:43:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.721 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strings.h... yes 2024-09-10T11:43:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:47 smithi026 ceph-mon[34817]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 107 KiB/s wr, 15 op/s 2024-09-10T11:43:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:43:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:47.760 INFO:tasks.workunit.client.0.smithi017.stdout:checking for inttypes.h... yes 2024-09-10T11:43:47.803 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdint.h... yes 2024-09-10T11:43:47.845 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... yes 2024-09-10T11:43:47.887 INFO:tasks.workunit.client.0.smithi017.stdout:checking minix/config.h usability... no 2024-09-10T11:43:47.915 INFO:tasks.workunit.client.0.smithi017.stdout:checking minix/config.h presence... no 2024-09-10T11:43:47.915 INFO:tasks.workunit.client.0.smithi017.stdout:checking for minix/config.h... no 2024-09-10T11:43:47.951 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-10T11:43:47.951 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc... (cached) gcc 2024-09-10T11:43:47.985 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T11:43:47.986 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T11:43:47.986 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T11:43:47.986 INFO:tasks.workunit.client.0.smithi017.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T11:43:48.027 INFO:tasks.workunit.client.0.smithi017.stdout:checking for main in -lm... yes 2024-09-10T11:43:48.071 INFO:tasks.workunit.client.0.smithi017.stdout:checking for main in -lpthread... yes 2024-09-10T11:43:48.072 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ANSI C header files... (cached) yes 2024-09-10T11:43:48.104 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T11:43:48.163 INFO:tasks.workunit.client.0.smithi017.stdout:checking pthread.h usability... yes 2024-09-10T11:43:48.181 INFO:tasks.workunit.client.0.smithi017.stdout:checking pthread.h presence... yes 2024-09-10T11:43:48.181 INFO:tasks.workunit.client.0.smithi017.stdout:checking for pthread.h... yes 2024-09-10T11:43:48.227 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h usability... yes 2024-09-10T11:43:48.243 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h presence... yes 2024-09-10T11:43:48.243 INFO:tasks.workunit.client.0.smithi017.stdout:checking for fcntl.h... yes 2024-09-10T11:43:48.290 INFO:tasks.workunit.client.0.smithi017.stdout:checking limits.h usability... yes 2024-09-10T11:43:48.307 INFO:tasks.workunit.client.0.smithi017.stdout:checking limits.h presence... yes 2024-09-10T11:43:48.307 INFO:tasks.workunit.client.0.smithi017.stdout:checking for limits.h... yes 2024-09-10T11:43:48.320 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdint.h... (cached) yes 2024-09-10T11:43:48.357 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h usability... yes 2024-09-10T11:43:48.373 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h presence... yes 2024-09-10T11:43:48.373 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/time.h... yes 2024-09-10T11:43:48.391 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... (cached) yes 2024-09-10T11:43:48.428 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/vfs.h usability... yes 2024-09-10T11:43:48.444 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/vfs.h presence... yes 2024-09-10T11:43:48.444 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/vfs.h... yes 2024-09-10T11:43:48.496 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/limits.h usability... no 2024-09-10T11:43:48.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:43:48.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:43:48.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:48 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:48.524 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/limits.h presence... no 2024-09-10T11:43:48.524 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/limits.h... no 2024-09-10T11:43:48.549 INFO:tasks.workunit.client.0.smithi017.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T11:43:48.577 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T11:43:48.634 INFO:tasks.workunit.client.0.smithi017.stdout:checking for system... yes 2024-09-10T11:43:48.689 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gettimeofday... yes 2024-09-10T11:43:48.702 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:43:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:43:48.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:48 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:48.743 INFO:tasks.workunit.client.0.smithi017.stdout:checking for mkdir... yes 2024-09-10T11:43:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:43:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:43:48.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:48 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:43:48.803 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strerror... yes 2024-09-10T11:43:48.857 INFO:tasks.workunit.client.0.smithi017.stdout:checking for open64... yes 2024-09-10T11:43:48.912 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stat64... yes 2024-09-10T11:43:48.966 INFO:tasks.workunit.client.0.smithi017.stdout:checking for fseeko64... yes 2024-09-10T11:43:49.021 INFO:tasks.workunit.client.0.smithi017.stdout:checking for lrand48_r... yes 2024-09-10T11:43:49.078 INFO:tasks.workunit.client.0.smithi017.stdout:checking for srand48_r... yes 2024-09-10T11:43:49.101 INFO:tasks.workunit.client.0.smithi017.stdout:configure: creating ./config.status 2024-09-10T11:43:49.159 INFO:tasks.workunit.client.0.smithi017.stdout: /bin/sh ./config.status 2024-09-10T11:43:49.205 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating Makefile 2024-09-10T11:43:49.217 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating config.h 2024-09-10T11:43:49.237 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: executing depfiles commands 2024-09-10T11:43:49.248 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: executing default commands 2024-09-10T11:43:49.273 INFO:tasks.workunit.client.0.smithi017.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-10T11:43:49.424 INFO:tasks.workunit.client.0.smithi017.stdout:rm -f stamp-h1 2024-09-10T11:43:49.426 INFO:tasks.workunit.client.0.smithi017.stdout:touch config.h.in 2024-09-10T11:43:49.427 INFO:tasks.workunit.client.0.smithi017.stdout:cd . && /bin/sh ./config.status config.h 2024-09-10T11:43:49.468 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating config.h 2024-09-10T11:43:49.492 INFO:tasks.workunit.client.0.smithi017.stdout:make all-am 2024-09-10T11:43:49.496 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T11:43:49.497 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-10T11:43:49.675 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-10T11:43:49.679 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-10T11:43:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:49 smithi081 ceph-mon[35059]: pgmap v373: 97 pgs: 97 active+clean; 4.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 359 KiB/s wr, 39 op/s 2024-09-10T11:43:49.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:49 smithi026 ceph-mon[34817]: pgmap v373: 97 pgs: 97 active+clean; 4.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 359 KiB/s wr, 39 op/s 2024-09-10T11:43:49.767 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-10T11:43:49.771 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-10T11:43:49.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:49 smithi017 ceph-mon[30817]: pgmap v373: 97 pgs: 97 active+clean; 4.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 359 KiB/s wr, 39 op/s 2024-09-10T11:43:49.856 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-10T11:43:49.859 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-10T11:43:49.948 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-10T11:43:49.952 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-10T11:43:50.075 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-10T11:43:50.078 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-10T11:43:50.129 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-10T11:43:50.131 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-10T11:43:50.173 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-10T11:43:50.176 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-10T11:43:50.222 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-10T11:43:50.225 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-10T11:43:50.431 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-10T11:43:50.434 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-10T11:43:50.580 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-10T11:43:50.583 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-10T11:43:50.736 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-10T11:43:50.738 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-10T11:43:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-10T11:43:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-10T11:43:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-10T11:43:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-10T11:43:50.989 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-10T11:43:50.992 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr:In file included from parser.h:22, 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr: from parser.c:25: 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c: In function ‘init_filesys’: 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.021 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.022 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.023 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.024 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.025 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-10T11:43:51.026 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.027 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.028 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.029 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: | ^ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T11:43:51.030 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: 36 | container_of(ptr, type, member) 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T11:43:51.031 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c: In function ‘get_optstr’: 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:200:14: note: source object declared here 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr: 200 | char temp[BUFSIZE]; 2024-09-10T11:43:51.069 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~ 2024-09-10T11:43:51.075 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c: In function ‘size64_convert’: 2024-09-10T11:43:51.075 INFO:tasks.workunit.client.0.smithi017.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-10T11:43:51.076 INFO:tasks.workunit.client.0.smithi017.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-10T11:43:51.076 INFO:tasks.workunit.client.0.smithi017.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-10T11:43:51.370 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-10T11:43:51.373 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-10T11:43:51.429 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-10T11:43:51.432 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-10T11:43:51.524 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-10T11:43:51.527 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-10T11:43:51.558 INFO:tasks.workunit.client.0.smithi017.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-10T11:43:51.561 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-10T11:43:51.594 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T11:43:51.595 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd .. 2024-09-10T11:43:51.595 INFO:tasks.workunit.client.0.smithi017.stderr:+ mkdir tmp 2024-09-10T11:43:51.597 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd tmp 2024-09-10T11:43:51.597 INFO:tasks.workunit.client.0.smithi017.stderr:+ for f in $mydir/*.ffsb 2024-09-10T11:43:51.597 INFO:tasks.workunit.client.0.smithi017.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-10T11:43:51.597 INFO:tasks.workunit.client.0.smithi017.stdout:FFSB version 6.0-RC2 started 2024-09-10T11:43:51.598 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.600 INFO:tasks.workunit.client.0.smithi017.stdout:benchmark time = 300 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout:ThreadGroup 0 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout:================ 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: num_threads = 32 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: read_random = off 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: read_size = 0 (0B) 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: read_blocksize = 0 (0B) 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: read_skip = off 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: read_skipsize = 0 (0B) 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: write_random = on 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: write_size = 5242880 (5MB) 2024-09-10T11:43:51.601 INFO:tasks.workunit.client.0.smithi017.stdout: fsync_file = 0 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: write_blocksize = 4096 (4KB) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: wait time = 0 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: op weights 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: read = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: readall = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: write = 1 (100.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: create = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: append = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: delete = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: metaop = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: createdir = 0 (0.00%) 2024-09-10T11:43:51.602 INFO:tasks.workunit.client.0.smithi017.stdout: stat = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: writeall = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: writeall_fsync = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: open_close = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: write_fsync = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: create_fsync = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: append_fsync = 0 (0.00%) 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout:FileSystem . 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout:========== 2024-09-10T11:43:51.603 INFO:tasks.workunit.client.0.smithi017.stdout: num_dirs = 0 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: starting files = 128 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: min file size = 104857600 (100MB) 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: max file size = 104857600 (100MB) 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: directio = off 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: alignedio = on 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: bufferedio = off 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: aging is off 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: current utilization = 0.00% 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:43:51.604 INFO:tasks.workunit.client.0.smithi017.stdout:checking existing fs: . 2024-09-10T11:43:51.605 INFO:tasks.workunit.client.0.smithi017.stdout:recreating new fileset 2024-09-10T11:43:51.605 INFO:tasks.workunit.client.0.smithi017.stderr:opendir: No such file or directory 2024-09-10T11:43:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:51 smithi081 ceph-mon[35059]: pgmap v374: 97 pgs: 97 active+clean; 5.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 441 KiB/s wr, 56 op/s 2024-09-10T11:43:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:51 smithi026 ceph-mon[34817]: pgmap v374: 97 pgs: 97 active+clean; 5.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 441 KiB/s wr, 56 op/s 2024-09-10T11:43:51.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:51 smithi017 ceph-mon[30817]: pgmap v374: 97 pgs: 97 active+clean; 5.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 441 KiB/s wr, 56 op/s 2024-09-10T11:43:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:53 smithi081 ceph-mon[35059]: pgmap v375: 97 pgs: 97 active+clean; 5.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 506 KiB/s wr, 61 op/s 2024-09-10T11:43:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:53 smithi026 ceph-mon[34817]: pgmap v375: 97 pgs: 97 active+clean; 5.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 506 KiB/s wr, 61 op/s 2024-09-10T11:43:53.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:53 smithi017 ceph-mon[30817]: pgmap v375: 97 pgs: 97 active+clean; 5.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 506 KiB/s wr, 61 op/s 2024-09-10T11:43:54.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:54 smithi081 ceph-mon[35059]: pgmap v376: 97 pgs: 97 active+clean; 7.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 544 KiB/s wr, 82 op/s 2024-09-10T11:43:54.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:54 smithi026 ceph-mon[34817]: pgmap v376: 97 pgs: 97 active+clean; 7.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 544 KiB/s wr, 82 op/s 2024-09-10T11:43:54.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:54 smithi017 ceph-mon[30817]: pgmap v376: 97 pgs: 97 active+clean; 7.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 544 KiB/s wr, 82 op/s 2024-09-10T11:43:54.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:43:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:56.882 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:56 smithi017 ceph-mon[30817]: pgmap v377: 97 pgs: 97 active+clean; 160 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 13 MiB/s wr, 93 op/s 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 -- 172.21.15.17:0/635110525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c1082a0 msgr2=0x7fd90c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 --2- 172.21.15.17:0/635110525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c1082a0 0x7fd90c10ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd904009cd0 tx=0x7fd90402a910 comp rx=0 tx=0).stop 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 -- 172.21.15.17:0/635110525 shutdown_connections 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 --2- 172.21.15.17:0/635110525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c1082a0 0x7fd90c10ec40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 --2- 172.21.15.17:0/635110525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1036e0 0x7fd90c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 --2- 172.21.15.17:0/635110525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c102d30 0x7fd90c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 -- 172.21.15.17:0/635110525 >> 172.21.15.17:0/635110525 conn(0x7fd90c0fc7d0 msgr2=0x7fd90c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 -- 172.21.15.17:0/635110525 shutdown_connections 2024-09-10T11:43:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.878+0000 7fd9119d6640 1 -- 172.21.15.17:0/635110525 wait complete. 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.879+0000 7fd9119d6640 1 Processor -- start 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 -- start start 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c102d30 0x7fd90c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c1036e0 0x7fd90c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c112170 con 0x7fd90c1082a0 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c111ff0 con 0x7fd90c102d30 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.880+0000 7fd9119d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c1122f0 con 0x7fd90c1036e0 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42920/0 (socket says 172.21.15.17:42920) 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 -- 172.21.15.17:0/1696743938 learned_addr learned my addr 172.21.15.17:0/1696743938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 -- 172.21.15.17:0/1696743938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c1036e0 msgr2=0x7fd90c100ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:43:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c1036e0 0x7fd90c100ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 -- 172.21.15.17:0/1696743938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c102d30 msgr2=0x7fd90c100990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c102d30 0x7fd90c100990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.881+0000 7fd90b7fe640 1 -- 172.21.15.17:0/1696743938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c1aaf80 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.882+0000 7fd90b7fe640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd904005e30 tx=0x7fd904003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.882+0000 7fd9109d4640 1 -- 172.21.15.17:0/1696743938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904031660 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.882+0000 7fd9109d4640 1 -- 172.21.15.17:0/1696743938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd904031800 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.882+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c1ab1b0 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.882+0000 7fd9109d4640 1 -- 172.21.15.17:0/1696743938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90402fae0 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.883+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c1ab630 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.887+0000 7fd9109d4640 1 -- 172.21.15.17:0/1696743938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd90402fc80 con 0x7fd90c1082a0 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.887+0000 7fd913daf740 1 Processor -- start 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.888+0000 7fd913daf740 1 -- start start 2024-09-10T11:43:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.888+0000 7fd913daf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.888+0000 7fd913daf740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba268140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd913daf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba26aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd913daf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba1c32e0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd913daf740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba16ace0 con 0x55f7ba25ddc0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd913daf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba1bf2a0 con 0x55f7ba268680 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd9109d4640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 0x7fd8f40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.889+0000 7fd9109d4640 1 -- 172.21.15.17:0/1696743938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd9040f04f0 con 0x7fd90c1082a0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.890+0000 7fd90b7fe640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 0x7fd8f40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.890+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.891+0000 7fd90b7fe640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 0x7fd8f40a5190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9040b9730 tx=0x7fd9040095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.891+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42936/0 (socket says 172.21.15.17:42936) 2024-09-10T11:43:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.891+0000 7fd90a7fc640 1 -- 172.21.15.17:0/476172351 learned_addr learned my addr 172.21.15.17:0/476172351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.891+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba26aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.892+0000 7fd90affd640 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba268140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.893+0000 7fd90a7fc640 1 -- 172.21.15.17:0/476172351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 msgr2=0x55f7ba26aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.893+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba26aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.893+0000 7fd90a7fc640 1 -- 172.21.15.17:0/476172351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 msgr2=0x55f7ba268140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.893+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba268140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.893+0000 7fd90a7fc640 1 -- 172.21.15.17:0/476172351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ba14f440 con 0x55f7ba25d4a0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.894+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0697d0 tx=0x7fd9000095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8077c969eeb38450 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.896+0000 7fd8f1ffb640 1 -- 172.21.15.17:0/476172351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004030 con 0x55f7ba25d4a0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.896+0000 7fd8f1ffb640 1 -- 172.21.15.17:0/476172351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9000041d0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.896+0000 7fd8f1ffb640 1 -- 172.21.15.17:0/476172351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90000f6e0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 -- 172.21.15.17:0/476172351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 msgr2=0x55f7ba25d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0697d0 tx=0x7fd9000095d0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 -- 172.21.15.17:0/476172351 shutdown_connections 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba26aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba268140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 --2- 172.21.15.17:0/476172351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25d4a0 0x55f7ba25d880 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.897+0000 7fd913daf740 1 -- 172.21.15.17:0/476172351 >> 172.21.15.17:0/476172351 conn(0x55f7ba259a30 msgr2=0x55f7ba259e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.898+0000 7fd913daf740 1 -- 172.21.15.17:0/476172351 shutdown_connections 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.898+0000 7fd913daf740 1 -- 172.21.15.17:0/476172351 wait complete. 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.898+0000 7fd913daf740 1 -- start start 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.898+0000 7fd913daf740 1 Processor -- start 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 0x55f7ba268040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba2652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba2658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba26b250 con 0x55f7ba268680 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba17e050 con 0x55f7ba25ddc0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f7ba26b3d0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd913daf740 10 client.0 _ll_register_callbacks cb 0x55f7ba1be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd90affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba2652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 0x55f7ba268040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd90affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba2652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38516/0 (socket says 172.21.15.17:38516) 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.899+0000 7fd90affd640 1 -- 172.21.15.17:0/2451713861 learned_addr learned my addr 172.21.15.17:0/2451713861 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.900+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2451713861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 msgr2=0x55f7ba2652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.900+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba2652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.900+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2451713861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 msgr2=0x55f7ba2658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.900+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba2658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.900+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2451713861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b9f343c0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.901+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 0x55f7ba268040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0697d0 tx=0x7fd900009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fcb446534c4254b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.901+0000 7fd8eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.901+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004380 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.901+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd9000035f0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.901+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9000041d0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd9000037f0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 10 client.25117 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ba2746c0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9000041d0 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd90004b070 con 0x55f7ba25d4a0 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 10 client.25117 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 10 client.25117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 20 client.25117 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba275ad0 0x55f7ba277f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 4 client.25117 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.902+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7ba1d0850 con 0x55f7ba275ad0 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.903+0000 7fd90affd640 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba275ad0 0x55f7ba277f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.906+0000 7fd8eaffd640 10 client.25117 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.906+0000 7fd90affd640 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba275ad0 0x55f7ba277f10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293ccce2086b8ced server_cookie=b458ac1781b48b79 in_seq=0 out_seq=0 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.908+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2451713861 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7ba1d0850 con 0x55f7ba275ad0 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.908+0000 7fd8eaffd640 10 client.25117 handle_command_reply: tid=0 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.908+0000 7fd913daf740 1 client.25117 shutdown 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 msgr2=0x55f7ba268040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 0x55f7ba268040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0697d0 tx=0x7fd900009530 comp rx=0 tx=0).stop 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 shutdown_connections 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba275ad0 0x55f7ba277f10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba2658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba25ddc0 0x55f7ba2652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 --2- 172.21.15.17:0/2451713861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25d4a0 0x55f7ba268040 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0697d0 tx=0x7fd900009530 comp rx=0 tx=0).stop 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 >> 172.21.15.17:0/2451713861 conn(0x55f7ba259a30 msgr2=0x55f7ba25f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd8eaffd640 0 client.25117 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 shutdown_connections 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 1 -- 172.21.15.17:0/2451713861 wait complete. 2024-09-10T11:43:56.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.909+0000 7fd913daf740 20 client.25117 trim_cache size 0 max 16384 2024-09-10T11:43:56.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:56 smithi081 ceph-mon[35059]: pgmap v377: 97 pgs: 97 active+clean; 160 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 13 MiB/s wr, 93 op/s 2024-09-10T11:43:56.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 Processor -- start 2024-09-10T11:43:56.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 -- start start 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25ddc0 0x55f7ba264bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba258a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c073e70 con 0x55f7ba268680 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c1ace80 con 0x55f7ba260900 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.963+0000 7fd913daf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c1aba10 con 0x55f7ba25ddc0 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.964+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.964+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38526/0 (socket says 172.21.15.17:38526) 2024-09-10T11:43:56.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.964+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2871834134 learned_addr learned my addr 172.21.15.17:0/2871834134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.964+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25ddc0 0x55f7ba264bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.965+0000 7fd90affd640 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba258a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.966+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2871834134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25ddc0 msgr2=0x55f7ba264bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.966+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25ddc0 0x55f7ba264bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.966+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2871834134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 msgr2=0x55f7ba258a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.966+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba258a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.966+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2871834134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ba2642a0 con 0x55f7ba260900 2024-09-10T11:43:56.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.968+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd900012920 tx=0x7fd900003990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f9575451c488a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.970+0000 7fd8f17fa640 1 -- 172.21.15.17:0/2871834134 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900051040 con 0x55f7ba260900 2024-09-10T11:43:56.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.970+0000 7fd8f17fa640 1 -- 172.21.15.17:0/2871834134 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd900046020 con 0x55f7ba260900 2024-09-10T11:43:56.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.971+0000 7fd8f17fa640 1 -- 172.21.15.17:0/2871834134 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90000f790 con 0x55f7ba260900 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 -- 172.21.15.17:0/2871834134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 msgr2=0x55f7ba285180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd900012920 tx=0x7fd900003990 comp rx=0 tx=0).stop 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 -- 172.21.15.17:0/2871834134 shutdown_connections 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba285180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba268680 0x55f7ba258a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 --2- 172.21.15.17:0/2871834134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba25ddc0 0x55f7ba264bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.973+0000 7fd913daf740 1 -- 172.21.15.17:0/2871834134 >> 172.21.15.17:0/2871834134 conn(0x55f7ba259a30 msgr2=0x55f7ba258350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.974+0000 7fd913daf740 1 -- 172.21.15.17:0/2871834134 shutdown_connections 2024-09-10T11:43:56.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.974+0000 7fd913daf740 1 -- 172.21.15.17:0/2871834134 wait complete. 2024-09-10T11:43:56.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.975+0000 7fd913daf740 1 -- start start 2024-09-10T11:43:56.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 Processor -- start 2024-09-10T11:43:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba2784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba2789e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c1ac7b0 con 0x55f7ba25ddc0 2024-09-10T11:43:56.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c1ac0e0 con 0x55f7ba260900 2024-09-10T11:43:56.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.976+0000 7fd913daf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c071e50 con 0x55f7ba268680 2024-09-10T11:43:56.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.977+0000 7fd913daf740 10 client.0 _ll_register_callbacks cb 0x7fd900009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:43:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba2784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42964/0 (socket says 172.21.15.17:42964) 2024-09-10T11:43:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2183367643 learned_addr learned my addr 172.21.15.17:0/2183367643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba2789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 msgr2=0x55f7ba2789e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba2789e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2183367643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 msgr2=0x55f7ba2784a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.979+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba2784a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.980+0000 7fd90a7fc640 1 -- 172.21.15.17:0/2183367643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ba265c50 con 0x55f7ba25ddc0 2024-09-10T11:43:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.980+0000 7fd90a7fc640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd900012c40 tx=0x7fd900009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e5698b8f549490 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.980+0000 7fd8eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:43:56.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.980+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90005d020 con 0x55f7ba25ddc0 2024-09-10T11:43:56.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.981+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd900046020 con 0x55f7ba25ddc0 2024-09-10T11:43:56.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.981+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd900005050 con 0x55f7ba25ddc0 2024-09-10T11:43:56.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.982+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd900051040 con 0x55f7ba25ddc0 2024-09-10T11:43:56.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.982+0000 7fd913daf740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-09-10T11:43:56.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.982+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ba2e3260 con 0x55f7ba25ddc0 2024-09-10T11:43:56.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.985+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd900046020 con 0x55f7ba25ddc0 2024-09-10T11:43:56.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd90004b070 con 0x55f7ba25ddc0 2024-09-10T11:43:56.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:43:56.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:43:56.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 20 client.15465 populate_metadata read hostname 'smithi017' 2024-09-10T11:43:56.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba2e3910 0x55f7ba2e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 4 client.15465 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:43:56.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.986+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f7ba1cad60 con 0x55f7ba2e3910 2024-09-10T11:43:56.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.987+0000 7fd90affd640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba2e3910 0x55f7ba2e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.989+0000 7fd8eaffd640 10 client.15465 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.989+0000 7fd90affd640 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba2e3910 0x55f7ba2e5d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2852e17e11595515 server_cookie=52ba28b1aca3f343 in_seq=0 out_seq=0 2024-09-10T11:43:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.989+0000 7fd8eaffd640 1 -- 172.21.15.17:0/2183367643 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f7ba1cad60 con 0x55f7ba2e3910 2024-09-10T11:43:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.989+0000 7fd8eaffd640 10 client.15465 handle_command_reply: tid=0 2024-09-10T11:43:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 client.15465 shutdown 2024-09-10T11:43:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 msgr2=0x55f7ba277f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd900012c40 tx=0x7fd900009310 comp rx=0 tx=0).stop 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 shutdown_connections 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f7ba2e3910 0x55f7ba2e5d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7ba268680 0x55f7ba2789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f7ba260900 0x55f7ba2784a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 --2- 172.21.15.17:0/2183367643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7ba25ddc0 0x55f7ba277f60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd8eaffd640 0 client.15465 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 >> 172.21.15.17:0/2183367643 conn(0x55f7ba259a30 msgr2=0x55f7ba273620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.990+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 shutdown_connections 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.991+0000 7fd913daf740 1 -- 172.21.15.17:0/2183367643 wait complete. 2024-09-10T11:43:56.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.991+0000 7fd913daf740 20 client.15465 trim_cache size 0 max 16384 2024-09-10T11:43:56.994 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:43:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:43:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:43:56.994 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.992+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 msgr2=0x7fd8f40a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.992+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 0x7fd8f40a5190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9040b9730 tx=0x7fd9040095c0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.992+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 msgr2=0x7fd90c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.992+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd904005e30 tx=0x7fd904003f10 comp rx=0 tx=0).stop 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 shutdown_connections 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd8f40a2cd0 0x7fd8f40a5190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c1036e0 0x7fd90c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd90c1082a0 0x7fd90c101410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 --2- 172.21.15.17:0/1696743938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd90c102d30 0x7fd90c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 >> 172.21.15.17:0/1696743938 conn(0x7fd90c0fc7d0 msgr2=0x7fd90c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 shutdown_connections 2024-09-10T11:43:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:56.993+0000 7fd9119d6640 1 -- 172.21.15.17:0/1696743938 wait complete. 2024-09-10T11:43:57.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:56 smithi026 ceph-mon[34817]: pgmap v377: 97 pgs: 97 active+clean; 160 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 13 MiB/s wr, 93 op/s 2024-09-10T11:43:57.897 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:43:57.898 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:43:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:43:58.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:58 smithi017 ceph-mon[30817]: pgmap v378: 97 pgs: 97 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 108 MiB/s wr, 133 op/s 2024-09-10T11:43:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 -- 172.21.15.17:0/133343813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc102d90 msgr2=0x7effcc103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 --2- 172.21.15.17:0/133343813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc102d90 0x7effcc103170 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7effbc009cd0 tx=0x7effbc02a930 comp rx=0 tx=0).stop 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 -- 172.21.15.17:0/133343813 shutdown_connections 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 --2- 172.21.15.17:0/133343813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108290 0x7effcc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 --2- 172.21.15.17:0/133343813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effcc103740 0x7effcc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 --2- 172.21.15.17:0/133343813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc102d90 0x7effcc103170 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.904+0000 7effd1010640 1 -- 172.21.15.17:0/133343813 >> 172.21.15.17:0/133343813 conn(0x7effcc0fc7d0 msgr2=0x7effcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.905+0000 7effd1010640 1 -- 172.21.15.17:0/133343813 shutdown_connections 2024-09-10T11:43:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.905+0000 7effd1010640 1 -- 172.21.15.17:0/133343813 wait complete. 2024-09-10T11:43:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.906+0000 7effd1010640 1 Processor -- start 2024-09-10T11:43:58.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.906+0000 7effd1010640 1 -- start start 2024-09-10T11:43:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effcc102d90 0x7effcc1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108290 0x7effcc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effcc112170 con 0x7effcc103740 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7effcc111ff0 con 0x7effcc102d90 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effd1010640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effcc1122f0 con 0x7effcc108290 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effca59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42986/0 (socket says 172.21.15.17:42986) 2024-09-10T11:43:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.907+0000 7effca59c640 1 -- 172.21.15.17:0/442606589 learned_addr learned my addr 172.21.15.17:0/442606589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 -- 172.21.15.17:0/442606589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108290 msgr2=0x7effcc19a780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108290 0x7effcc19a780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 -- 172.21.15.17:0/442606589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effcc102d90 msgr2=0x7effcc1a0600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effcc102d90 0x7effcc1a0600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 -- 172.21.15.17:0/442606589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc19af20 con 0x7effcc103740 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.908+0000 7effca59c640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7effc000b470 tx=0x7effc000b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:58.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.909+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0015020 con 0x7effcc103740 2024-09-10T11:43:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.909+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effc0011d70 con 0x7effcc103740 2024-09-10T11:43:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.909+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc19b210 con 0x7effcc103740 2024-09-10T11:43:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.909+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc000f340 con 0x7effcc103740 2024-09-10T11:43:58.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.909+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1a7460 con 0x7effcc103740 2024-09-10T11:43:58.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.912+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc06a7f0 con 0x7effcc103740 2024-09-10T11:43:58.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.915+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7effc0018020 con 0x7effcc103740 2024-09-10T11:43:58.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.916+0000 7effb3fff640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 0x7effb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.916+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7effc00cefe0 con 0x7effcc103740 2024-09-10T11:43:58.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.917+0000 7effcad9d640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 0x7effb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.918+0000 7effcad9d640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 0x7effb40a50c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effbc006010 tx=0x7effbc0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:58.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:58.926+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effc001f020 con 0x7effcc103740 2024-09-10T11:43:58.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:58 smithi081 ceph-mon[35059]: pgmap v378: 97 pgs: 97 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 108 MiB/s wr, 133 op/s 2024-09-10T11:43:59.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:58 smithi026 ceph-mon[34817]: pgmap v378: 97 pgs: 97 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 108 MiB/s wr, 133 op/s 2024-09-10T11:43:59.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.275+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effcc1031f0 con 0x7effcc103740 2024-09-10T11:43:59.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.275+0000 7effb3fff640 1 -- 172.21.15.17:0/442606589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11956 (secure 0 0 0) 0x7effcc1031f0 con 0x7effcc103740 2024-09-10T11:43:59.277 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:43:59.277 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-10T11:42:28:538585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:42:28.100418+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:43:59.277 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-10T11:43:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 msgr2=0x7effb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 0x7effb40a50c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7effbc006010 tx=0x7effbc0093f0 comp rx=0 tx=0).stop 2024-09-10T11:43:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 msgr2=0x7effcc1a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7effc000b470 tx=0x7effc000b930 comp rx=0 tx=0).stop 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 shutdown_connections 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7effb40a2c00 0x7effb40a50c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effcc108290 0x7effcc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effcc103740 0x7effcc1a0b40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 --2- 172.21.15.17:0/442606589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effcc102d90 0x7effcc1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 >> 172.21.15.17:0/442606589 conn(0x7effcc0fc7d0 msgr2=0x7effcc100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 shutdown_connections 2024-09-10T11:43:59.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:43:59.278+0000 7effd1010640 1 -- 172.21.15.17:0/442606589 wait complete. 2024-09-10T11:43:59.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:43:59 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/442606589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:44:00.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:43:59 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/442606589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:44:00.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:43:59 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/442606589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:44:00.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:44:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:00.923 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:00 smithi017 ceph-mon[30817]: pgmap v379: 97 pgs: 97 active+clean; 3.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 254 MiB/s wr, 187 op/s 2024-09-10T11:44:00.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:00 smithi081 ceph-mon[35059]: pgmap v379: 97 pgs: 97 active+clean; 3.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 254 MiB/s wr, 187 op/s 2024-09-10T11:44:01.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:00 smithi026 ceph-mon[34817]: pgmap v379: 97 pgs: 97 active+clean; 3.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 254 MiB/s wr, 187 op/s 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 -- 172.21.15.17:0/2535818036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 msgr2=0x7f20e810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/2535818036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e810e610 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009ca0 tx=0x7f20e002a970 comp rx=0 tx=0).stop 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 -- 172.21.15.17:0/2535818036 shutdown_connections 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/2535818036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e810e610 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/2535818036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8103660 0x7f20e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/2535818036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e8102d40 0x7f20e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 -- 172.21.15.17:0/2535818036 >> 172.21.15.17:0/2535818036 conn(0x7f20e80fc7a0 msgr2=0x7f20e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.174+0000 7f20ef2f2640 1 -- 172.21.15.17:0/2535818036 shutdown_connections 2024-09-10T11:44:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.175+0000 7f20ef2f2640 1 -- 172.21.15.17:0/2535818036 wait complete. 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.175+0000 7f20ef2f2640 1 Processor -- start 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 -- start start 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8102d40 0x7f20e8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e8103660 0x7f20e81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8111fd0 con 0x7f20e810c170 2024-09-10T11:44:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8111e50 con 0x7f20e8102d40 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ef2f2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8112150 con 0x7f20e8103660 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ed88f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ed88f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42998/0 (socket says 172.21.15.17:42998) 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ed88f640 1 -- 172.21.15.17:0/1911909025 learned_addr learned my addr 172.21.15.17:0/1911909025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.176+0000 7f20ed08e640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8102d40 0x7f20e8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 -- 172.21.15.17:0/1911909025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e8103660 msgr2=0x7f20e81989b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e8103660 0x7f20e81989b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 -- 172.21.15.17:0/1911909025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8102d40 msgr2=0x7f20e8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8102d40 0x7f20e8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 -- 172.21.15.17:0/1911909025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e819d420 con 0x7f20e810c170 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ed88f640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006010 tx=0x7f20e0030670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20de7fc640 1 -- 172.21.15.17:0/1911909025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0034030 con 0x7f20e810c170 2024-09-10T11:44:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e819d6b0 con 0x7f20e810c170 2024-09-10T11:44:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20de7fc640 1 -- 172.21.15.17:0/1911909025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e002f8a0 con 0x7f20e810c170 2024-09-10T11:44:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81008d0 con 0x7f20e810c170 2024-09-10T11:44:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.177+0000 7f20de7fc640 1 -- 172.21.15.17:0/1911909025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e002e7f0 con 0x7f20e810c170 2024-09-10T11:44:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20de7fc640 1 -- 172.21.15.17:0/1911909025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f20e0037020 con 0x7f20e810c170 2024-09-10T11:44:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 Processor -- start 2024-09-10T11:44:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 -- start start 2024-09-10T11:44:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d21913f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d21913fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d2190a52f0 con 0x55d21914a370 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d21904ccf0 con 0x55d21913f5d0 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.180+0000 7f20f16cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2190a12b0 con 0x55d219140b40 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20de7fc640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43002/0 (socket says 172.21.15.17:43002) 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 -- 172.21.15.17:0/3440108512 learned_addr learned my addr 172.21.15.17:0/3440108512 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ed08e640 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d21913fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ed88f640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d21913f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 -- 172.21.15.17:0/3440108512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 msgr2=0x55d21913f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d21913f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 -- 172.21.15.17:0/3440108512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 msgr2=0x55d21913fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d21913fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 -- 172.21.15.17:0/3440108512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2190313a0 con 0x55d21914a370 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20de7fc640 1 -- 172.21.15.17:0/1911909025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f20e00f0100 con 0x7f20e810c170 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20d800ceb0 tx=0x7f20d800c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e0d8cf89f136ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.181+0000 7f20ed88f640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 0x7f20d40a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20e0030040 tx=0x7f20e00b1df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20d37fe640 1 -- 172.21.15.17:0/3440108512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800edc0 con 0x55d21914a370 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20d37fe640 1 -- 172.21.15.17:0/3440108512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d8017030 con 0x55d21914a370 2024-09-10T11:44:01.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20d37fe640 1 -- 172.21.15.17:0/3440108512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8004a00 con 0x55d21914a370 2024-09-10T11:44:01.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 -- 172.21.15.17:0/3440108512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 msgr2=0x55d21914c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20d800ceb0 tx=0x7f20d800c3c0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 -- 172.21.15.17:0/3440108512 shutdown_connections 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d21914c760 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d21913fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3440108512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d21913f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 -- 172.21.15.17:0/3440108512 >> 172.21.15.17:0/3440108512 conn(0x55d219108310 msgr2=0x55d21913bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.182+0000 7f20f16cb740 1 -- 172.21.15.17:0/3440108512 shutdown_connections 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 -- 172.21.15.17:0/3440108512 wait complete. 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 -- start start 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 Processor -- start 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219149d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d21914d070 con 0x55d21914a370 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d219060060 con 0x55d21913f5d0 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d21914d1f0 con 0x55d219140b40 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.183+0000 7f20f16cb740 10 client.0 _ll_register_callbacks cb 0x55d218db38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43018/0 (socket says 172.21.15.17:43018) 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 -- 172.21.15.17:0/3732383451 learned_addr learned my addr 172.21.15.17:0/3732383451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ed08e640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 -- 172.21.15.17:0/3732383451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 msgr2=0x55d219146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 -- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 msgr2=0x55d219149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 -- 172.21.15.17:0/3732383451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d218e163c0 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ed08e640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20ec88d640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d80056f0 tx=0x7f20d80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d606402113e7de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.184+0000 7f20d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012540 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f20d8009040 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d8017030 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20d80126e0 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d219158b70 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d8017030 con 0x55d21914a370 2024-09-10T11:44:01.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20d800f040 con 0x55d21914a370 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 10 client.15483 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 20 client.15483 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d219159f20 0x55d21915c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 4 client.15483 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.185+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2190b2860 con 0x55d219159f20 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.186+0000 7f20ed08e640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d219159f20 0x55d21915c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.186+0000 7f20d0ff9640 10 client.15483 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.186+0000 7f20ed08e640 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d219159f20 0x55d21915c310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cca510e11f5d6671 server_cookie=a4b3f298312a9e12 in_seq=0 out_seq=0 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20d0ff9640 1 -- 172.21.15.17:0/3732383451 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2190b2860 con 0x55d219159f20 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20d0ff9640 10 client.15483 handle_command_reply: tid=0 2024-09-10T11:44:01.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 client.15483 shutdown 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 msgr2=0x55d2191475e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d80056f0 tx=0x7f20d80055f0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 shutdown_connections 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d219159f20 0x55d21915c310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d2191475e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 --2- 172.21.15.17:0/3732383451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 >> 172.21.15.17:0/3732383451 conn(0x55d219108310 msgr2=0x55d219141930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20d0ff9640 0 client.15483 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 shutdown_connections 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 1 -- 172.21.15.17:0/3732383451 wait complete. 2024-09-10T11:44:01.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.187+0000 7f20f16cb740 20 client.15483 trim_cache size 0 max 16384 2024-09-10T11:44:01.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.200+0000 7f20f16cb740 1 Processor -- start 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.200+0000 7f20f16cb740 1 -- start start 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d21913f5d0 0x55d2191563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21914a370 0x55d21913bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00e400 con 0x55d219140b40 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00ff40 con 0x55d21914a370 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20f16cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00ead0 con 0x55d21913f5d0 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43034/0 (socket says 172.21.15.17:43034) 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 -- 172.21.15.17:0/2058534581 learned_addr learned my addr 172.21.15.17:0/2058534581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d21913f5d0 0x55d2191563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21914a370 0x55d21913bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 -- 172.21.15.17:0/2058534581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d21913f5d0 msgr2=0x55d2191563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d21913f5d0 0x55d2191563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 -- 172.21.15.17:0/2058534581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21914a370 msgr2=0x55d21913bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21914a370 0x55d21913bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 -- 172.21.15.17:0/2058534581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d21913c180 con 0x55d219140b40 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.201+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55d219146880 tx=0x7f20e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8c20e14b5867c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20d2ffd640 1 -- 172.21.15.17:0/2058534581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4026420 con 0x55d219140b40 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20d2ffd640 1 -- 172.21.15.17:0/2058534581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4021030 con 0x55d219140b40 2024-09-10T11:44:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20d2ffd640 1 -- 172.21.15.17:0/2058534581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401d4f0 con 0x55d219140b40 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 -- 172.21.15.17:0/2058534581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 msgr2=0x55d21913b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55d219146880 tx=0x7f20e4008040 comp rx=0 tx=0).stop 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 -- 172.21.15.17:0/2058534581 shutdown_connections 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21914a370 0x55d21913bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d219140b40 0x55d21913b700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2058534581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d21913f5d0 0x55d2191563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.202+0000 7f20f16cb740 1 -- 172.21.15.17:0/2058534581 >> 172.21.15.17:0/2058534581 conn(0x55d219108310 msgr2=0x55d219146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- 172.21.15.17:0/2058534581 shutdown_connections 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- 172.21.15.17:0/2058534581 wait complete. 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- start start 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 Processor -- start 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d219144160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00f870 con 0x55d21914a370 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00f1a0 con 0x55d21913f5d0 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc00c3e0 con 0x55d219140b40 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20f16cb740 10 client.0 _ll_register_callbacks cb 0x7f20d800cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:01.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20ed08e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.203+0000 7f20ec88d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d219144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:37398/0 (socket says 172.21.15.17:37398) 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 -- 172.21.15.17:0/2130395890 learned_addr learned my addr 172.21.15.17:0/2130395890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 -- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 msgr2=0x55d219152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 -- 172.21.15.17:0/2130395890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 msgr2=0x55d219144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d219144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 -- 172.21.15.17:0/2130395890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d219144800 con 0x55d219140b40 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20ed08e640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20e4008010 tx=0x7f20e4009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87841727c40ccf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:44:01.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401d670 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e4021030 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f20e401d810 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20e401d0d0 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20f16cb740 10 client.25132 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.204+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2191c4930 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4021030 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20e402f400 con 0x55d219140b40 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 10 client.25132 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 10 client.25132 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 20 client.25132 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d2191c4f70 0x55d2191c7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 4 client.25132 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:44:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2190acd70 con 0x55d2191c4f70 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.205+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d2191c4f70 0x55d2191c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20ec88d640 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d2191c4f70 0x55d2191c7390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b2b12bdfd0ad133c server_cookie=bd6a49192423fd5b in_seq=0 out_seq=0 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20d0ff9640 10 client.25132 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20d0ff9640 1 -- 172.21.15.17:0/2130395890 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2190acd70 con 0x55d2191c4f70 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20d0ff9640 10 client.25132 handle_command_reply: tid=0 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 client.25132 shutdown 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 msgr2=0x55d219143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20e4008010 tx=0x7f20e4009b10 comp rx=0 tx=0).stop 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 shutdown_connections 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55d2191c4f70 0x55d2191c7390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d219140b40 0x55d219143c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21914a370 0x55d219144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20d0ff9640 0 client.25132 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 --2- 172.21.15.17:0/2130395890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d21913f5d0 0x55d219152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 >> 172.21.15.17:0/2130395890 conn(0x55d219108310 msgr2=0x55d219148850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 shutdown_connections 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 1 -- 172.21.15.17:0/2130395890 wait complete. 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.206+0000 7f20f16cb740 20 client.25132 trim_cache size 0 max 16384 2024-09-10T11:44:01.213 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 msgr2=0x7f20d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 0x7f20d40a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20e0030040 tx=0x7f20e00b1df0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 msgr2=0x7f20e819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20e0006010 tx=0x7f20e0030670 comp rx=0 tx=0).stop 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 shutdown_connections 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f20d40a2c00 0x7f20d40a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e8103660 0x7f20e81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20e810c170 0x7f20e819cd40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 --2- 172.21.15.17:0/1911909025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e8102d40 0x7f20e8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 >> 172.21.15.17:0/1911909025 conn(0x7f20e80fc7a0 msgr2=0x7f20e80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 shutdown_connections 2024-09-10T11:44:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:01.207+0000 7f20ef2f2640 1 -- 172.21.15.17:0/1911909025 wait complete. 2024-09-10T11:44:02.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:44:02.680 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:02.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:02 smithi081 ceph-mon[35059]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 302 MiB/s wr, 181 op/s 2024-09-10T11:44:03.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:02 smithi026 ceph-mon[34817]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 302 MiB/s wr, 181 op/s 2024-09-10T11:44:03.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:02 smithi017 ceph-mon[30817]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 302 MiB/s wr, 181 op/s 2024-09-10T11:44:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.595+0000 7f696762f640 1 -- 172.21.15.17:0/1218817724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960102790 msgr2=0x7f69601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.595+0000 7f696762f640 1 --2- 172.21.15.17:0/1218817724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960102790 0x7f69601067e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6950009900 tx=0x7f695002a410 comp rx=0 tx=0).stop 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 -- 172.21.15.17:0/1218817724 shutdown_connections 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 --2- 172.21.15.17:0/1218817724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6960106f10 0x7f696010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 --2- 172.21.15.17:0/1218817724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960102790 0x7f69601067e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 --2- 172.21.15.17:0/1218817724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6960101de0 0x7f69601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 -- 172.21.15.17:0/1218817724 >> 172.21.15.17:0/1218817724 conn(0x7f69600fd8e0 msgr2=0x7f69600ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 -- 172.21.15.17:0/1218817724 shutdown_connections 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 -- 172.21.15.17:0/1218817724 wait complete. 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 Processor -- start 2024-09-10T11:44:03.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.596+0000 7f696762f640 1 -- start start 2024-09-10T11:44:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6960102790 0x7f6960198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6960106f10 0x7f696019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112080 con 0x7f6960101de0 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6960111f00 con 0x7f6960102790 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f696762f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112200 con 0x7f6960106f10 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54528/0 (socket says 172.21.15.17:54528) 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 -- 172.21.15.17:0/3186831087 learned_addr learned my addr 172.21.15.17:0/3186831087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 -- 172.21.15.17:0/3186831087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6960106f10 msgr2=0x7f696019ced0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6960106f10 0x7f696019ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 -- 172.21.15.17:0/3186831087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6960102790 msgr2=0x7f6960198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6960102790 0x7f6960198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.597+0000 7f69653cb640 1 -- 172.21.15.17:0/3186831087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696019d5b0 con 0x7f6960101de0 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f69653cb640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f695c00b450 tx=0x7f695c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f69567fc640 1 -- 172.21.15.17:0/3186831087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c015020 con 0x7f6960101de0 2024-09-10T11:44:03.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696019d8a0 con 0x7f6960101de0 2024-09-10T11:44:03.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f69567fc640 1 -- 172.21.15.17:0/3186831087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c011d70 con 0x7f6960101de0 2024-09-10T11:44:03.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f69567fc640 1 -- 172.21.15.17:0/3186831087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c00f340 con 0x7f6960101de0 2024-09-10T11:44:03.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.598+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601a5180 con 0x7f6960101de0 2024-09-10T11:44:03.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.602+0000 7f6969a08740 1 Processor -- start 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.602+0000 7f6969a08740 1 -- start start 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2367090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2374760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b5a22cd2f0 con 0x55b5a23675d0 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b5a2274cf0 con 0x55b5a2372370 2024-09-10T11:44:03.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.603+0000 7f6969a08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5a22c92b0 con 0x55b5a2368b40 2024-09-10T11:44:03.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f69567fc640 1 -- 172.21.15.17:0/3186831087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f695c018020 con 0x7f6960101de0 2024-09-10T11:44:03.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54544/0 (socket says 172.21.15.17:54544) 2024-09-10T11:44:03.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f69653cb640 1 -- 172.21.15.17:0/3765003846 learned_addr learned my addr 172.21.15.17:0/3765003846 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:03.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f6964bca640 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2374760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.604+0000 7f6965bcc640 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2367090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 -- 172.21.15.17:0/3765003846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 msgr2=0x55b5a2367090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2367090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 -- 172.21.15.17:0/3765003846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 msgr2=0x55b5a2374760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2374760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 -- 172.21.15.17:0/3765003846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a22593a0 con 0x55b5a23675d0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69653cb640 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d2dc0 tx=0x7f695c0d7610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2505bc6aa33def9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.605+0000 7f69567fc640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 0x7f694c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.606+0000 7f694b7fe640 1 -- 172.21.15.17:0/3765003846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c0df020 con 0x55b5a23675d0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.606+0000 7f69567fc640 1 -- 172.21.15.17:0/3186831087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f695c0ceb40 con 0x7f6960101de0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.606+0000 7f6965bcc640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 0x7f694c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.606+0000 7f694b7fe640 1 -- 172.21.15.17:0/3765003846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c09bab0 con 0x55b5a23675d0 2024-09-10T11:44:03.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.606+0000 7f694b7fe640 1 -- 172.21.15.17:0/3765003846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c097650 con 0x55b5a23675d0 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.607+0000 7f6965bcc640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 0x7f694c0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6958009e20 tx=0x7f6958009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.607+0000 7f6969a08740 1 -- 172.21.15.17:0/3765003846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 msgr2=0x55b5a2367a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.607+0000 7f6969a08740 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d2dc0 tx=0x7f695c0d7610 comp rx=0 tx=0).stop 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 -- 172.21.15.17:0/3765003846 shutdown_connections 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2374760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2367a10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 --2- 172.21.15.17:0/3765003846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2367090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 -- 172.21.15.17:0/3765003846 >> 172.21.15.17:0/3765003846 conn(0x55b5a2330310 msgr2=0x55b5a2363c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 -- 172.21.15.17:0/3765003846 shutdown_connections 2024-09-10T11:44:03.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 -- 172.21.15.17:0/3765003846 wait complete. 2024-09-10T11:44:03.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.608+0000 7f6969a08740 1 -- start start 2024-09-10T11:44:03.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 Processor -- start 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2368b40 0x55b5a236f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2372370 0x55b5a236f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b5a2379480 con 0x55b5a23675d0 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b5a2288060 con 0x55b5a2368b40 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b5a2379600 con 0x55b5a2372370 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.609+0000 7f6969a08740 10 client.0 _ll_register_callbacks cb 0x55b5a1fdb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54552/0 (socket says 172.21.15.17:54552) 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 -- 172.21.15.17:0/214636652 learned_addr learned my addr 172.21.15.17:0/214636652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f6964bca640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2368b40 0x55b5a236f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f6965bcc640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2372370 0x55b5a236f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 -- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2372370 msgr2=0x55b5a236f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2372370 0x55b5a236f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 -- 172.21.15.17:0/214636652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2368b40 msgr2=0x55b5a236f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2368b40 0x55b5a236f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.610+0000 7f69653cb640 1 -- 172.21.15.17:0/214636652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a203e3c0 con 0x55b5a23675d0 2024-09-10T11:44:03.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.611+0000 7f69653cb640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d7b10 tx=0x7f695c0d2550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b26c0c4add9ec0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.611+0000 7f6948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:03.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.611+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c0df070 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.612+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f695c0d2940 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.612+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695c09bab0 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.612+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f695c09ad10 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.612+0000 7f6969a08740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.612+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5a2384f60 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c09bab0 con 0x55b5a23675d0 2024-09-10T11:44:03.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f695c0b4140 con 0x55b5a23675d0 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 10 client.15501 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 20 client.15501 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23862b0 0x55b5a23886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 4 client.15501 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.613+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5a22da860 con 0x55b5a23862b0 2024-09-10T11:44:03.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.614+0000 7f6964bca640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23862b0 0x55b5a23886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.615+0000 7f6964bca640 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23862b0 0x55b5a23886a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1733c1a4b10dc226 server_cookie=be0e5354c4cb65b6 in_seq=0 out_seq=0 2024-09-10T11:44:03.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.615+0000 7f6948ff9640 10 client.15501 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:44:03.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.616+0000 7f6948ff9640 1 -- 172.21.15.17:0/214636652 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5a22da860 con 0x55b5a23862b0 2024-09-10T11:44:03.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.616+0000 7f6948ff9640 10 client.15501 handle_command_reply: tid=0 2024-09-10T11:44:03.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.616+0000 7f6969a08740 1 client.15501 shutdown 2024-09-10T11:44:03.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 msgr2=0x55b5a2371d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d7b10 tx=0x7f695c0d2550 comp rx=0 tx=0).stop 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 shutdown_connections 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23862b0 0x55b5a23886a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2372370 0x55b5a236f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2368b40 0x55b5a236f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 --2- 172.21.15.17:0/214636652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a2371d70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.617+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 >> 172.21.15.17:0/214636652 conn(0x55b5a2330310 msgr2=0x55b5a2369960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.618+0000 7f6948ff9640 0 client.15501 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:44:03.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.618+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 shutdown_connections 2024-09-10T11:44:03.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.618+0000 7f6969a08740 1 -- 172.21.15.17:0/214636652 wait complete. 2024-09-10T11:44:03.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.618+0000 7f6969a08740 20 client.15501 trim_cache size 0 max 16384 2024-09-10T11:44:03.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.635+0000 7f6969a08740 1 Processor -- start 2024-09-10T11:44:03.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.635+0000 7f6969a08740 1 -- start start 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2363e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a236a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ab4f0 con 0x55b5a23675d0 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ad030 con 0x55b5a2372370 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6969a08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69601abbc0 con 0x55b5a2368b40 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f69653cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54558/0 (socket says 172.21.15.17:54558) 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f69653cb640 1 -- 172.21.15.17:0/1645947511 learned_addr learned my addr 172.21.15.17:0/1645947511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.636+0000 7f6964bca640 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2363e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 -- 172.21.15.17:0/1645947511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 msgr2=0x55b5a2363e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2363e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 -- 172.21.15.17:0/1645947511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 msgr2=0x55b5a236a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a236a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 -- 172.21.15.17:0/1645947511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a236fa40 con 0x55b5a23675d0 2024-09-10T11:44:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f6964bca640 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2363e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:44:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f69653cb640 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971e6865be38c60a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f694affd640 1 -- 172.21.15.17:0/1645947511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c0df070 con 0x55b5a23675d0 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f694affd640 1 -- 172.21.15.17:0/1645947511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c09bab0 con 0x55b5a23675d0 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.637+0000 7f694affd640 1 -- 172.21.15.17:0/1645947511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c09aef0 con 0x55b5a23675d0 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.638+0000 7f6969a08740 1 -- 172.21.15.17:0/1645947511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 msgr2=0x55b5a23828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.638+0000 7f6969a08740 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c010990 comp rx=0 tx=0).stop 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 -- 172.21.15.17:0/1645947511 shutdown_connections 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a2363e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a236a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 --2- 172.21.15.17:0/1645947511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a23675d0 0x55b5a23828a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 -- 172.21.15.17:0/1645947511 >> 172.21.15.17:0/1645947511 conn(0x55b5a2330310 msgr2=0x55b5a2363700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 -- 172.21.15.17:0/1645947511 shutdown_connections 2024-09-10T11:44:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.639+0000 7f6969a08740 1 -- 172.21.15.17:0/1645947511 wait complete. 2024-09-10T11:44:03.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.640+0000 7f6969a08740 1 -- start start 2024-09-10T11:44:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.640+0000 7f6969a08740 1 Processor -- start 2024-09-10T11:44:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a238b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2388b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ac960 con 0x55b5a2389080 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ac290 con 0x55b5a2372370 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69601a94d0 con 0x55b5a2368b40 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6969a08740 10 client.0 _ll_register_callbacks cb 0x7f695c0d2c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54562/0 (socket says 172.21.15.17:54562) 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 -- 172.21.15.17:0/1785924854 learned_addr learned my addr 172.21.15.17:0/1785924854 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 -- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 msgr2=0x55b5a238b7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a238b7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 -- 172.21.15.17:0/1785924854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 msgr2=0x55b5a2388b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2388b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.641+0000 7f6965bcc640 1 -- 172.21.15.17:0/1785924854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a23efbf0 con 0x55b5a2389080 2024-09-10T11:44:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.642+0000 7f6965bcc640 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6958017c30 tx=0x7f6958004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb892be3e71f2976 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.642+0000 7f6948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.643+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580168a0 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.643+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6958016a40 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.643+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695c09bab0 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6958016c40 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5a23f0db0 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6958027070 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6958022660 con 0x55b5a2389080 2024-09-10T11:44:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 10 client.15507 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 20 client.15507 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23f1580 0x55b5a23f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 4 client.15507 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.644+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f695c09bab0 con 0x55b5a23f1580 2024-09-10T11:44:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.645+0000 7f69653cb640 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23f1580 0x55b5a23f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:03.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.647+0000 7f69653cb640 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23f1580 0x55b5a23f39a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac878b42bb7406e2 server_cookie=3e25606d9726ecd8 in_seq=0 out_seq=0 2024-09-10T11:44:03.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.647+0000 7f6948ff9640 10 client.15507 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:44:03.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.648+0000 7f6948ff9640 1 -- 172.21.15.17:0/1785924854 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f695c09bab0 con 0x55b5a23f1580 2024-09-10T11:44:03.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.648+0000 7f6948ff9640 10 client.15507 handle_command_reply: tid=0 2024-09-10T11:44:03.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.648+0000 7f6969a08740 1 client.15507 shutdown 2024-09-10T11:44:03.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 msgr2=0x55b5a2389500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6958017c30 tx=0x7f6958004b50 comp rx=0 tx=0).stop 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 shutdown_connections 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55b5a23f1580 0x55b5a23f39a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5a2389080 0x55b5a2389500 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b5a2372370 0x55b5a2388b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 --2- 172.21.15.17:0/1785924854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b5a2368b40 0x55b5a238b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 >> 172.21.15.17:0/1785924854 conn(0x55b5a2330310 msgr2=0x55b5a23624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6948ff9640 0 client.15507 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:44:03.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.649+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 shutdown_connections 2024-09-10T11:44:03.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.650+0000 7f6969a08740 1 -- 172.21.15.17:0/1785924854 wait complete. 2024-09-10T11:44:03.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.650+0000 7f6969a08740 20 client.15507 trim_cache size 0 max 16384 2024-09-10T11:44:03.652 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:44:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.651+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 msgr2=0x7f694c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.651+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 0x7f694c0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6958009e20 tx=0x7f6958009410 comp rx=0 tx=0).stop 2024-09-10T11:44:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.651+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 msgr2=0x7f6960198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.651+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f695c00b450 tx=0x7f695c00b910 comp rx=0 tx=0).stop 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 shutdown_connections 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f694c0a2c00 0x7f694c0a50c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6960106f10 0x7f696019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6960102790 0x7f6960198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 --2- 172.21.15.17:0/3186831087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6960101de0 0x7f6960198600 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 >> 172.21.15.17:0/3186831087 conn(0x7f69600fd8e0 msgr2=0x7f69600fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 shutdown_connections 2024-09-10T11:44:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:03.652+0000 7f696762f640 1 -- 172.21.15.17:0/3186831087 wait complete. 2024-09-10T11:44:04.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:44:04.832 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:04.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:04 smithi081 ceph-mon[35059]: pgmap v381: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 454 MiB/s wr, 245 op/s 2024-09-10T11:44:04.970 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:04 smithi017 ceph-mon[30817]: pgmap v381: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 454 MiB/s wr, 245 op/s 2024-09-10T11:44:05.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:04 smithi026 ceph-mon[34817]: pgmap v381: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 454 MiB/s wr, 245 op/s 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.473+0000 7f458764e640 1 -- 172.21.15.17:0/1799969178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 msgr2=0x7f4580106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.473+0000 7f458764e640 1 --2- 172.21.15.17:0/1799969178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f4580106e50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f457c009930 tx=0x7f457c02a440 comp rx=0 tx=0).stop 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 -- 172.21.15.17:0/1799969178 shutdown_connections 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 --2- 172.21.15.17:0/1799969178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4580101410 0x7f458010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 --2- 172.21.15.17:0/1799969178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4580100a70 0x7f4580100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 --2- 172.21.15.17:0/1799969178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f4580106e50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 -- 172.21.15.17:0/1799969178 >> 172.21.15.17:0/1799969178 conn(0x7f45800fc7d0 msgr2=0x7f45800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 -- 172.21.15.17:0/1799969178 shutdown_connections 2024-09-10T11:44:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.474+0000 7f458764e640 1 -- 172.21.15.17:0/1799969178 wait complete. 2024-09-10T11:44:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.475+0000 7f458764e640 1 Processor -- start 2024-09-10T11:44:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.475+0000 7f458764e640 1 -- start start 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4580100a70 0x7f45801a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4580101410 0x7f45801a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4580112030 con 0x7f4580106a70 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4580111eb0 con 0x7f4580100a70 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f458764e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45801121b0 con 0x7f4580101410 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f4585beb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f4585beb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54576/0 (socket says 172.21.15.17:54576) 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.476+0000 7f4585beb640 1 -- 172.21.15.17:0/274375177 learned_addr learned my addr 172.21.15.17:0/274375177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 -- 172.21.15.17:0/274375177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4580101410 msgr2=0x7f45801a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4580101410 0x7f45801a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 -- 172.21.15.17:0/274375177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4580100a70 msgr2=0x7f45801a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4580100a70 0x7f45801a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 -- 172.21.15.17:0/274375177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458019aed0 con 0x7f4580106a70 2024-09-10T11:44:05.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f4585beb640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f457800b970 tx=0x7f457800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f45767fc640 1 -- 172.21.15.17:0/274375177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578019070 con 0x7f4580106a70 2024-09-10T11:44:05.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f45767fc640 1 -- 172.21.15.17:0/274375177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f457800cb40 con 0x7f4580106a70 2024-09-10T11:44:05.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f45767fc640 1 -- 172.21.15.17:0/274375177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578007650 con 0x7f4580106a70 2024-09-10T11:44:05.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458019b1c0 con 0x7f4580106a70 2024-09-10T11:44:05.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.477+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45801a7340 con 0x7f4580106a70 2024-09-10T11:44:05.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.481+0000 7f45767fc640 1 -- 172.21.15.17:0/274375177 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f457801c070 con 0x7f4580106a70 2024-09-10T11:44:05.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.481+0000 7f4589a27740 1 Processor -- start 2024-09-10T11:44:05.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 -- start start 2024-09-10T11:44:05.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d68a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d68aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d46d5f02f0 con 0x55d46d695370 2024-09-10T11:44:05.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d46d597cf0 con 0x55d46d68a5d0 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4589a27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d46d5ec2b0 con 0x55d46d68bb40 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f45767fc640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 0x7f456c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54586/0 (socket says 172.21.15.17:54586) 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.482+0000 7f4584be9640 1 -- 172.21.15.17:0/122185960 learned_addr learned my addr 172.21.15.17:0/122185960 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4585beb640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 0x7f456c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f45853ea640 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d68aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 -- 172.21.15.17:0/122185960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 msgr2=0x55d46d68a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d68a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 -- 172.21.15.17:0/122185960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 msgr2=0x55d46d68aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d68aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 -- 172.21.15.17:0/122185960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46d57c3a0 con 0x55d46d695370 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f45853ea640 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d68aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.483+0000 7f4584be9640 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45700017f0 tx=0x7f4570001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660d3bf345825e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.484+0000 7f456b7fe640 1 -- 172.21.15.17:0/122185960 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700074f0 con 0x55d46d695370 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.484+0000 7f456b7fe640 1 -- 172.21.15.17:0/122185960 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4570008de0 con 0x55d46d695370 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.484+0000 7f456b7fe640 1 -- 172.21.15.17:0/122185960 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570009260 con 0x55d46d695370 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.484+0000 7f4585beb640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 0x7f456c0a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4578095970 tx=0x7f45780c5a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.484+0000 7f45767fc640 1 -- 172.21.15.17:0/274375177 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f45780ce660 con 0x7f4580106a70 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 -- 172.21.15.17:0/122185960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 msgr2=0x55d46d697760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45700017f0 tx=0x7f4570001cb0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 -- 172.21.15.17:0/122185960 shutdown_connections 2024-09-10T11:44:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d697760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d68aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 --2- 172.21.15.17:0/122185960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d68a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 -- 172.21.15.17:0/122185960 >> 172.21.15.17:0/122185960 conn(0x55d46d653310 msgr2=0x55d46d686c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 -- 172.21.15.17:0/122185960 shutdown_connections 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.485+0000 7f4589a27740 1 -- 172.21.15.17:0/122185960 wait complete. 2024-09-10T11:44:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.486+0000 7f4589a27740 1 -- start start 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.486+0000 7f4589a27740 1 Processor -- start 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d692030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d695370 0x55d46d692640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d46d698070 con 0x55d46d68a5d0 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d46d5ab060 con 0x55d46d695370 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d46d6981f0 con 0x55d46d68bb40 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4589a27740 10 client.0 _ll_register_callbacks cb 0x55d46d2fe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54596/0 (socket says 172.21.15.17:54596) 2024-09-10T11:44:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.487+0000 7f4584be9640 1 -- 172.21.15.17:0/1826736036 learned_addr learned my addr 172.21.15.17:0/1826736036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d695370 0x55d46d692640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 -- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 msgr2=0x55d46d692030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d692030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 -- 172.21.15.17:0/1826736036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d695370 msgr2=0x55d46d692640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d695370 0x55d46d692640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.488+0000 7f4584be9640 1 -- 172.21.15.17:0/1826736036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46d3613c0 con 0x55d46d68a5d0 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.489+0000 7f4584be9640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4570004f20 tx=0x7f4570009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77f42efea0d96e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.489+0000 7f4568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.489+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570025060 con 0x55d46d68a5d0 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.489+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f4570008bc0 con 0x55d46d68a5d0 2024-09-10T11:44:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.490+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4570008de0 con 0x55d46d68a5d0 2024-09-10T11:44:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.490+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4570019040 con 0x55d46d68a5d0 2024-09-10T11:44:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.490+0000 7f4589a27740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.490+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d46d6a3ae0 con 0x55d46d68a5d0 2024-09-10T11:44:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.490+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4570004500 con 0x55d46d68a5d0 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f457001f030 con 0x55d46d68a5d0 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 10 client.15519 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 20 client.15519 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d6a4e30 0x55d46d6a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 4 client.15519 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.491+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4570008de0 con 0x55d46d6a4e30 2024-09-10T11:44:05.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.493+0000 7f45853ea640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d6a4e30 0x55d46d6a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.497+0000 7f45853ea640 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d6a4e30 0x55d46d6a7220 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=999de17c32084c9b server_cookie=870bdc169b0f7812 in_seq=0 out_seq=0 2024-09-10T11:44:05.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.497+0000 7f4568ff9640 10 client.15519 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4568ff9640 1 -- 172.21.15.17:0/1826736036 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4570008de0 con 0x55d46d6a4e30 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4568ff9640 10 client.15519 handle_command_reply: tid=0 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 client.15519 shutdown 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 msgr2=0x55d46d694d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4570004f20 tx=0x7f4570009a60 comp rx=0 tx=0).stop 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 shutdown_connections 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d6a4e30 0x55d46d6a7220 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68bb40 0x55d46d692030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d695370 0x55d46d692640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 --2- 172.21.15.17:0/1826736036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68a5d0 0x55d46d694d80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 >> 172.21.15.17:0/1826736036 conn(0x55d46d653310 msgr2=0x55d46d68c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.500+0000 7f4568ff9640 0 client.15519 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:44:05.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.501+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 shutdown_connections 2024-09-10T11:44:05.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.501+0000 7f4589a27740 1 -- 172.21.15.17:0/1826736036 wait complete. 2024-09-10T11:44:05.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.501+0000 7f4589a27740 20 client.15519 trim_cache size 0 max 16384 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.515+0000 7f4589a27740 1 Processor -- start 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 -- start start 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d686ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 0x55d46d6a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d695370 0x55d46d6ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45801afa80 con 0x55d46d68bb40 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45801b15c0 con 0x55d46d68a5d0 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4589a27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45801b0150 con 0x55d46d695370 2024-09-10T11:44:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f45853ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 0x55d46d6a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f45853ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 0x55d46d6a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54610/0 (socket says 172.21.15.17:54610) 2024-09-10T11:44:05.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f45853ea640 1 -- 172.21.15.17:0/3298206689 learned_addr learned my addr 172.21.15.17:0/3298206689 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:05.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d686ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d695370 0x55d46d6ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 -- 172.21.15.17:0/3298206689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d695370 msgr2=0x55d46d6ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d695370 0x55d46d6ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 -- 172.21.15.17:0/3298206689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 msgr2=0x55d46d6a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 0x55d46d6a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.516+0000 7f4584be9640 1 -- 172.21.15.17:0/3298206689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46d698210 con 0x55d46d68a5d0 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.517+0000 7f4584be9640 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d686ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f457000e6e0 tx=0x7f4570004f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f132793a8ca3c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.517+0000 7f456affd640 1 -- 172.21.15.17:0/3298206689 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570025040 con 0x55d46d68a5d0 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.517+0000 7f456affd640 1 -- 172.21.15.17:0/3298206689 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4570031070 con 0x55d46d68a5d0 2024-09-10T11:44:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.517+0000 7f456affd640 1 -- 172.21.15.17:0/3298206689 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570009230 con 0x55d46d68a5d0 2024-09-10T11:44:05.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- 172.21.15.17:0/3298206689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 msgr2=0x55d46d686ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d686ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f457000e6e0 tx=0x7f4570004f50 comp rx=0 tx=0).stop 2024-09-10T11:44:05.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- 172.21.15.17:0/3298206689 shutdown_connections 2024-09-10T11:44:05.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d695370 0x55d46d6ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d68bb40 0x55d46d6a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 --2- 172.21.15.17:0/3298206689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68a5d0 0x55d46d686ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- 172.21.15.17:0/3298206689 >> 172.21.15.17:0/3298206689 conn(0x55d46d653310 msgr2=0x55d46d6865d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- 172.21.15.17:0/3298206689 shutdown_connections 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- 172.21.15.17:0/3298206689 wait complete. 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.518+0000 7f4589a27740 1 -- start start 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 Processor -- start 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68a5d0 0x55d46d69d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 0x55d46d69dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d68e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d68e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4584be9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d68e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54612/0 (socket says 172.21.15.17:54612) 2024-09-10T11:44:05.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4584be9640 1 -- 172.21.15.17:0/1105021775 learned_addr learned my addr 172.21.15.17:0/1105021775 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45801b0ef0 con 0x55d46d695370 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45801b0820 con 0x55d46d68bb40 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ada60 con 0x55d46d68a5d0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f45853ea640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 0x55d46d69dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4584be9640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68a5d0 0x55d46d69d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.519+0000 7f4589a27740 10 client.0 _ll_register_callbacks cb 0x7f45700016c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 -- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68a5d0 msgr2=0x55d46d69d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68a5d0 0x55d46d69d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 -- 172.21.15.17:0/1105021775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 msgr2=0x55d46d68e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d68e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46d68f090 con 0x55d46d68bb40 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f45853ea640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 0x55d46d69dbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f457c02a960 tx=0x7f457c004330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf8b729159f2f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c048020 con 0x55d46d68bb40 2024-09-10T11:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4570031070 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f457c005240 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f457c035040 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4589a27740 10 client.25178 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.520+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d46d70f360 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4570031070 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f457c003660 con 0x55d46d68bb40 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 10 client.25178 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 10 client.25178 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 20 client.25178 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d70fac0 0x55d46d711ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 4 client.25178 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.521+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d46d5fd860 con 0x55d46d70fac0 2024-09-10T11:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.522+0000 7f4584be9640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d70fac0 0x55d46d711ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.524+0000 7f4568ff9640 10 client.25178 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.524+0000 7f4584be9640 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d70fac0 0x55d46d711ee0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a010a40ec8c85b4 server_cookie=2d8fb86eb6ec8d79 in_seq=0 out_seq=0 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.524+0000 7f4568ff9640 1 -- 172.21.15.17:0/1105021775 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d46d5fd860 con 0x55d46d70fac0 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.524+0000 7f4568ff9640 10 client.25178 handle_command_reply: tid=0 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.524+0000 7f4589a27740 1 client.25178 shutdown 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 msgr2=0x55d46d69dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 0x55d46d69dbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f457c02a960 tx=0x7f457c004330 comp rx=0 tx=0).stop 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 shutdown_connections 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55d46d70fac0 0x55d46d711ee0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d46d695370 0x55d46d68e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d46d68bb40 0x55d46d69dbd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4568ff9640 0 client.25178 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:44:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 --2- 172.21.15.17:0/1105021775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d46d68a5d0 0x55d46d69d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 >> 172.21.15.17:0/1105021775 conn(0x55d46d653310 msgr2=0x55d46d6854e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 shutdown_connections 2024-09-10T11:44:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 1 -- 172.21.15.17:0/1105021775 wait complete. 2024-09-10T11:44:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.525+0000 7f4589a27740 20 client.25178 trim_cache size 0 max 16384 2024-09-10T11:44:05.529 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 msgr2=0x7f456c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 0x7f456c0a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4578095970 tx=0x7f45780c5a60 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 msgr2=0x7f458019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f457800b970 tx=0x7f457800be30 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 shutdown_connections 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f456c0a2b80 0x7f456c0a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4580101410 0x7f45801a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4580106a70 0x7f458019a660 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 --2- 172.21.15.17:0/274375177 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4580100a70 0x7f45801a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.526+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 >> 172.21.15.17:0/274375177 conn(0x7f45800fc7d0 msgr2=0x7f458010c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.527+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 shutdown_connections 2024-09-10T11:44:05.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:05.527+0000 7f458764e640 1 -- 172.21.15.17:0/274375177 wait complete. 2024-09-10T11:44:06.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:44:06.645 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:06.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:06 smithi017 ceph-mon[30817]: pgmap v382: 97 pgs: 97 active+clean; 6.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 541 MiB/s wr, 237 op/s 2024-09-10T11:44:06.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:06 smithi081 ceph-mon[35059]: pgmap v382: 97 pgs: 97 active+clean; 6.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 541 MiB/s wr, 237 op/s 2024-09-10T11:44:07.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:06 smithi026 ceph-mon[34817]: pgmap v382: 97 pgs: 97 active+clean; 6.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 541 MiB/s wr, 237 op/s 2024-09-10T11:44:07.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.247+0000 7f3a729f4640 1 -- 172.21.15.17:0/2548300451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c100e20 msgr2=0x7f3a6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.247+0000 7f3a729f4640 1 --2- 172.21.15.17:0/2548300451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c100e20 0x7f3a6c101200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a4a0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 -- 172.21.15.17:0/2548300451 shutdown_connections 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 --2- 172.21.15.17:0/2548300451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 --2- 172.21.15.17:0/2548300451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 0x7f3a6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 --2- 172.21.15.17:0/2548300451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c100e20 0x7f3a6c101200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 -- 172.21.15.17:0/2548300451 >> 172.21.15.17:0/2548300451 conn(0x7f3a6c0fc7d0 msgr2=0x7f3a6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 -- 172.21.15.17:0/2548300451 shutdown_connections 2024-09-10T11:44:07.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.248+0000 7f3a729f4640 1 -- 172.21.15.17:0/2548300451 wait complete. 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 Processor -- start 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 -- start start 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a6c100e20 0x7f3a6c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 0x7f3a6c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1121c0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112040 con 0x7f3a6c102570 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.249+0000 7f3a729f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112340 con 0x7f3a6c100e20 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54638/0 (socket says 172.21.15.17:54638) 2024-09-10T11:44:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 -- 172.21.15.17:0/3282038871 learned_addr learned my addr 172.21.15.17:0/3282038871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 0x7f3a6c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 -- 172.21.15.17:0/3282038871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a6c100e20 msgr2=0x7f3a6c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a6c100e20 0x7f3a6c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 -- 172.21.15.17:0/3282038871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 msgr2=0x7f3a6c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 0x7f3a6c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 -- 172.21.15.17:0/3282038871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c19d4f0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a70f91640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400b990 tx=0x7f3a6400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a697fa640 1 -- 172.21.15.17:0/3282038871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64019070 con 0x7f3a6c102ef0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c19d7e0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a697fa640 1 -- 172.21.15.17:0/3282038871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a6400cba0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.250+0000 7f3a697fa640 1 -- 172.21.15.17:0/3282038871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64007610 con 0x7f3a6c102ef0 2024-09-10T11:44:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.251+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a50c0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.253+0000 7f3a697fa640 1 -- 172.21.15.17:0/3282038871 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3a6401c070 con 0x7f3a6c102ef0 2024-09-10T11:44:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.254+0000 7f3a697fa640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 0x7f3a540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 Processor -- start 2024-09-10T11:44:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 0x7f3a540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a697fa640 1 -- 172.21.15.17:0/3282038871 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3a640ce5c0 con 0x7f3a6c102ef0 2024-09-10T11:44:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 -- start start 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e42c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41120 0x562498e41560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562498da72f0 con 0x562498e41b80 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562498d4ecf0 con 0x562498e42840 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562498da32b0 con 0x562498e41120 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.255+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 0x7f3a540a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0314e0 tx=0x7f3a5c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54644/0 (socket says 172.21.15.17:54644) 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 -- 172.21.15.17:0/2138809850 learned_addr learned my addr 172.21.15.17:0/2138809850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e42c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 -- 172.21.15.17:0/2138809850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41120 msgr2=0x562498e41560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41120 0x562498e41560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 -- 172.21.15.17:0/2138809850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 msgr2=0x562498e42c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e42c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 -- 172.21.15.17:0/2138809850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498d333a0 con 0x562498e41b80 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a70f91640 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a640a3570 tx=0x7f3a6409aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02b73f608ea1f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a527fc640 1 -- 172.21.15.17:0/2138809850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400cd50 con 0x562498e41b80 2024-09-10T11:44:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a527fc640 1 -- 172.21.15.17:0/2138809850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a640991e0 con 0x562498e41b80 2024-09-10T11:44:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.256+0000 7f3a527fc640 1 -- 172.21.15.17:0/2138809850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a640ce350 con 0x562498e41b80 2024-09-10T11:44:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.257+0000 7f3a74dcd740 1 -- 172.21.15.17:0/2138809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 msgr2=0x562498e56f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a640a3570 tx=0x7f3a6409aee0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 -- 172.21.15.17:0/2138809850 shutdown_connections 2024-09-10T11:44:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41120 0x562498e41560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e56f60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/2138809850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e42c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 -- 172.21.15.17:0/2138809850 >> 172.21.15.17:0/2138809850 conn(0x562498e0a310 msgr2=0x562498e3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 -- 172.21.15.17:0/2138809850 shutdown_connections 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 -- 172.21.15.17:0/2138809850 wait complete. 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 -- start start 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.258+0000 7f3a74dcd740 1 Processor -- start 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41b80 0x562498e540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e54690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562498e57870 con 0x562498e41120 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562498d62060 con 0x562498e41b80 2024-09-10T11:44:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562498e579f0 con 0x562498e42840 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a74dcd740 10 client.0 _ll_register_callbacks cb 0x562498ab58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54660/0 (socket says 172.21.15.17:54660) 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a6bfff640 1 -- 172.21.15.17:0/1098442490 learned_addr learned my addr 172.21.15.17:0/1098442490 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.259+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41b80 0x562498e540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a70f91640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e54690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 -- 172.21.15.17:0/1098442490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 msgr2=0x562498e54690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e54690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 -- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41b80 msgr2=0x562498e540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41b80 0x562498e540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 -- 172.21.15.17:0/1098442490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562498b183c0 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a70f91640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e54690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f37599ad8da997a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c04c020 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a640991e0 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.260+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3a5c048450 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c035040 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562498e63310 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a640991e0 con 0x562498e41120 2024-09-10T11:44:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a5c03a790 con 0x562498e41120 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 10 client.15537 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 20 client.15537 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498e670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 4 client.15537 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.261+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562498db4860 con 0x562498e64c40 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.262+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498e670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.263+0000 7f3a4b7fe640 10 client.15537 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.263+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498e670a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c94f6b78d4f71950 server_cookie=2200fb8ad5013bb6 in_seq=0 out_seq=0 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/1098442490 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562498db4860 con 0x562498e64c40 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a4b7fe640 10 client.15537 handle_command_reply: tid=0 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 client.15537 shutdown 2024-09-10T11:44:07.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 msgr2=0x562498e56e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c009260 comp rx=0 tx=0).stop 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 shutdown_connections 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498e670a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e54690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a4b7fe640 0 client.15537 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41b80 0x562498e540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/1098442490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e56e40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 >> 172.21.15.17:0/1098442490 conn(0x562498e0a310 msgr2=0x562498e439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 shutdown_connections 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 1 -- 172.21.15.17:0/1098442490 wait complete. 2024-09-10T11:44:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.264+0000 7f3a74dcd740 20 client.15537 trim_cache size 0 max 16384 2024-09-10T11:44:07.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 Processor -- start 2024-09-10T11:44:07.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 -- start start 2024-09-10T11:44:07.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41120 0x562498e60b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ab450 con 0x562498e41b80 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1acf90 con 0x562498e41120 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1abb20 con 0x562498e42840 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54674/0 (socket says 172.21.15.17:54674) 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a6b7fe640 1 -- 172.21.15.17:0/3839507156 learned_addr learned my addr 172.21.15.17:0/3839507156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.278+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41120 0x562498e60b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 -- 172.21.15.17:0/3839507156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 msgr2=0x562498e46810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 -- 172.21.15.17:0/3839507156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41120 msgr2=0x562498e60b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41120 0x562498e60b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 -- 172.21.15.17:0/3839507156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498e56960 con 0x562498e41b80 2024-09-10T11:44:07.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x562498e53980 tx=0x7f3a60010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529a005c2eb489eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a51ffb640 1 -- 172.21.15.17:0/3839507156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60010e60 con 0x562498e41b80 2024-09-10T11:44:07.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a51ffb640 1 -- 172.21.15.17:0/3839507156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a60004250 con 0x562498e41b80 2024-09-10T11:44:07.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.279+0000 7f3a51ffb640 1 -- 172.21.15.17:0/3839507156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6001d850 con 0x562498e41b80 2024-09-10T11:44:07.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 -- 172.21.15.17:0/3839507156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 msgr2=0x562498e462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x562498e53980 tx=0x7f3a60010800 comp rx=0 tx=0).stop 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 -- 172.21.15.17:0/3839507156 shutdown_connections 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e42840 0x562498e46810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41b80 0x562498e462d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/3839507156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e41120 0x562498e60b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 -- 172.21.15.17:0/3839507156 >> 172.21.15.17:0/3839507156 conn(0x562498e0a310 msgr2=0x562498e478b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 -- 172.21.15.17:0/3839507156 shutdown_connections 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.280+0000 7f3a74dcd740 1 -- 172.21.15.17:0/3839507156 wait complete. 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.281+0000 7f3a74dcd740 1 -- start start 2024-09-10T11:44:07.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.281+0000 7f3a74dcd740 1 Processor -- start 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41b80 0x562498e6c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e6c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ac8c0 con 0x562498e41120 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1ac1f0 con 0x562498e42840 2024-09-10T11:44:07.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1a9430 con 0x562498e41b80 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a74dcd740 10 client.0 _ll_register_callbacks cb 0x7f3a60005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54686/0 (socket says 172.21.15.17:54686) 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 -- 172.21.15.17:0/285975672 learned_addr learned my addr 172.21.15.17:0/285975672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a70f91640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e6c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 -- 172.21.15.17:0/285975672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41b80 msgr2=0x562498e6c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41b80 0x562498e6c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 -- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 msgr2=0x562498e6c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e6c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a6bfff640 1 -- 172.21.15.17:0/285975672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562498e6cfa0 con 0x562498e41120 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.282+0000 7f3a70f91640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e6c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:07.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a6bfff640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02aa90 tx=0x7f3a5c02ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5befefc45b3b21b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c04c040 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f3a5c031540 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a60004250 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c031740 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a74dcd740 10 client.15543 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.283+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562498ecf8f0 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a60004250 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3a5c0669b0 con 0x562498e41120 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 10 client.15543 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 10 client.15543 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 20 client.15543 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:07.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498ed20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:07.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 4 client.15543 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:44:07.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562498e484d0 con 0x562498e64c40 2024-09-10T11:44:07.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.284+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498ed20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:07.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.285+0000 7f3a6b7fe640 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498ed20e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be657fa6f9ac2bc3 server_cookie=be21b013b2d9f200 in_seq=0 out_seq=0 2024-09-10T11:44:07.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.285+0000 7f3a4b7fe640 10 client.15543 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:44:07.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.285+0000 7f3a4b7fe640 1 -- 172.21.15.17:0/285975672 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562498e484d0 con 0x562498e64c40 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.285+0000 7f3a4b7fe640 10 client.15543 handle_command_reply: tid=0 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.285+0000 7f3a74dcd740 1 client.15543 shutdown 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 msgr2=0x562498e5d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02aa90 tx=0x7f3a5c02ac10 comp rx=0 tx=0).stop 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 shutdown_connections 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x562498e64c40 0x562498ed20e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562498e41b80 0x562498e6c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562498e42840 0x562498e6c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 --2- 172.21.15.17:0/285975672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562498e41120 0x562498e5d330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 >> 172.21.15.17:0/285975672 conn(0x562498e0a310 msgr2=0x562498e43180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a4b7fe640 0 client.15543 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 shutdown_connections 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 1 -- 172.21.15.17:0/285975672 wait complete. 2024-09-10T11:44:07.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.286+0000 7f3a74dcd740 20 client.15543 trim_cache size 0 max 16384 2024-09-10T11:44:07.292 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:44:07.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 msgr2=0x7f3a540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 0x7f3a540a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0314e0 tx=0x7f3a5c000bc0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 msgr2=0x7f3a6c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400b990 tx=0x7f3a6400be50 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 shutdown_connections 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f3a540a2b80 0x7f3a540a5040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a6c102ef0 0x7f3a6c19ce10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a6c102570 0x7f3a6c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 --2- 172.21.15.17:0/3282038871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a6c100e20 0x7f3a6c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 >> 172.21.15.17:0/3282038871 conn(0x7f3a6c0fc7d0 msgr2=0x7f3a6c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 shutdown_connections 2024-09-10T11:44:07.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:07.288+0000 7f3a729f4640 1 -- 172.21.15.17:0/3282038871 wait complete. 2024-09-10T11:44:07.573 INFO:tasks.workunit.client.0.smithi017.stdout:fs setup took 15 secs 2024-09-10T11:44:08.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:44:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:08 smithi081 ceph-mon[35059]: pgmap v383: 97 pgs: 97 active+clean; 8.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 680 MiB/s wr, 274 op/s 2024-09-10T11:44:09.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:08 smithi026 ceph-mon[34817]: pgmap v383: 97 pgs: 97 active+clean; 8.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 680 MiB/s wr, 274 op/s 2024-09-10T11:44:09.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:08 smithi017 ceph-mon[30817]: pgmap v383: 97 pgs: 97 active+clean; 8.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 680 MiB/s wr, 274 op/s 2024-09-10T11:44:09.079 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 -- 172.21.15.17:0/3471639000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed41082a0 msgr2=0x7f2ed410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/3471639000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed41082a0 0x7f2ed410ec40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009cd0 tx=0x7f2ecc02a910 comp rx=0 tx=0).stop 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 -- 172.21.15.17:0/3471639000 shutdown_connections 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/3471639000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed41036e0 0x7f2ed4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/3471639000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed41082a0 0x7f2ed410ec40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/3471639000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed4102d30 0x7f2ed4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 -- 172.21.15.17:0/3471639000 >> 172.21.15.17:0/3471639000 conn(0x7f2ed40fc7d0 msgr2=0x7f2ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 -- 172.21.15.17:0/3471639000 shutdown_connections 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.625+0000 7f2ed97d0640 1 -- 172.21.15.17:0/3471639000 wait complete. 2024-09-10T11:44:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.626+0000 7f2ed97d0640 1 Processor -- start 2024-09-10T11:44:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.626+0000 7f2ed97d0640 1 -- start start 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed41036e0 0x7f2ed4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed41082a0 0x7f2ed4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41120e0 con 0x7f2ed4102d30 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4111f60 con 0x7f2ed41036e0 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed97d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4112260 con 0x7f2ed41082a0 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54716/0 (socket says 172.21.15.17:54716) 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/107713062 learned_addr learned my addr 172.21.15.17:0/107713062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/107713062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed41082a0 msgr2=0x7f2ed4101410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed41082a0 0x7f2ed4101410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/107713062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed41036e0 msgr2=0x7f2ed4100ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed41036e0 0x7f2ed4100ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.627+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/107713062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed41a6a90 con 0x7f2ed4102d30 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400d950 tx=0x7f2ec400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed0ff9640 1 -- 172.21.15.17:0/107713062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4017070 con 0x7f2ed4102d30 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed0ff9640 1 -- 172.21.15.17:0/107713062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec4009c30 con 0x7f2ed4102d30 2024-09-10T11:44:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed41a6d80 con 0x7f2ed4102d30 2024-09-10T11:44:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed0ff9640 1 -- 172.21.15.17:0/107713062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400f6b0 con 0x7f2ed4102d30 2024-09-10T11:44:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.628+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed41a7290 con 0x7f2ed4102d30 2024-09-10T11:44:09.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.632+0000 7f2ed0ff9640 1 -- 172.21.15.17:0/107713062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2ec40109d0 con 0x7f2ed4102d30 2024-09-10T11:44:09.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.632+0000 7f2edbba9740 1 Processor -- start 2024-09-10T11:44:09.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.632+0000 7f2edbba9740 1 -- start start 2024-09-10T11:44:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a930090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a930a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a8962f0 con 0x55ee6a93b370 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a83dcf0 con 0x55ee6a931b40 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2edbba9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a8922b0 con 0x55ee6a9305d0 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54724/0 (socket says 172.21.15.17:54724) 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ecbfff640 1 -- 172.21.15.17:0/3670693050 learned_addr learned my addr 172.21.15.17:0/3670693050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ed0ff9640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 0x7f2ec00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a930a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 0x7f2ec00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.633+0000 7f2ecbfff640 1 -- 172.21.15.17:0/3670693050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 msgr2=0x55ee6a930a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a930a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ecbfff640 1 -- 172.21.15.17:0/3670693050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 msgr2=0x55ee6a930090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a930090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ecbfff640 1 -- 172.21.15.17:0/3670693050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6a8223a0 con 0x55ee6a93b370 2024-09-10T11:44:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ed0ff9640 1 -- 172.21.15.17:0/107713062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2ec40cf020 con 0x7f2ed4102d30 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0096e0 tx=0x7f2ebc009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1b2c8a25a78a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 0x7f2ec00a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004af0 tx=0x7f2ecc031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ec97fa640 1 -- 172.21.15.17:0/3670693050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc015020 con 0x55ee6a93b370 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ec97fa640 1 -- 172.21.15.17:0/3670693050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ebc00bda0 con 0x55ee6a93b370 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.634+0000 7f2ec97fa640 1 -- 172.21.15.17:0/3670693050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc010380 con 0x55ee6a93b370 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 -- 172.21.15.17:0/3670693050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 msgr2=0x55ee6a93d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0096e0 tx=0x7f2ebc009ba0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 -- 172.21.15.17:0/3670693050 shutdown_connections 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a930a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93d760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 --2- 172.21.15.17:0/3670693050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a930090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 -- 172.21.15.17:0/3670693050 >> 172.21.15.17:0/3670693050 conn(0x55ee6a8f9310 msgr2=0x55ee6a92cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 -- 172.21.15.17:0/3670693050 shutdown_connections 2024-09-10T11:44:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.635+0000 7f2edbba9740 1 -- 172.21.15.17:0/3670693050 wait complete. 2024-09-10T11:44:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 -- start start 2024-09-10T11:44:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 Processor -- start 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a938040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a93b370 0x55ee6a938650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a93e070 con 0x55ee6a9305d0 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a851060 con 0x55ee6a931b40 2024-09-10T11:44:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ee6a93e1f0 con 0x55ee6a93b370 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2edbba9740 10 client.0 _ll_register_callbacks cb 0x55ee6a5a48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54730/0 (socket says 172.21.15.17:54730) 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.636+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/1362866273 learned_addr learned my addr 172.21.15.17:0/1362866273 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a938040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a93b370 0x55ee6a938650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a93b370 msgr2=0x55ee6a938650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a93b370 0x55ee6a938650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/1362866273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 msgr2=0x55ee6a938040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a938040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 -- 172.21.15.17:0/1362866273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6a6073c0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ec409b590 tx=0x7f2ec406b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456e968228fd5565 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2eba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4020070 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.637+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2ec40d10d0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ebc00bda0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ec4009de0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee6a949ba0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ebc00bda0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ec409baf0 con 0x55ee6a9305d0 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 20 client.15555 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:09.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a94afb0 0x55ee6a94d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 4 client.15555 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:09.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.638+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee6a8a3860 con 0x55ee6a94afb0 2024-09-10T11:44:09.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.639+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a94afb0 0x55ee6a94d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.640+0000 7f2eba7fc640 10 client.15555 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.640+0000 7f2ecbfff640 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a94afb0 0x55ee6a94d3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8cd456635dcf201 server_cookie=59f7ee8860bc2fd7 in_seq=0 out_seq=0 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.641+0000 7f2eba7fc640 1 -- 172.21.15.17:0/1362866273 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee6a8a3860 con 0x55ee6a94afb0 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.641+0000 7f2eba7fc640 10 client.15555 handle_command_reply: tid=0 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 client.15555 shutdown 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 msgr2=0x55ee6a93ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ec409b590 tx=0x7f2ec406b740 comp rx=0 tx=0).stop 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 shutdown_connections 2024-09-10T11:44:09.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a94afb0 0x55ee6a94d3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a93b370 0x55ee6a938650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a938040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 --2- 172.21.15.17:0/1362866273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a9305d0 0x55ee6a93ad90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2eba7fc640 0 client.15555 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 >> 172.21.15.17:0/1362866273 conn(0x55ee6a8f9310 msgr2=0x55ee6a932960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 shutdown_connections 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 1 -- 172.21.15.17:0/1362866273 wait complete. 2024-09-10T11:44:09.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.642+0000 7f2edbba9740 20 client.15555 trim_cache size 0 max 16384 2024-09-10T11:44:09.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.661+0000 7f2edbba9740 1 Processor -- start 2024-09-10T11:44:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.661+0000 7f2edbba9740 1 -- start start 2024-09-10T11:44:09.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a936910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a933120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41af820 con 0x55ee6a93b370 2024-09-10T11:44:09.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41b1360 con 0x55ee6a931b40 2024-09-10T11:44:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2edbba9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41afef0 con 0x55ee6a9305d0 2024-09-10T11:44:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54736/0 (socket says 172.21.15.17:54736) 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.662+0000 7f2ed37fe640 1 -- 172.21.15.17:0/2114904782 learned_addr learned my addr 172.21.15.17:0/2114904782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a936910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 -- 172.21.15.17:0/2114904782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 msgr2=0x55ee6a936910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a936910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 -- 172.21.15.17:0/2114904782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 msgr2=0x55ee6a933120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a933120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 -- 172.21.15.17:0/2114904782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6a936ff0 con 0x55ee6a93b370 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.663+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc02f350 tx=0x7f2ecc03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f267325b609d2bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.664+0000 7f2ec8ff9640 1 -- 172.21.15.17:0/2114904782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc02f380 con 0x55ee6a93b370 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.664+0000 7f2ec8ff9640 1 -- 172.21.15.17:0/2114904782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc04b070 con 0x55ee6a93b370 2024-09-10T11:44:09.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.664+0000 7f2ec8ff9640 1 -- 172.21.15.17:0/2114904782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc02f8d0 con 0x55ee6a93b370 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- 172.21.15.17:0/2114904782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 msgr2=0x55ee6a933660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc02f350 tx=0x7f2ecc03d000 comp rx=0 tx=0).stop 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- 172.21.15.17:0/2114904782 shutdown_connections 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a933660 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a931b40 0x55ee6a933120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 --2- 172.21.15.17:0/2114904782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a9305d0 0x55ee6a936910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- 172.21.15.17:0/2114904782 >> 172.21.15.17:0/2114904782 conn(0x55ee6a8f9310 msgr2=0x55ee6a92bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- 172.21.15.17:0/2114904782 shutdown_connections 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- 172.21.15.17:0/2114904782 wait complete. 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.665+0000 7f2edbba9740 1 -- start start 2024-09-10T11:44:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 Processor -- start 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a9305d0 0x55ee6a93f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a931b40 0x55ee6a93f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41b0c90 con 0x55ee6a93b370 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41b05c0 con 0x55ee6a9305d0 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed41ad800 con 0x55ee6a931b40 2024-09-10T11:44:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2edbba9740 10 client.0 _ll_register_callbacks cb 0x7f2ec409b3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54742/0 (socket says 172.21.15.17:54742) 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.666+0000 7f2ed37fe640 1 -- 172.21.15.17:0/4135386197 learned_addr learned my addr 172.21.15.17:0/4135386197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 -- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a931b40 msgr2=0x55ee6a93f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a931b40 0x55ee6a93f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 -- 172.21.15.17:0/4135386197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a9305d0 msgr2=0x55ee6a93f4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a9305d0 0x55ee6a93f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 -- 172.21.15.17:0/4135386197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6a9bd670 con 0x55ee6a93b370 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2ed37fe640 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004790 tx=0x7f2ecc0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df83f6212349a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2eba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc05e060 con 0x55ee6a93b370 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ecc04b070 con 0x55ee6a93b370 2024-09-10T11:44:09.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.667+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2ecc004010 con 0x55ee6a93b370 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ecc004830 con 0x55ee6a93b370 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee6a9be9c0 con 0x55ee6a93b370 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc04b070 con 0x55ee6a93b370 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ecc030660 con 0x55ee6a93b370 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 20 client.15561 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a9bf070 0x55ee6a9c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 4 client.15561 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:44:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.668+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee6a89dd70 con 0x55ee6a9bf070 2024-09-10T11:44:09.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.670+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a9bf070 0x55ee6a9c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:09.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2eba7fc640 10 client.15561 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:09.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2ed2ffd640 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a9bf070 0x55ee6a9c1490 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b0d8a339fb031c server_cookie=4ddd4c71c01783c6 in_seq=0 out_seq=0 2024-09-10T11:44:09.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2eba7fc640 1 -- 172.21.15.17:0/4135386197 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee6a89dd70 con 0x55ee6a9bf070 2024-09-10T11:44:09.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2eba7fc640 10 client.15561 handle_command_reply: tid=0 2024-09-10T11:44:09.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 client.15561 shutdown 2024-09-10T11:44:09.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 msgr2=0x55ee6a93ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004790 tx=0x7f2ecc0095d0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 shutdown_connections 2024-09-10T11:44:09.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ee6a9bf070 0x55ee6a9c1490 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2eba7fc640 0 client.15561 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:09.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee6a931b40 0x55ee6a93f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee6a93b370 0x55ee6a93ff20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.676+0000 7f2edbba9740 1 --2- 172.21.15.17:0/4135386197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ee6a9305d0 0x55ee6a93f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.677+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 >> 172.21.15.17:0/4135386197 conn(0x55ee6a8f9310 msgr2=0x55ee6a9398a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.677+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 shutdown_connections 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.677+0000 7f2edbba9740 1 -- 172.21.15.17:0/4135386197 wait complete. 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.677+0000 7f2edbba9740 20 client.15561 trim_cache size 0 max 16384 2024-09-10T11:44:09.681 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.677+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 msgr2=0x7f2ec00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 0x7f2ec00a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004af0 tx=0x7f2ecc031000 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 msgr2=0x7f2ed4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400d950 tx=0x7f2ec400de10 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 shutdown_connections 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ec00a2c00 0x7f2ec00a50c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ed41082a0 0x7f2ed4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ed41036e0 0x7f2ed4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 --2- 172.21.15.17:0/107713062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ed4102d30 0x7f2ed4100990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 >> 172.21.15.17:0/107713062 conn(0x7f2ed40fc7d0 msgr2=0x7f2ed4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:09.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 shutdown_connections 2024-09-10T11:44:09.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:09.678+0000 7f2ed97d0640 1 -- 172.21.15.17:0/107713062 wait complete. 2024-09-10T11:44:11.403 INFO:tasks.workunit.client.0.smithi017.stdout:Syncing()...3 sec 2024-09-10T11:44:11.404 INFO:tasks.workunit.client.0.smithi017.stdout:Starting Actual Benchmark At: Tue Sep 10 11:44:11 2024 2024-09-10T11:44:11.404 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:44:11.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:11 smithi026 ceph-mon[34817]: pgmap v384: 97 pgs: 97 active+clean; 9.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 733 MiB/s wr, 286 op/s 2024-09-10T11:44:11.516 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:44:11.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:44:11.529 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:11 smithi017 ceph-mon[30817]: pgmap v384: 97 pgs: 97 active+clean; 9.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 733 MiB/s wr, 286 op/s 2024-09-10T11:44:11.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:11 smithi081 ceph-mon[35059]: pgmap v384: 97 pgs: 97 active+clean; 9.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 733 MiB/s wr, 286 op/s 2024-09-10T11:44:12.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:12 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:12.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:12 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:12.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:12 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:12.775 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:13.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:13 smithi017 ceph-mon[30817]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 636 MiB/s wr, 221 op/s 2024-09-10T11:44:13.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:13 smithi081 ceph-mon[35059]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 636 MiB/s wr, 221 op/s 2024-09-10T11:44:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:13 smithi026 ceph-mon[34817]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 636 MiB/s wr, 221 op/s 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.445+0000 7f74fec86640 1 -- 172.21.15.17:0/2430956312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8109e00 msgr2=0x7f74f80742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.445+0000 7f74fec86640 1 --2- 172.21.15.17:0/2430956312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8109e00 0x7f74f80742d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0097d0 tx=0x7f74ec02b650 comp rx=0 tx=0).stop 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.447+0000 7f74fec86640 1 -- 172.21.15.17:0/2430956312 shutdown_connections 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.447+0000 7f74fec86640 1 --2- 172.21.15.17:0/2430956312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f8074990 0x7f74f807b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.447+0000 7f74fec86640 1 --2- 172.21.15.17:0/2430956312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8109e00 0x7f74f80742d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.447+0000 7f74fec86640 1 --2- 172.21.15.17:0/2430956312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8109450 0x7f74f8109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.447+0000 7f74fec86640 1 -- 172.21.15.17:0/2430956312 >> 172.21.15.17:0/2430956312 conn(0x7f74f806e140 msgr2=0x7f74f806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.454+0000 7f74fec86640 1 -- 172.21.15.17:0/2430956312 shutdown_connections 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.455+0000 7f74fec86640 1 -- 172.21.15.17:0/2430956312 wait complete. 2024-09-10T11:44:14.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 Processor -- start 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 -- start start 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 0x7f74f807b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f8076260 0x7f74f80766c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8084ea0 con 0x7f74f8074990 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8084d20 con 0x7f74f8076260 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fec86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8085020 con 0x7f74f8076c00 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.456+0000 7f74fd223640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:43524/0 (socket says 172.21.15.17:43524) 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 -- 172.21.15.17:0/865243240 learned_addr learned my addr 172.21.15.17:0/865243240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:14.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 -- 172.21.15.17:0/865243240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f8076260 msgr2=0x7f74f80766c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f8076260 0x7f74f80766c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 -- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 msgr2=0x7f74f807b1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fca22640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 0x7f74f807b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 0x7f74f807b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.457+0000 7f74fd223640 1 -- 172.21.15.17:0/865243240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f81c4d70 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.458+0000 7f74fca22640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 0x7f74f807b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.458+0000 7f74fd223640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b970 tx=0x7f74f000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.464+0000 7f74f5ffb640 1 -- 172.21.15.17:0/865243240 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0019070 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.464+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f81c5060 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.464+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81c55a0 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.467+0000 7f74f5ffb640 1 -- 172.21.15.17:0/865243240 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74f000cb40 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.467+0000 7f74f5ffb640 1 -- 172.21.15.17:0/865243240 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0007660 con 0x7f74f8076c00 2024-09-10T11:44:14.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.474+0000 7f750105f740 1 Processor -- start 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.474+0000 7f750105f740 1 -- start start 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f74f5ffb640 1 -- 172.21.15.17:0/865243240 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f74f001c070 con 0x7f74f8076c00 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f25f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f33130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d99e8b280 con 0x563d99f25b60 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563d99e32b10 con 0x563d99f30d40 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.475+0000 7f750105f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d99e87240 con 0x563d99f26480 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.476+0000 7f74fca22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.476+0000 7f74fca22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:43534/0 (socket says 172.21.15.17:43534) 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.476+0000 7f74fca22640 1 -- 172.21.15.17:0/517584448 learned_addr learned my addr 172.21.15.17:0/517584448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.477+0000 7f74f5ffb640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 0x7f74e80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.478+0000 7f74f5ffb640 1 -- 172.21.15.17:0/865243240 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f74f00ce880 con 0x7f74f8076c00 2024-09-10T11:44:14.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.478+0000 7f74f7fff640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f25f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.478+0000 7f74f7fff640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f33130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.480+0000 7f74fca22640 1 -- 172.21.15.17:0/517584448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 msgr2=0x563d99f33130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74fca22640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f33130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74fca22640 1 -- 172.21.15.17:0/517584448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 msgr2=0x563d99f25f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74fca22640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f25f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74fca22640 1 -- 172.21.15.17:0/517584448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d99e3f1f0 con 0x563d99f26480 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74f7fff640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f33130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.481+0000 7f74fd223640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 0x7f74e80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.484+0000 7f74fd223640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 0x7f74e80a5250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f74f0097a60 tx=0x7f74f000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.488+0000 7f74fca22640 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009b20 tx=0x7f74e400e2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6199bcabe1fdf86e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.492+0000 7f74e2ffd640 1 -- 172.21.15.17:0/517584448 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4016070 con 0x563d99f26480 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.493+0000 7f74e2ffd640 1 -- 172.21.15.17:0/517584448 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e400ed20 con 0x563d99f26480 2024-09-10T11:44:14.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.493+0000 7f74e2ffd640 1 -- 172.21.15.17:0/517584448 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4011470 con 0x563d99f26480 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 -- 172.21.15.17:0/517584448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 msgr2=0x563d99f30800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009b20 tx=0x7f74e400e2f0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 -- 172.21.15.17:0/517584448 shutdown_connections 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f30800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f33130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 --2- 172.21.15.17:0/517584448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f25f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 -- 172.21.15.17:0/517584448 >> 172.21.15.17:0/517584448 conn(0x563d99f220f0 msgr2=0x563d99f224d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 -- 172.21.15.17:0/517584448 shutdown_connections 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.494+0000 7f750105f740 1 -- 172.21.15.17:0/517584448 wait complete. 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.495+0000 7f750105f740 1 -- start start 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.495+0000 7f750105f740 1 Processor -- start 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f26480 0x563d99f2db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f2e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d99f44920 con 0x563d99f26480 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563d99e45f10 con 0x563d99f30d40 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d99f44aa0 con 0x563d99f25b60 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:43550/0 (socket says 172.21.15.17:43550) 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f74f7fff640 1 -- 172.21.15.17:0/703005524 learned_addr learned my addr 172.21.15.17:0/703005524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f74f7fff640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f2e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.496+0000 7f750105f740 10 client.0 _ll_register_callbacks cb 0x563d99e0ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 -- 172.21.15.17:0/703005524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 msgr2=0x563d99f2e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f2e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 -- 172.21.15.17:0/703005524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f26480 msgr2=0x563d99f2db20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f26480 0x563d99f2db20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 -- 172.21.15.17:0/703005524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d99bfc6a0 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.497+0000 7f74f7fff640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74ec000c00 tx=0x7f74ec02bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d9806e9d990a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.498+0000 7f74d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.498+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec037070 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.498+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f74ec0048c0 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.498+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74e400ed20 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.499+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74ec004ae0 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.499+0000 7f750105f740 10 client.25168 fetch_fsmap learned FSMap version 29 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.499+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563d99f35d20 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.502+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ec06a070 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.502+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f74ec071ca0 con 0x563d99f25b60 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 10 client.25168 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 10 client.25168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:14.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 20 client.25168 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99f37230 0x563d99f396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 4 client.25168 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.503+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f74e400ed20 con 0x563d99f37230 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.504+0000 7f74fca22640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99f37230 0x563d99f396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.505+0000 7f74fca22640 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99f37230 0x563d99f396b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0373293aed8db14 server_cookie=a1599cc1ff2148c6 in_seq=0 out_seq=0 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.505+0000 7f74d7fff640 10 client.25168 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f74d7fff640 1 -- 172.21.15.17:0/703005524 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f74e400ed20 con 0x563d99f37230 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f74d7fff640 10 client.25168 handle_command_reply: tid=0 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 client.25168 shutdown 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 msgr2=0x563d99f307d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74ec000c00 tx=0x7f74ec02bdd0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 shutdown_connections 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99f37230 0x563d99f396b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99f2e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f26480 0x563d99f2db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 --2- 172.21.15.17:0/703005524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f25b60 0x563d99f307d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.520+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 >> 172.21.15.17:0/703005524 conn(0x563d99f220f0 msgr2=0x563d99f21270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.521+0000 7f74d7fff640 0 client.25168 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.521+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 shutdown_connections 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.521+0000 7f750105f740 1 -- 172.21.15.17:0/703005524 wait complete. 2024-09-10T11:44:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.521+0000 7f750105f740 20 client.25168 trim_cache size 0 max 16384 2024-09-10T11:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.562+0000 7f750105f740 1 Processor -- start 2024-09-10T11:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.563+0000 7f750105f740 1 -- start start 2024-09-10T11:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.564+0000 7f750105f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.564+0000 7f750105f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f2ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.565+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.565+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43186/0 (socket says 172.21.15.17:43186) 2024-09-10T11:44:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.566+0000 7f74f7fff640 1 -- 172.21.15.17:0/3672993764 learned_addr learned my addr 172.21.15.17:0/3672993764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.566+0000 7f74fca22640 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f2ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.566+0000 7f750105f740 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f30d40 0x563d99f2b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.566+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc00e510 con 0x563d99f30d40 2024-09-10T11:44:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.567+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc010080 con 0x563d99f25b60 2024-09-10T11:44:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.567+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc00ebe0 con 0x563d99f26480 2024-09-10T11:44:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.568+0000 7f74f7fff640 1 -- 172.21.15.17:0/3672993764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 msgr2=0x563d99f2ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.568+0000 7f74f7fff640 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f2ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.568+0000 7f74f7fff640 1 -- 172.21.15.17:0/3672993764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f30d40 msgr2=0x563d99f2b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.568+0000 7f74f7fff640 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f30d40 0x563d99f2b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.568+0000 7f74f7fff640 1 -- 172.21.15.17:0/3672993764 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d99f1d830 con 0x563d99f25b60 2024-09-10T11:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.572+0000 7f74f7fff640 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005a70 tx=0x7f74ec0325a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3d9acbb006882f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.572+0000 7f74e27fc640 1 -- 172.21.15.17:0/3672993764 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec037040 con 0x563d99f25b60 2024-09-10T11:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.572+0000 7f74e27fc640 1 -- 172.21.15.17:0/3672993764 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ec06a040 con 0x563d99f25b60 2024-09-10T11:44:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.572+0000 7f74e27fc640 1 -- 172.21.15.17:0/3672993764 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0046c0 con 0x563d99f25b60 2024-09-10T11:44:14.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.575+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 msgr2=0x563d99f2daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.575+0000 7f750105f740 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005a70 tx=0x7f74ec0325a0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.576+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 shutdown_connections 2024-09-10T11:44:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.576+0000 7f750105f740 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f2ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.576+0000 7f750105f740 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f30d40 0x563d99f2b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.576+0000 7f750105f740 1 --2- 172.21.15.17:0/3672993764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f25b60 0x563d99f2daf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.577+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 >> 172.21.15.17:0/3672993764 conn(0x563d99f220f0 msgr2=0x563d99f2d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.577+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 shutdown_connections 2024-09-10T11:44:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.577+0000 7f750105f740 1 -- 172.21.15.17:0/3672993764 wait complete. 2024-09-10T11:44:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.578+0000 7f750105f740 1 -- start start 2024-09-10T11:44:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.578+0000 7f750105f740 1 Processor -- start 2024-09-10T11:44:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.579+0000 7f750105f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.579+0000 7f750105f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f47830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.582+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.582+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60896/0 (socket says 172.21.15.17:60896) 2024-09-10T11:44:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.582+0000 7f74f7fff640 1 -- 172.21.15.17:0/1034661111 learned_addr learned my addr 172.21.15.17:0/1034661111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.582+0000 7f74fca22640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f47830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.582+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99fa9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.583+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc00f980 con 0x563d99f25b60 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.583+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc00f2b0 con 0x563d99f30d40 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.583+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc00c4f0 con 0x563d99f26480 2024-09-10T11:44:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.583+0000 7f750105f740 10 client.0 _ll_register_callbacks cb 0x7f74ec035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74f7fff640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99fa9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74fca22640 1 -- 172.21.15.17:0/1034661111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 msgr2=0x563d99fa9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74fca22640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99fa9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74fca22640 1 -- 172.21.15.17:0/1034661111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 msgr2=0x563d99f472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74fca22640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.585+0000 7f74fca22640 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d99faa570 con 0x563d99f26480 2024-09-10T11:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.586+0000 7f74fca22640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f47830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x563d99f2d3b0 tx=0x7f74e4009330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b16c4cafb72ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.586+0000 7f74d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.586+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4016040 con 0x563d99f26480 2024-09-10T11:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.587+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74ec06a040 con 0x563d99f26480 2024-09-10T11:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.587+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f74e4005040 con 0x563d99f26480 2024-09-10T11:44:14.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.590+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74e400ed20 con 0x563d99f26480 2024-09-10T11:44:14.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.592+0000 7f750105f740 10 client.25174 fetch_fsmap learned FSMap version 29 2024-09-10T11:44:14.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.592+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563d99fab8f0 con 0x563d99f26480 2024-09-10T11:44:14.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.592+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e4009740 con 0x563d99f26480 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f74e402b030 con 0x563d99f26480 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 10 client.25174 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 10 client.25174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 20 client.25174 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99fac0a0 0x563d99fae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 4 client.25174 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.593+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f74ec06a040 con 0x563d99fac0a0 2024-09-10T11:44:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.594+0000 7f74f7fff640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99fac0a0 0x563d99fae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:14.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.594+0000 7f74d7fff640 10 client.25174 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:14.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.594+0000 7f74f7fff640 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99fac0a0 0x563d99fae4c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97bdf8eb134c9c1f server_cookie=ee6f6d6e7138f427 in_seq=0 out_seq=0 2024-09-10T11:44:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f74d7fff640 1 -- 172.21.15.17:0/1034661111 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f74ec06a040 con 0x563d99fac0a0 2024-09-10T11:44:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f74d7fff640 10 client.25174 handle_command_reply: tid=0 2024-09-10T11:44:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f750105f740 1 client.25174 shutdown 2024-09-10T11:44:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 msgr2=0x563d99f47830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f47830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x563d99f2d3b0 tx=0x7f74e4009330 comp rx=0 tx=0).stop 2024-09-10T11:44:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 shutdown_connections 2024-09-10T11:44:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.624+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d99fac0a0 0x563d99fae4c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d99f26480 0x563d99f47830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d99f30d40 0x563d99fa9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 --2- 172.21.15.17:0/1034661111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d99f25b60 0x563d99f472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 >> 172.21.15.17:0/1034661111 conn(0x563d99f220f0 msgr2=0x563d99f20a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f74d7fff640 0 client.25174 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 shutdown_connections 2024-09-10T11:44:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.625+0000 7f750105f740 1 -- 172.21.15.17:0/1034661111 wait complete. 2024-09-10T11:44:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.628+0000 7f750105f740 20 client.25174 trim_cache size 0 max 16384 2024-09-10T11:44:14.629 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:44:14.629 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:44:14.630 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "59449390-a7a5-4275-bb63-805f417b979d", 2024-09-10T11:44:14.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:44:14.630 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 msgr2=0x7f74e80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 0x7f74e80a5250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f74f0097a60 tx=0x7f74f000e040 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 msgr2=0x7f74f81c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74f000b970 tx=0x7f74f000be30 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 shutdown_connections 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74e80a2d90 0x7f74e80a5250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f8076c00 0x7f74f81c47b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74f8076260 0x7f74f80766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 --2- 172.21.15.17:0/865243240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74f8074990 0x7f74f807b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 >> 172.21.15.17:0/865243240 conn(0x7f74f806e140 msgr2=0x7f74f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.629+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 shutdown_connections 2024-09-10T11:44:14.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:14.630+0000 7f74fec86640 1 -- 172.21.15.17:0/865243240 wait complete. 2024-09-10T11:44:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:15 smithi081 ceph-mon[35059]: pgmap v386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 736 MiB/s wr, 1.12k op/s 2024-09-10T11:44:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:15 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:44:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:15 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:44:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:15 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:44:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:15 smithi026 ceph-mon[34817]: pgmap v386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 736 MiB/s wr, 1.12k op/s 2024-09-10T11:44:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:15 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:44:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:15 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:44:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:15 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:44:15.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:15 smithi017 ceph-mon[30817]: pgmap v386: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 736 MiB/s wr, 1.12k op/s 2024-09-10T11:44:15.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:15 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:44:15.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:15 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:44:15.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:15 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:44:16.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:16 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:44:16.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:16 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:44:16.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:16 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:44:16.836 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:44:17.391 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:17 smithi081 ceph-mon[35059]: pgmap v387: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 623 MiB/s wr, 2.42k op/s 2024-09-10T11:44:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:17 smithi026 ceph-mon[34817]: pgmap v387: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 623 MiB/s wr, 2.42k op/s 2024-09-10T11:44:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:17 smithi017 ceph-mon[30817]: pgmap v387: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 623 MiB/s wr, 2.42k op/s 2024-09-10T11:44:19.256 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:19 smithi017 ceph-mon[30817]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 564 MiB/s wr, 5.85k op/s 2024-09-10T11:44:19.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 -- 172.21.15.17:0/207754435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7510108da0 msgr2=0x7f751010cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 --2- 172.21.15.17:0/207754435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7510108da0 0x7f751010cdf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7508009ca0 tx=0x7f750802a8f0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 -- 172.21.15.17:0/207754435 shutdown_connections 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 --2- 172.21.15.17:0/207754435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f751010d520 0x7f75101150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 --2- 172.21.15.17:0/207754435 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7510108da0 0x7f751010cdf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 --2- 172.21.15.17:0/207754435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75101083f0 0x7f75101087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.165+0000 7f75168d5640 1 -- 172.21.15.17:0/207754435 >> 172.21.15.17:0/207754435 conn(0x7f7510077af0 msgr2=0x7f7510079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.167+0000 7f75168d5640 1 -- 172.21.15.17:0/207754435 shutdown_connections 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.167+0000 7f75168d5640 1 -- 172.21.15.17:0/207754435 wait complete. 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.168+0000 7f75168d5640 1 Processor -- start 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.168+0000 7f75168d5640 1 -- start start 2024-09-10T11:44:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75101083f0 0x7f7510073a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751010d520 0x7f751006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7510118570 con 0x7f751010d520 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75101183f0 con 0x7f75101083f0 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f75168d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75101186f0 con 0x7f7510108da0 2024-09-10T11:44:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:43576/0 (socket says 172.21.15.17:43576) 2024-09-10T11:44:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.169+0000 7f750f7fe640 1 -- 172.21.15.17:0/2088970954 learned_addr learned my addr 172.21.15.17:0/2088970954 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750ffff640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75101083f0 0x7f7510073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750f7fe640 1 -- 172.21.15.17:0/2088970954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75101083f0 msgr2=0x7f7510073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750f7fe640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75101083f0 0x7f7510073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750f7fe640 1 -- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751010d520 msgr2=0x7f751006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750f7fe640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751010d520 0x7f751006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.170+0000 7f750f7fe640 1 -- 172.21.15.17:0/2088970954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751006d670 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.171+0000 7f750f7fe640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7508031fd0 tx=0x7f7508031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.172+0000 7f750d7fa640 1 -- 172.21.15.17:0/2088970954 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750802fa50 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.172+0000 7f750d7fa640 1 -- 172.21.15.17:0/2088970954 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f750802d070 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.172+0000 7f750d7fa640 1 -- 172.21.15.17:0/2088970954 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080466e0 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.172+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751006d900 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.173+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7510071880 con 0x7f7510108da0 2024-09-10T11:44:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.176+0000 7f7518cae740 1 Processor -- start 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.181+0000 7f7518cae740 1 -- start start 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e5772130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e5774a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5565e56cd2e0 con 0x5565e5772670 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5565e5674ce0 con 0x5565e5767490 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f7518cae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565e56c92a0 con 0x5565e5767db0 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.182+0000 7f750d7fa640 1 -- 172.21.15.17:0/2088970954 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f750802fbf0 con 0x7f7510108da0 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.184+0000 7f750d7fa640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 0x7f74f80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.184+0000 7f750d7fa640 1 -- 172.21.15.17:0/2088970954 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f75080f0430 con 0x7f7510108da0 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.185+0000 7f750ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e5772130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.185+0000 7f7514e72640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 0x7f74f80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.186+0000 7f7514e72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.186+0000 7f7514e72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43226/0 (socket says 172.21.15.17:43226) 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.186+0000 7f7514e72640 1 -- 172.21.15.17:0/494830296 learned_addr learned my addr 172.21.15.17:0/494830296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.186+0000 7f750f7fe640 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e5774a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f750f7fe640 1 -- 172.21.15.17:0/494830296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 msgr2=0x5565e5772130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f750f7fe640 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e5772130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f750f7fe640 1 -- 172.21.15.17:0/494830296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 msgr2=0x5565e5767870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f750f7fe640 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f750f7fe640 1 -- 172.21.15.17:0/494830296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e5659440 con 0x5565e5772670 2024-09-10T11:44:19.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.188+0000 7f7514e72640 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:44:19.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.189+0000 7f750f7fe640 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e5774a60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f750802aee0 tx=0x7f75080454a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a612cfffa286f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.190+0000 7f7514e72640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 0x7f74f80a5250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7500012940 tx=0x7f7500005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.190+0000 7f74f67fc640 1 -- 172.21.15.17:0/494830296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080c0ff0 con 0x5565e5772670 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.191+0000 7f74f67fc640 1 -- 172.21.15.17:0/494830296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7508036040 con 0x5565e5772670 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 -- 172.21.15.17:0/494830296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 msgr2=0x5565e5774a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e5774a60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f750802aee0 tx=0x7f75080454a0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 -- 172.21.15.17:0/494830296 shutdown_connections 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e5772130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e5774a60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 --2- 172.21.15.17:0/494830296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5767870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 -- 172.21.15.17:0/494830296 >> 172.21.15.17:0/494830296 conn(0x5565e5763a20 msgr2=0x5565e5763e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 -- 172.21.15.17:0/494830296 shutdown_connections 2024-09-10T11:44:19.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.192+0000 7f7518cae740 1 -- 172.21.15.17:0/494830296 wait complete. 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.193+0000 7f7518cae740 1 -- start start 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.193+0000 7f7518cae740 1 Processor -- start 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5771f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e576f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5565e5775000 con 0x5565e5772670 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5565e5688050 con 0x5565e5767490 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565e5775180 con 0x5565e5767db0 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.194+0000 7f7518cae740 10 client.0 _ll_register_callbacks cb 0x5565e56c8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.195+0000 7f7514e72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.195+0000 7f7514e72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60930/0 (socket says 172.21.15.17:60930) 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.195+0000 7f7514e72640 1 -- 172.21.15.17:0/3189739800 learned_addr learned my addr 172.21.15.17:0/3189739800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:19.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.195+0000 7f750f7fe640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e576f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.195+0000 7f750ffff640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5771f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.196+0000 7f7514e72640 1 -- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 msgr2=0x5565e576f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.196+0000 7f7514e72640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e576f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.196+0000 7f7514e72640 1 -- 172.21.15.17:0/3189739800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 msgr2=0x5565e5771f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.196+0000 7f7514e72640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5771f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.196+0000 7f7514e72640 1 -- 172.21.15.17:0/3189739800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e543e3c0 con 0x5565e5772670 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.197+0000 7f7514e72640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f750000dd40 tx=0x7f75000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231d9ba4cd34d25e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.197+0000 7f74ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:44:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.206+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500024070 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.206+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7500020880 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.206+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7508036040 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.207+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f750002e050 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.207+0000 7f7518cae740 10 client.15579 fetch_fsmap learned FSMap version 29 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.207+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565e5780a00 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.208+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7500029440 con 0x5565e5772670 2024-09-10T11:44:19.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.208+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f750001e040 con 0x5565e5772670 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 10 client.15579 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 20 client.15579 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e5781ec0 0x5565e57842d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 4 client.15579 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:19.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.209+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7508036040 con 0x5565e5781ec0 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.210+0000 7f750ffff640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e5781ec0 0x5565e57842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.212+0000 7f750ffff640 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e5781ec0 0x5565e57842d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a5829a29ace558 server_cookie=6c136eb1af448ae9 in_seq=0 out_seq=0 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.212+0000 7f74ef7fe640 10 client.15579 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.213+0000 7f74ef7fe640 1 -- 172.21.15.17:0/3189739800 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7508036040 con 0x5565e5781ec0 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.213+0000 7f74ef7fe640 10 client.15579 handle_command_reply: tid=0 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.213+0000 7f7518cae740 1 client.15579 shutdown 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 msgr2=0x5565e576f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f750000dd40 tx=0x7f75000046c0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 shutdown_connections 2024-09-10T11:44:19.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e5781ec0 0x5565e57842d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f74ef7fe640 0 client.15579 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5767db0 0x5565e576f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5772670 0x5565e576f720 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 --2- 172.21.15.17:0/3189739800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e5771f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 >> 172.21.15.17:0/3189739800 conn(0x5565e5763a20 msgr2=0x5565e5762ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 shutdown_connections 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.214+0000 7f7518cae740 1 -- 172.21.15.17:0/3189739800 wait complete. 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.215+0000 7f7518cae740 20 client.15579 trim_cache size 0 max 16384 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.254+0000 7f7518cae740 1 Processor -- start 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.255+0000 7f7518cae740 1 -- start start 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.255+0000 7f7518cae740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.255+0000 7f7518cae740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5767db0 0x5565e577e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f750ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f750ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43234/0 (socket says 172.21.15.17:43234) 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f750ffff640 1 -- 172.21.15.17:0/3787493104 learned_addr learned my addr 172.21.15.17:0/3787493104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f7518cae740 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e5789ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c4c90 con 0x5565e5767db0 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c6800 con 0x5565e5767490 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f7514e72640 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e5789ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.256+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c5360 con 0x5565e5772670 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.257+0000 7f750ffff640 1 -- 172.21.15.17:0/3787493104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 msgr2=0x5565e5789ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.257+0000 7f750ffff640 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e5789ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.257+0000 7f750ffff640 1 -- 172.21.15.17:0/3787493104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5767db0 msgr2=0x5565e577e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.257+0000 7f750ffff640 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5767db0 0x5565e577e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.257+0000 7f750ffff640 1 -- 172.21.15.17:0/3787493104 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e5763850 con 0x5565e5767490 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.259+0000 7f750ffff640 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5565e5784ae0 tx=0x7f75040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ca9e94d9b8274bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.260+0000 7f74f5ffb640 1 -- 172.21.15.17:0/3787493104 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750401c460 con 0x5565e5767490 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.260+0000 7f74f5ffb640 1 -- 172.21.15.17:0/3787493104 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f750401cae0 con 0x5565e5767490 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 msgr2=0x5565e576aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5565e5784ae0 tx=0x7f75040046c0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 shutdown_connections 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e5789ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e5767db0 0x5565e577e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 --2- 172.21.15.17:0/3787493104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767490 0x5565e576aa80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.261+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 >> 172.21.15.17:0/3787493104 conn(0x5565e5763a20 msgr2=0x5565e5771260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.262+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 shutdown_connections 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.262+0000 7f7518cae740 1 -- 172.21.15.17:0/3787493104 wait complete. 2024-09-10T11:44:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.262+0000 7f7518cae740 1 -- start start 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 Processor -- start 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767db0 0x5565e576c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e576c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 0x5565e57ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c6100 con 0x5565e576cde0 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c5a30 con 0x5565e5767db0 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75101c2c70 con 0x5565e5772670 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.263+0000 7f7518cae740 10 client.0 _ll_register_callbacks cb 0x7f750000dc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.265+0000 7f7514e72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 0x5565e57ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.265+0000 7f7514e72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 0x5565e57ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60946/0 (socket says 172.21.15.17:60946) 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.265+0000 7f7514e72640 1 -- 172.21.15.17:0/1916780614 learned_addr learned my addr 172.21.15.17:0/1916780614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.266+0000 7f750f7fe640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e576c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.267+0000 7f750f7fe640 1 -- 172.21.15.17:0/1916780614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767db0 msgr2=0x5565e576c360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.267+0000 7f750f7fe640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767db0 0x5565e576c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.267+0000 7f750f7fe640 1 -- 172.21.15.17:0/1916780614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 msgr2=0x5565e57ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.267+0000 7f750f7fe640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 0x5565e57ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.267+0000 7f750f7fe640 1 -- 172.21.15.17:0/1916780614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e57ec160 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.271+0000 7f750f7fe640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e576c8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f750802aee0 tx=0x7f75080bb150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d7b464cfac9efd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.271+0000 7f74ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.271+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080c56b0 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.272+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565e56da850 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.272+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f75080db330 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.276+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f75080c0ff0 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.276+0000 7f7518cae740 10 client.25192 fetch_fsmap learned FSMap version 29 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.276+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565e57ed530 con 0x5565e5772670 2024-09-10T11:44:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5565e56da850 con 0x5565e5772670 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f750809bcd0 con 0x5565e5772670 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 10 client.25192 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 10 client.25192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 20 client.25192 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e57eda90 0x5565e57efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 4 client.25192 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.282+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565e56d4d60 con 0x5565e57eda90 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.285+0000 7f750ffff640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e57eda90 0x5565e57efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.287+0000 7f750ffff640 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e57eda90 0x5565e57efeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f97981574c273e server_cookie=80093095b686da97 in_seq=0 out_seq=0 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f74ef7fe640 10 client.25192 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f74ef7fe640 1 -- 172.21.15.17:0/1916780614 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5565e56d4d60 con 0x5565e57eda90 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f74ef7fe640 10 client.25192 handle_command_reply: tid=0 2024-09-10T11:44:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 client.25192 shutdown 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 msgr2=0x5565e576c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e576c8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f750802aee0 tx=0x7f75080bb150 comp rx=0 tx=0).stop 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 shutdown_connections 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5565e57eda90 0x5565e57efeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565e5772670 0x5565e576c8a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e576cde0 0x5565e57ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (135 inodes in the stack)", 2024-09-10T11:44:19.421 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: "59449390-a7a5-4275-bb63-805f417b979d": { 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "59449390-a7a5-4275-bb63-805f417b979d", 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 --2- 172.21.15.17:0/1916780614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5565e5767db0 0x5565e576c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 >> 172.21.15.17:0/1916780614 conn(0x5565e5763a20 msgr2=0x5565e5762380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.289+0000 7f74ef7fe640 0 client.25192 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:19.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.290+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 shutdown_connections 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.290+0000 7f7518cae740 1 -- 172.21.15.17:0/1916780614 wait complete. 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.290+0000 7f7518cae740 20 client.25192 trim_cache size 0 max 16384 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.301+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 msgr2=0x7f74f80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.301+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 0x7f74f80a5250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7500012940 tx=0x7f7500005e70 comp rx=0 tx=0).stop 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.301+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 msgr2=0x7f751006caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.301+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7508031fd0 tx=0x7f7508031a20 comp rx=0 tx=0).stop 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 shutdown_connections 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f74f80a2d90 0x7f74f80a5250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7510108da0 0x7f751006caf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751010d520 0x7f751006d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 --2- 172.21.15.17:0/2088970954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75101083f0 0x7f7510073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.302+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 >> 172.21.15.17:0/2088970954 conn(0x7f7510077af0 msgr2=0x7f7510078ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.303+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 shutdown_connections 2024-09-10T11:44:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:19.303+0000 7f75168d5640 1 -- 172.21.15.17:0/2088970954 wait complete. 2024-09-10T11:44:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:19 smithi081 ceph-mon[35059]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 564 MiB/s wr, 5.85k op/s 2024-09-10T11:44:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:19 smithi026 ceph-mon[34817]: pgmap v388: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 564 MiB/s wr, 5.85k op/s 2024-09-10T11:44:20.563 INFO:tasks.cephfs.filesystem:scrub status for tag:59449390-a7a5-4275-bb63-805f417b979d - {'path': '/', 'tag': '59449390-a7a5-4275-bb63-805f417b979d', 'options': 'recursive,force'} 2024-09-10T11:44:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:21 smithi026 ceph-mon[34817]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 469 MiB/s wr, 13.66k op/s 2024-09-10T11:44:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:21 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:21.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:21 smithi017 ceph-mon[30817]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 469 MiB/s wr, 13.66k op/s 2024-09-10T11:44:21.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:21 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:21.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:21 smithi081 ceph-mon[35059]: pgmap v389: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 469 MiB/s wr, 13.66k op/s 2024-09-10T11:44:21.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:21 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:23 smithi026 ceph-mon[34817]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 349 MiB/s wr, 17.10k op/s 2024-09-10T11:44:23.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:23 smithi017 ceph-mon[30817]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 349 MiB/s wr, 17.10k op/s 2024-09-10T11:44:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:23 smithi081 ceph-mon[35059]: pgmap v390: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 349 MiB/s wr, 17.10k op/s 2024-09-10T11:44:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:25 smithi026 ceph-mon[34817]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 357 MiB/s wr, 23.80k op/s 2024-09-10T11:44:25.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:25 smithi017 ceph-mon[30817]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 357 MiB/s wr, 23.80k op/s 2024-09-10T11:44:25.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:25 smithi081 ceph-mon[35059]: pgmap v391: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 357 MiB/s wr, 23.80k op/s 2024-09-10T11:44:26.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:26 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:26.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:26 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:26.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:26 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:27 smithi081 ceph-mon[35059]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 239 MiB/s wr, 26.19k op/s 2024-09-10T11:44:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:27 smithi026 ceph-mon[34817]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 239 MiB/s wr, 26.19k op/s 2024-09-10T11:44:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:27 smithi017 ceph-mon[30817]: pgmap v392: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 239 MiB/s wr, 26.19k op/s 2024-09-10T11:44:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:29 smithi081 ceph-mon[35059]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 234 MiB/s wr, 28.27k op/s 2024-09-10T11:44:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:29 smithi026 ceph-mon[34817]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 234 MiB/s wr, 28.27k op/s 2024-09-10T11:44:29.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:29 smithi017 ceph-mon[30817]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 234 MiB/s wr, 28.27k op/s 2024-09-10T11:44:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:31 smithi081 ceph-mon[35059]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 271 MiB/s wr, 31.07k op/s 2024-09-10T11:44:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:31 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:31.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:31 smithi026 ceph-mon[34817]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 271 MiB/s wr, 31.07k op/s 2024-09-10T11:44:31.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:31 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:31.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:31 smithi017 ceph-mon[30817]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 271 MiB/s wr, 31.07k op/s 2024-09-10T11:44:31.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:31 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:33 smithi081 ceph-mon[35059]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 268 MiB/s wr, 28.04k op/s 2024-09-10T11:44:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:33 smithi026 ceph-mon[34817]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 268 MiB/s wr, 28.04k op/s 2024-09-10T11:44:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:33 smithi017 ceph-mon[30817]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 268 MiB/s wr, 28.04k op/s 2024-09-10T11:44:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:35 smithi081 ceph-mon[35059]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 301 MiB/s wr, 29.39k op/s 2024-09-10T11:44:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:35 smithi026 ceph-mon[34817]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 301 MiB/s wr, 29.39k op/s 2024-09-10T11:44:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:35 smithi017 ceph-mon[30817]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 301 MiB/s wr, 29.39k op/s 2024-09-10T11:44:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:36 smithi081 ceph-mon[35059]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 306 MiB/s wr, 27.35k op/s 2024-09-10T11:44:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:36 smithi026 ceph-mon[34817]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 306 MiB/s wr, 27.35k op/s 2024-09-10T11:44:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:36 smithi017 ceph-mon[30817]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 306 MiB/s wr, 27.35k op/s 2024-09-10T11:44:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:38 smithi081 ceph-mon[35059]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 316 MiB/s wr, 26.70k op/s 2024-09-10T11:44:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:38 smithi026 ceph-mon[34817]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 316 MiB/s wr, 26.70k op/s 2024-09-10T11:44:39.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:38 smithi017 ceph-mon[30817]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 316 MiB/s wr, 26.70k op/s 2024-09-10T11:44:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:40 smithi081 ceph-mon[35059]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 363 MiB/s wr, 28.56k op/s 2024-09-10T11:44:41.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:40 smithi026 ceph-mon[34817]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 363 MiB/s wr, 28.56k op/s 2024-09-10T11:44:41.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:40 smithi017 ceph-mon[30817]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 45 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 363 MiB/s wr, 28.56k op/s 2024-09-10T11:44:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:42 smithi081 ceph-mon[35059]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 360 MiB/s wr, 26.52k op/s 2024-09-10T11:44:43.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:42 smithi026 ceph-mon[34817]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 360 MiB/s wr, 26.52k op/s 2024-09-10T11:44:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:42 smithi017 ceph-mon[30817]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 46 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 360 MiB/s wr, 26.52k op/s 2024-09-10T11:44:44.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:44 smithi081 ceph-mon[35059]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 361 MiB/s wr, 26.26k op/s 2024-09-10T11:44:45.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:44 smithi026 ceph-mon[34817]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 361 MiB/s wr, 26.26k op/s 2024-09-10T11:44:45.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:44 smithi017 ceph-mon[30817]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 361 MiB/s wr, 26.26k op/s 2024-09-10T11:44:46.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:46 smithi081 ceph-mon[35059]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 351 MiB/s wr, 25.64k op/s 2024-09-10T11:44:47.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:46 smithi026 ceph-mon[34817]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 351 MiB/s wr, 25.64k op/s 2024-09-10T11:44:47.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:46 smithi017 ceph-mon[30817]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 47 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 351 MiB/s wr, 25.64k op/s 2024-09-10T11:44:47.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:47 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:44:48.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:47 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:44:48.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:47 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 324 MiB/s wr, 23.91k op/s 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:44:49.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 324 MiB/s wr, 23.91k op/s 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:44:49.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:44:49.455 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 324 MiB/s wr, 23.91k op/s 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:44:49.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:44:50.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:44:51.182 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:44:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:50 smithi081 ceph-mon[35059]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 328 MiB/s wr, 24.93k op/s 2024-09-10T11:44:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:50 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:50 smithi026 ceph-mon[34817]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 328 MiB/s wr, 24.93k op/s 2024-09-10T11:44:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:50 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:51.273 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:50 smithi017 ceph-mon[30817]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 48 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 328 MiB/s wr, 24.93k op/s 2024-09-10T11:44:51.273 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:50 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (110 inodes in the stack)", 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "59449390-a7a5-4275-bb63-805f417b979d": { 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "59449390-a7a5-4275-bb63-805f417b979d", 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:44:52.523 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:44:52.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 -- 172.21.15.17:0/3088192281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410acb0 msgr2=0x7fb804113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 --2- 172.21.15.17:0/3088192281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410acb0 0x7fb804113370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009900 tx=0x7fb7f402a410 comp rx=0 tx=0).stop 2024-09-10T11:44:52.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 -- 172.21.15.17:0/3088192281 shutdown_connections 2024-09-10T11:44:52.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 --2- 172.21.15.17:0/3088192281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 0x7fb804115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 --2- 172.21.15.17:0/3088192281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410acb0 0x7fb804113370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 --2- 172.21.15.17:0/3088192281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410a300 0x7fb80410a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 -- 172.21.15.17:0/3088192281 >> 172.21.15.17:0/3088192281 conn(0x7fb804073660 msgr2=0x7fb804073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 -- 172.21.15.17:0/3088192281 shutdown_connections 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.372+0000 7fb80c14b640 1 -- 172.21.15.17:0/3088192281 wait complete. 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.374+0000 7fb80c14b640 1 Processor -- start 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.374+0000 7fb80c14b640 1 -- start start 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.374+0000 7fb80c14b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 0x7fb8041a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.374+0000 7fb80c14b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 0x7fb8041a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.374+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 0x7fb8041a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 0x7fb8041a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45018/0 (socket says 172.21.15.17:45018) 2024-09-10T11:44:52.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb809ee7640 1 -- 172.21.15.17:0/2616501870 learned_addr learned my addr 172.21.15.17:0/2616501870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 0x7fb8041a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb80c14b640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 0x7fb80419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb80c14b640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb804118480 con 0x7fb8041138b0 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb80c14b640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb804118300 con 0x7fb80410a300 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 0x7fb80419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb80c14b640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb804118600 con 0x7fb80410acb0 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 -- 172.21.15.17:0/2616501870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 msgr2=0x7fb8041a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 0x7fb8041a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 -- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 msgr2=0x7fb80419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 0x7fb80419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.375+0000 7fb8096e6640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80419ef30 con 0x7fb80410acb0 2024-09-10T11:44:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.376+0000 7fb8096e6640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 0x7fb8041a4b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402a930 tx=0x7fb7f4003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.379+0000 7fb7faffd640 1 -- 172.21.15.17:0/2616501870 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f403f070 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.379+0000 7fb7faffd640 1 -- 172.21.15.17:0/2616501870 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4031c90 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.379+0000 7fb7faffd640 1 -- 172.21.15.17:0/2616501870 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4035030 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.380+0000 7fb80c14b640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80419f1c0 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.380+0000 7fb80c14b640 1 -- 172.21.15.17:0/2616501870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80419f620 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.384+0000 7fb80e524740 1 Processor -- start 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.386+0000 7fb7faffd640 1 -- 172.21.15.17:0/2616501870 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb7f4042070 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.387+0000 7fb80e524740 1 -- start start 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.388+0000 7fb7faffd640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 0x7fb7f00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.388+0000 7fb7faffd640 1 -- 172.21.15.17:0/2616501870 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fb7f40f0010 con 0x7fb80410acb0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.389+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 0x7fb7f00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.389+0000 7fb80e524740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.390+0000 7fb80e524740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ecb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.390+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 0x7fb7f00a5210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001160 tx=0x7fb7fc0010f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.390+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.390+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:45644/0 (socket says 172.21.15.17:45644) 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.390+0000 7fb80e524740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ecbb20 0x563ae5ecbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 -- 172.21.15.17:0/231569720 learned_addr learned my addr 172.21.15.17:0/231569720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ae5e272e0 con 0x563ae5ed14d0 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563ae5dcece0 con 0x563ae5ecbb20 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563ae5e232a0 con 0x563ae5ed0bb0 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 -- 172.21.15.17:0/231569720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ecbb20 msgr2=0x563ae5ecbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ecbb20 0x563ae5ecbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 -- 172.21.15.17:0/231569720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 msgr2=0x563ae5ecb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ecb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.391+0000 7fb809ee7640 1 -- 172.21.15.17:0/231569720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ae5db3440 con 0x563ae5ed0bb0 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.392+0000 7fb809ee7640 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb800009e10 tx=0x7fb800011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e50505a7c55c15f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.393+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/231569720 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80001e070 con 0x563ae5ed0bb0 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.394+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/231569720 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb800019b10 con 0x563ae5ed0bb0 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.394+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/231569720 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80000fc60 con 0x563ae5ed0bb0 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 msgr2=0x563ae5ed0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb800009e10 tx=0x7fb800011810 comp rx=0 tx=0).stop 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 shutdown_connections 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ecbb20 0x563ae5ecbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ecb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 --2- 172.21.15.17:0/231569720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed0f90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.395+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 >> 172.21.15.17:0/231569720 conn(0x563ae5ebd9b0 msgr2=0x563ae5ebdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.396+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 shutdown_connections 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.396+0000 7fb80e524740 1 -- 172.21.15.17:0/231569720 wait complete. 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.396+0000 7fb80e524740 1 -- start start 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.397+0000 7fb80e524740 1 Processor -- start 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.397+0000 7fb80e524740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 0x563ae5ed7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ed4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ae5ed7e20 con 0x563ae5ed14d0 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563ae5de2050 con 0x563ae5ed0bb0 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45040/0 (socket says 172.21.15.17:45040) 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 -- 172.21.15.17:0/719751509 learned_addr learned my addr 172.21.15.17:0/719751509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563ae5ed7fa0 con 0x563ae5ecbb20 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ed4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb809ee7640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 0x563ae5ed7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 10 client.0 _ll_register_callbacks cb 0x563ae5e22160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 -- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 msgr2=0x563ae5ed7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 0x563ae5ed7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 -- 172.21.15.17:0/719751509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 msgr2=0x563ae5ed4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ed4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb8096e6640 1 -- 172.21.15.17:0/719751509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ae5b983c0 con 0x563ae5ed0bb0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.398+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb800019b10 con 0x563ae5ed0bb0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.399+0000 7fb809ee7640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 0x563ae5ed7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.401+0000 7fb8096e6640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40c4f60 tx=0x7fb7f40bc420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9c78d0350f0671 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.401+0000 7fb7ed7fa640 10 client.25232 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.401+0000 7fb7ed7fa640 1 -- 172.21.15.17:0/719751509 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40d4020 con 0x563ae5ed0bb0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb7ed7fa640 1 -- 172.21.15.17:0/719751509 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fb7f403b460 con 0x563ae5ed0bb0 2024-09-10T11:44:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb7ed7fa640 1 -- 172.21.15.17:0/719751509 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb7f40bcf20 con 0x563ae5ed0bb0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb80e524740 10 client.25232 fetch_fsmap learned FSMap version 33 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=33}) -- 0x563ae5ed7f00 con 0x563ae5ed0bb0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb7ed7fa640 1 -- 172.21.15.17:0/719751509 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb7f404c060 con 0x563ae5ed0bb0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.402+0000 7fb80e524740 10 client.25232 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.403+0000 7fb80e524740 10 client.25232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.403+0000 7fb80e524740 20 client.25232 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.403+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5ee4bc0 0x563ae5ee6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.403+0000 7fb80e524740 4 client.25232 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.403+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ae5e34850 con 0x563ae5ee4bc0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.405+0000 7fb809ee7640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5ee4bc0 0x563ae5ee6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.415+0000 7fb809ee7640 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5ee4bc0 0x563ae5ee6fe0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc9725267beb64f server_cookie=b28e9c2817245fe8 in_seq=0 out_seq=0 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.415+0000 7fb7ed7fa640 10 client.25232 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.416+0000 7fb7ed7fa640 1 -- 172.21.15.17:0/719751509 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ae5e34850 con 0x563ae5ee4bc0 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.416+0000 7fb7ed7fa640 10 client.25232 handle_command_reply: tid=0 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.416+0000 7fb80e524740 1 client.25232 shutdown 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.416+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 msgr2=0x563ae5ed44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.416+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40c4f60 tx=0x7fb7f40bc420 comp rx=0 tx=0).stop 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 shutdown_connections 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5ee4bc0 0x563ae5ee6fe0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ed14d0 0x563ae5ed4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed44c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 --2- 172.21.15.17:0/719751509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ecbb20 0x563ae5ed7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 >> 172.21.15.17:0/719751509 conn(0x563ae5ebd9b0 msgr2=0x563ae5eca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb7ed7fa640 0 client.25232 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 shutdown_connections 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 1 -- 172.21.15.17:0/719751509 wait complete. 2024-09-10T11:44:52.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.417+0000 7fb80e524740 20 client.25232 trim_cache size 0 max 16384 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.452+0000 7fb80e524740 1 Processor -- start 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.453+0000 7fb80e524740 1 -- start start 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.453+0000 7fb80e524740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.453+0000 7fb80e524740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.454+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.454+0000 7fb809ee7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57698/0 (socket says 172.21.15.17:57698) 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.454+0000 7fb809ee7640 1 -- 172.21.15.17:0/3466959294 learned_addr learned my addr 172.21.15.17:0/3466959294 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.454+0000 7fb80e524740 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed14d0 0x563ae5ebcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.454+0000 7fb8096e6640 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.455+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b3a60 con 0x563ae5ecbb20 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.455+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed14d0 0x563ae5ebcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.455+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b5690 con 0x563ae5ed0bb0 2024-09-10T11:44:52.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.455+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b4130 con 0x563ae5ed14d0 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.456+0000 7fb809ee7640 1 -- 172.21.15.17:0/3466959294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed14d0 msgr2=0x563ae5ebcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.456+0000 7fb809ee7640 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed14d0 0x563ae5ebcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.456+0000 7fb809ee7640 1 -- 172.21.15.17:0/3466959294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 msgr2=0x563ae5ed49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.456+0000 7fb809ee7640 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.456+0000 7fb809ee7640 1 -- 172.21.15.17:0/3466959294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ae5ed3470 con 0x563ae5ecbb20 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.457+0000 7fb809ee7640 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb800011d10 tx=0x7fb80000f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80c70c2714ed94a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.458+0000 7fb7eeffd640 1 -- 172.21.15.17:0/3466959294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800032070 con 0x563ae5ecbb20 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.458+0000 7fb7eeffd640 1 -- 172.21.15.17:0/3466959294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb800029030 con 0x563ae5ecbb20 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.458+0000 7fb7eeffd640 1 -- 172.21.15.17:0/3466959294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80001e040 con 0x563ae5ecbb20 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.460+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 msgr2=0x563ae5ee10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.460+0000 7fb80e524740 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb800011d10 tx=0x7fb80000f550 comp rx=0 tx=0).stop 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.461+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 shutdown_connections 2024-09-10T11:44:52.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.461+0000 7fb80e524740 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed14d0 0x563ae5ebcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.461+0000 7fb80e524740 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed0bb0 0x563ae5ed49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.461+0000 7fb80e524740 1 --2- 172.21.15.17:0/3466959294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5ee10c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.461+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 >> 172.21.15.17:0/3466959294 conn(0x563ae5ebd9b0 msgr2=0x563ae5ed42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.462+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 shutdown_connections 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.462+0000 7fb80e524740 1 -- 172.21.15.17:0/3466959294 wait complete. 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.463+0000 7fb80e524740 1 -- start start 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.463+0000 7fb80e524740 1 Processor -- start 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5edd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5eec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 0x563ae5eec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b4f00 con 0x563ae5ecbb20 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b4800 con 0x563ae5ed14d0 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041b1a40 con 0x563ae5ed0bb0 2024-09-10T11:44:52.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb80e524740 10 client.0 _ll_register_callbacks cb 0x7fb7f40b8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb8096e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5eec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.464+0000 7fb8096e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5eec180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:45674/0 (socket says 172.21.15.17:45674) 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb8096e6640 1 -- 172.21.15.17:0/1865571203 learned_addr learned my addr 172.21.15.17:0/1865571203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 0x563ae5eec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb809ee7640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5edd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 -- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 msgr2=0x563ae5eec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5eec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 -- 172.21.15.17:0/1865571203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 msgr2=0x563ae5edd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5edd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb80a6e8640 1 -- 172.21.15.17:0/1865571203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ae5e8fde0 con 0x563ae5ed14d0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.465+0000 7fb809ee7640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5edd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.466+0000 7fb80a6e8640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 0x563ae5eec6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x563ae5ebf200 tx=0x7fb7fc0012e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e094a816fd02e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.466+0000 7fb7ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.466+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc02b060 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.466+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fb7fc01ccd0 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.467+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb800029030 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.467+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb7fc0263f0 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.467+0000 7fb80e524740 10 client.25238 fetch_fsmap learned FSMap version 33 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.467+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563ae5f4f6f0 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.468+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc026a70 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.468+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb7fc025030 con 0x563ae5ed14d0 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 10 client.25238 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 10 client.25238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 20 client.25238 populate_metadata read hostname 'smithi017' 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5f4fda0 0x563ae5f52190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:52.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 4 client.25238 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.469+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb800029030 con 0x563ae5f4fda0 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.470+0000 7fb809ee7640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5f4fda0 0x563ae5f52190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.470+0000 7fb7ecff9640 10 client.25238 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.470+0000 7fb809ee7640 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5f4fda0 0x563ae5f52190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b30ef8e66bb883c server_cookie=162f1f6f06b53b7e in_seq=0 out_seq=0 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb7ecff9640 1 -- 172.21.15.17:0/1865571203 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x7fb800029030 con 0x563ae5f4fda0 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb7ecff9640 10 client.25238 handle_command_reply: tid=0 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 client.25238 shutdown 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 msgr2=0x563ae5eec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 0x563ae5eec6c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x563ae5ebf200 tx=0x7fb7fc0012e0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 shutdown_connections 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563ae5f4fda0 0x563ae5f52190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb7ecff9640 0 client.25238 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:44:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ae5ed0bb0 0x563ae5eec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ae5ed14d0 0x563ae5eec6c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 --2- 172.21.15.17:0/1865571203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ae5ecbb20 0x563ae5edd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.471+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 >> 172.21.15.17:0/1865571203 conn(0x563ae5ebd9b0 msgr2=0x563ae5ebcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.472+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 shutdown_connections 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.472+0000 7fb80e524740 1 -- 172.21.15.17:0/1865571203 wait complete. 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.472+0000 7fb80e524740 20 client.25238 trim_cache size 0 max 16384 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 msgr2=0x7fb7f00a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 0x7fb7f00a5210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001160 tx=0x7fb7fc0010f0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 msgr2=0x7fb8041a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 0x7fb8041a4b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402a930 tx=0x7fb7f4003b90 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 shutdown_connections 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fb7f00a2d50 0x7fb7f00a5210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb80410acb0 0x7fb8041a4b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8041138b0 0x7fb80419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 --2- 172.21.15.17:0/2616501870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb80410a300 0x7fb8041a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 >> 172.21.15.17:0/2616501870 conn(0x7fb804073660 msgr2=0x7fb80406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 shutdown_connections 2024-09-10T11:44:52.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:44:52.473+0000 7fb7f8ff9640 1 -- 172.21.15.17:0/2616501870 wait complete. 2024-09-10T11:44:53.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:52 smithi081 ceph-mon[35059]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 304 MiB/s wr, 24.79k op/s 2024-09-10T11:44:53.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:52 smithi026 ceph-mon[34817]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 304 MiB/s wr, 24.79k op/s 2024-09-10T11:44:53.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:52 smithi017 ceph-mon[30817]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 304 MiB/s wr, 24.79k op/s 2024-09-10T11:44:53.769 INFO:tasks.cephfs.filesystem:scrub status for tag:59449390-a7a5-4275-bb63-805f417b979d - {'path': '/', 'tag': '59449390-a7a5-4275-bb63-805f417b979d', 'options': 'recursive,force'} 2024-09-10T11:44:55.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:54 smithi081 ceph-mon[35059]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 326 KiB/s rd, 270 MiB/s wr, 22.96k op/s 2024-09-10T11:44:55.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:54 smithi026 ceph-mon[34817]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 326 KiB/s rd, 270 MiB/s wr, 22.96k op/s 2024-09-10T11:44:55.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:54 smithi017 ceph-mon[30817]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1024 GiB / 1.0 TiB avail; 326 KiB/s rd, 270 MiB/s wr, 22.96k op/s 2024-09-10T11:44:57.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:56 smithi026 ceph-mon[34817]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 394 KiB/s rd, 257 MiB/s wr, 22.16k op/s 2024-09-10T11:44:57.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:56 smithi017 ceph-mon[30817]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 394 KiB/s rd, 257 MiB/s wr, 22.16k op/s 2024-09-10T11:44:57.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:56 smithi081 ceph-mon[35059]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 49 GiB used, 1023 GiB / 1.0 TiB avail; 394 KiB/s rd, 257 MiB/s wr, 22.16k op/s 2024-09-10T11:44:59.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:44:58 smithi026 ceph-mon[34817]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 349 KiB/s rd, 247 MiB/s wr, 21.86k op/s 2024-09-10T11:44:59.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:44:58 smithi017 ceph-mon[30817]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 349 KiB/s rd, 247 MiB/s wr, 21.86k op/s 2024-09-10T11:44:59.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:44:58 smithi081 ceph-mon[35059]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 50 GiB used, 1023 GiB / 1.0 TiB avail; 349 KiB/s rd, 247 MiB/s wr, 21.86k op/s 2024-09-10T11:45:01.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:01 smithi081 ceph-mon[35059]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 534 KiB/s rd, 250 MiB/s wr, 22.61k op/s 2024-09-10T11:45:01.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:01 smithi026 ceph-mon[34817]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 534 KiB/s rd, 250 MiB/s wr, 22.61k op/s 2024-09-10T11:45:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:01 smithi017 ceph-mon[30817]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 534 KiB/s rd, 250 MiB/s wr, 22.61k op/s 2024-09-10T11:45:03.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:03 smithi081 ceph-mon[35059]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 412 KiB/s rd, 264 MiB/s wr, 24.47k op/s 2024-09-10T11:45:03.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:03 smithi026 ceph-mon[34817]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 412 KiB/s rd, 264 MiB/s wr, 24.47k op/s 2024-09-10T11:45:03.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:03 smithi017 ceph-mon[30817]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1022 GiB / 1.0 TiB avail; 412 KiB/s rd, 264 MiB/s wr, 24.47k op/s 2024-09-10T11:45:05.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:05 smithi017 ceph-mon[30817]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 398 KiB/s rd, 230 MiB/s wr, 21.76k op/s 2024-09-10T11:45:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:05 smithi081 ceph-mon[35059]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 398 KiB/s rd, 230 MiB/s wr, 21.76k op/s 2024-09-10T11:45:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:05 smithi026 ceph-mon[34817]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 51 GiB used, 1021 GiB / 1.0 TiB avail; 398 KiB/s rd, 230 MiB/s wr, 21.76k op/s 2024-09-10T11:45:07.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:07 smithi081 ceph-mon[35059]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 382 KiB/s rd, 255 MiB/s wr, 24.45k op/s 2024-09-10T11:45:07.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:07 smithi026 ceph-mon[34817]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 382 KiB/s rd, 255 MiB/s wr, 24.45k op/s 2024-09-10T11:45:07.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:07 smithi017 ceph-mon[30817]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 52 GiB used, 1021 GiB / 1.0 TiB avail; 382 KiB/s rd, 255 MiB/s wr, 24.45k op/s 2024-09-10T11:45:09.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:09 smithi081 ceph-mon[35059]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 331 KiB/s rd, 258 MiB/s wr, 24.80k op/s 2024-09-10T11:45:09.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:09 smithi026 ceph-mon[34817]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 331 KiB/s rd, 258 MiB/s wr, 24.80k op/s 2024-09-10T11:45:09.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:09 smithi017 ceph-mon[30817]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 53 GiB used, 1020 GiB / 1.0 TiB avail; 331 KiB/s rd, 258 MiB/s wr, 24.80k op/s 2024-09-10T11:45:11.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:11 smithi081 ceph-mon[35059]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 413 KiB/s rd, 260 MiB/s wr, 24.78k op/s 2024-09-10T11:45:11.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:11 smithi026 ceph-mon[34817]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 413 KiB/s rd, 260 MiB/s wr, 24.78k op/s 2024-09-10T11:45:11.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:11 smithi017 ceph-mon[30817]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 413 KiB/s rd, 260 MiB/s wr, 24.78k op/s 2024-09-10T11:45:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:13 smithi081 ceph-mon[35059]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 288 KiB/s rd, 266 MiB/s wr, 25.05k op/s 2024-09-10T11:45:13.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:13 smithi026 ceph-mon[34817]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 288 KiB/s rd, 266 MiB/s wr, 25.05k op/s 2024-09-10T11:45:13.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:13 smithi017 ceph-mon[30817]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 288 KiB/s rd, 266 MiB/s wr, 25.05k op/s 2024-09-10T11:45:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:15 smithi081 ceph-mon[35059]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 416 KiB/s rd, 246 MiB/s wr, 23.22k op/s 2024-09-10T11:45:15.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:15 smithi026 ceph-mon[34817]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 416 KiB/s rd, 246 MiB/s wr, 23.22k op/s 2024-09-10T11:45:15.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:15 smithi017 ceph-mon[30817]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 54 GiB used, 1019 GiB / 1.0 TiB avail; 416 KiB/s rd, 246 MiB/s wr, 23.22k op/s 2024-09-10T11:45:16.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:16 smithi081 ceph-mon[35059]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 439 KiB/s rd, 258 MiB/s wr, 24.27k op/s 2024-09-10T11:45:16.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:16 smithi026 ceph-mon[34817]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 439 KiB/s rd, 258 MiB/s wr, 24.27k op/s 2024-09-10T11:45:16.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:16 smithi017 ceph-mon[30817]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 55 GiB used, 1018 GiB / 1.0 TiB avail; 439 KiB/s rd, 258 MiB/s wr, 24.27k op/s 2024-09-10T11:45:18.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:18 smithi081 ceph-mon[35059]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 436 KiB/s rd, 264 MiB/s wr, 24.31k op/s 2024-09-10T11:45:19.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:18 smithi026 ceph-mon[34817]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 436 KiB/s rd, 264 MiB/s wr, 24.31k op/s 2024-09-10T11:45:19.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:18 smithi017 ceph-mon[30817]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 436 KiB/s rd, 264 MiB/s wr, 24.31k op/s 2024-09-10T11:45:20.823 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:20 smithi017 ceph-mon[30817]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 418 KiB/s rd, 257 MiB/s wr, 23.46k op/s 2024-09-10T11:45:20.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:20 smithi081 ceph-mon[35059]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 418 KiB/s rd, 257 MiB/s wr, 23.46k op/s 2024-09-10T11:45:21.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:20 smithi026 ceph-mon[34817]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 418 KiB/s rd, 257 MiB/s wr, 23.46k op/s 2024-09-10T11:45:22.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:22 smithi081 ceph-mon[35059]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 334 KiB/s rd, 225 MiB/s wr, 20.47k op/s 2024-09-10T11:45:23.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:22 smithi026 ceph-mon[34817]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 334 KiB/s rd, 225 MiB/s wr, 20.47k op/s 2024-09-10T11:45:23.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:22 smithi017 ceph-mon[30817]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 56 GiB used, 1017 GiB / 1.0 TiB avail; 334 KiB/s rd, 225 MiB/s wr, 20.47k op/s 2024-09-10T11:45:23.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:45:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:45:24.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:24 smithi017 ceph-mon[30817]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 406 KiB/s rd, 248 MiB/s wr, 22.58k op/s 2024-09-10T11:45:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:24 smithi081 ceph-mon[35059]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 406 KiB/s rd, 248 MiB/s wr, 22.58k op/s 2024-09-10T11:45:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:24 smithi026 ceph-mon[34817]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 406 KiB/s rd, 248 MiB/s wr, 22.58k op/s 2024-09-10T11:45:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 -- 172.21.15.17:0/1496222246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44102ef0 msgr2=0x7fcb4410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 --2- 172.21.15.17:0/1496222246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44102ef0 0x7fcb4410da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009930 tx=0x7fcb2c02a510 comp rx=0 tx=0).stop 2024-09-10T11:45:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 -- 172.21.15.17:0/1496222246 shutdown_connections 2024-09-10T11:45:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 --2- 172.21.15.17:0/1496222246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44102ef0 0x7fcb4410da40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 --2- 172.21.15.17:0/1496222246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 0x7fcb441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 --2- 172.21.15.17:0/1496222246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb44100e20 0x7fcb44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.418+0000 7fcb4a268640 1 -- 172.21.15.17:0/1496222246 >> 172.21.15.17:0/1496222246 conn(0x7fcb440fc7d0 msgr2=0x7fcb440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.419+0000 7fcb4a268640 1 -- 172.21.15.17:0/1496222246 shutdown_connections 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.419+0000 7fcb4a268640 1 -- 172.21.15.17:0/1496222246 wait complete. 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.420+0000 7fcb4a268640 1 Processor -- start 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.420+0000 7fcb4a268640 1 -- start start 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 0x7fcb4410a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb44102ef0 0x7fcb4410a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410ff00 con 0x7fcb44102ef0 2024-09-10T11:45:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410fd80 con 0x7fcb44102570 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.421+0000 7fcb4a268640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44110080 con 0x7fcb44100e20 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60540/0 (socket says 172.21.15.17:60540) 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 -- 172.21.15.17:0/2356454714 learned_addr learned my addr 172.21.15.17:0/2356454714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb437fe640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 0x7fcb4410a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 -- 172.21.15.17:0/2356454714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 msgr2=0x7fcb4410a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 0x7fcb4410a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 -- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb44102ef0 msgr2=0x7fcb4410a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb44102ef0 0x7fcb4410a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.422+0000 7fcb43fff640 1 -- 172.21.15.17:0/2356454714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb44073c60 con 0x7fcb44100e20 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.423+0000 7fcb43fff640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400d980 tx=0x7fcb3400de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.423+0000 7fcb417fa640 1 -- 172.21.15.17:0/2356454714 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34017070 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.423+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb44073f50 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.423+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb44115970 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.425+0000 7fcb417fa640 1 -- 172.21.15.17:0/2356454714 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb34009c30 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.425+0000 7fcb417fa640 1 -- 172.21.15.17:0/2356454714 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400f6b0 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.428+0000 7fcb417fa640 1 -- 172.21.15.17:0/2356454714 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb3400f850 con 0x7fcb44100e20 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.430+0000 7fcb4c641740 1 Processor -- start 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.430+0000 7fcb4c641740 1 -- start start 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a58880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5597299be2e0 con 0x559729a584a0 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559729965ce0 con 0x559729a58dc0 2024-09-10T11:45:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb4c641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5597299ba2a0 con 0x559729a63680 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb417fa640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 0x7fcb300a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60548/0 (socket says 172.21.15.17:60548) 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb437fe640 1 -- 172.21.15.17:0/1796653767 learned_addr learned my addr 172.21.15.17:0/1796653767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.431+0000 7fcb43fff640 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 -- 172.21.15.17:0/1796653767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 msgr2=0x559729a63140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a63140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 -- 172.21.15.17:0/1796653767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 msgr2=0x559729a58880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a58880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 -- 172.21.15.17:0/1796653767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972994a440 con 0x559729a63680 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb437fe640 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009f00 tx=0x7fcb3c010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbc9c11b8625b243 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.432+0000 7fcb48805640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 0x7fcb300a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.433+0000 7fcb3a7fc640 1 -- 172.21.15.17:0/1796653767 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c016070 con 0x559729a63680 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.433+0000 7fcb3a7fc640 1 -- 172.21.15.17:0/1796653767 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb3c012930 con 0x559729a63680 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.433+0000 7fcb3a7fc640 1 -- 172.21.15.17:0/1796653767 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c016070 con 0x559729a63680 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.433+0000 7fcb417fa640 1 -- 172.21.15.17:0/2356454714 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcb340ceee0 con 0x7fcb44100e20 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb48805640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 0x7fcb300a5140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c02aa30 tx=0x7fcb2c005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 -- 172.21.15.17:0/1796653767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 msgr2=0x559729a65a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009f00 tx=0x7fcb3c010740 comp rx=0 tx=0).stop 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 -- 172.21.15.17:0/1796653767 shutdown_connections 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a63680 0x559729a65a70 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009f00 tx=0x7fcb3c010740 comp rx=0 tx=0).stop 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a63140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 --2- 172.21.15.17:0/1796653767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a58880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.435+0000 7fcb4c641740 1 -- 172.21.15.17:0/1796653767 >> 172.21.15.17:0/1796653767 conn(0x559729a54a30 msgr2=0x559729a54e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.436+0000 7fcb4c641740 1 -- 172.21.15.17:0/1796653767 shutdown_connections 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.436+0000 7fcb4c641740 1 -- 172.21.15.17:0/1796653767 wait complete. 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.437+0000 7fcb4c641740 1 -- start start 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.438+0000 7fcb4c641740 1 Processor -- start 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.438+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a60360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60558/0 (socket says 172.21.15.17:60558) 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb43fff640 1 -- 172.21.15.17:0/3718045460 learned_addr learned my addr 172.21.15.17:0/3718045460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729a6f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559729a66250 con 0x559729a60a50 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb48805640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729a6f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb437fe640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a60360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.439+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559729979050 con 0x559729a58dc0 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559729a663d0 con 0x559729a584a0 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb4c641740 10 client.0 _ll_register_callbacks cb 0x5597299b9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb48805640 1 -- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 msgr2=0x559729a630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb48805640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb48805640 1 -- 172.21.15.17:0/3718045460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 msgr2=0x559729a60360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb48805640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a60360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.440+0000 7fcb48805640 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55972972f3c0 con 0x559729a60a50 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.441+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.441+0000 7fcb437fe640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a60360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.441+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb3c012930 con 0x559729a60a50 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.442+0000 7fcb48805640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729a6f750 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009900 tx=0x7fcb2c0055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a7b7388b41b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.442+0000 7fcb237fe640 10 client.15597 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.442+0000 7fcb237fe640 1 -- 172.21.15.17:0/3718045460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c040070 con 0x559729a60a50 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.442+0000 7fcb237fe640 1 -- 172.21.15.17:0/3718045460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcb2c031740 con 0x559729a60a50 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.443+0000 7fcb237fe640 1 -- 172.21.15.17:0/3718045460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcb2c035040 con 0x559729a60a50 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.443+0000 7fcb4c641740 10 client.15597 fetch_fsmap learned FSMap version 33 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.443+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=33}) -- 0x559729a72020 con 0x559729a60a50 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb237fe640 1 -- 172.21.15.17:0/3718045460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fcb2c031980 con 0x559729a60a50 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 10 client.15597 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 20 client.15597 populate_metadata read hostname 'smithi017' 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729a75900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 4 client.15597 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597299cb850 con 0x559729a73440 2024-09-10T11:45:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.444+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729a75900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.445+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729a75900 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713f7427b4c98653 server_cookie=50883c687e4c48e9 in_seq=0 out_seq=0 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.445+0000 7fcb237fe640 10 client.15597 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb237fe640 1 -- 172.21.15.17:0/3718045460 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597299cb850 con 0x559729a73440 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb237fe640 10 client.15597 handle_command_reply: tid=0 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb4c641740 1 client.15597 shutdown 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 msgr2=0x559729a6f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729a6f750 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009900 tx=0x7fcb2c0055b0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 shutdown_connections 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.446+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729a75900 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729a6f750 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb237fe640 0 client.15597 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:25.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a58dc0 0x559729a60360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3718045460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a584a0 0x559729a630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 >> 172.21.15.17:0/3718045460 conn(0x559729a54a30 msgr2=0x559729a5a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 shutdown_connections 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 1 -- 172.21.15.17:0/3718045460 wait complete. 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.447+0000 7fcb4c641740 20 client.15597 trim_cache size 0 max 16384 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 Processor -- start 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 -- start start 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a5fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a6f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400e4b0 con 0x559729a584a0 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240100e0 con 0x559729a60a50 2024-09-10T11:45:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.488+0000 7fcb4c641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400eb80 con 0x559729a58dc0 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:50404/0 (socket says 172.21.15.17:50404) 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 -- 172.21.15.17:0/3686497643 learned_addr learned my addr 172.21.15.17:0/3686497643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 -- 172.21.15.17:0/3686497643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 msgr2=0x559729a6f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a6f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 -- 172.21.15.17:0/3686497643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 msgr2=0x559729a5fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a5fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.489+0000 7fcb48805640 1 -- 172.21.15.17:0/3686497643 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559729a65de0 con 0x559729a60a50 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.490+0000 7fcb48805640 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009850 tx=0x7fcb2c046000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b62f878cfc384c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.491+0000 7fcb39ffb640 1 -- 172.21.15.17:0/3686497643 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c060070 con 0x559729a60a50 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.491+0000 7fcb39ffb640 1 -- 172.21.15.17:0/3686497643 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb3c012930 con 0x559729a60a50 2024-09-10T11:45:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.491+0000 7fcb39ffb640 1 -- 172.21.15.17:0/3686497643 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c047470 con 0x559729a60a50 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 -- 172.21.15.17:0/3686497643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 msgr2=0x559729a6fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009850 tx=0x7fcb2c046000 comp rx=0 tx=0).stop 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 -- 172.21.15.17:0/3686497643 shutdown_connections 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a6f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a60a50 0x559729a6fa80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3686497643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a584a0 0x559729a5fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.493+0000 7fcb4c641740 1 -- 172.21.15.17:0/3686497643 >> 172.21.15.17:0/3686497643 conn(0x559729a54a30 msgr2=0x559729a5a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.494+0000 7fcb4c641740 1 -- 172.21.15.17:0/3686497643 shutdown_connections 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.494+0000 7fcb4c641740 1 -- 172.21.15.17:0/3686497643 wait complete. 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.494+0000 7fcb4c641740 1 -- start start 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.494+0000 7fcb4c641740 1 Processor -- start 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a67c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729add230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400f950 con 0x559729a60a50 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400f250 con 0x559729a584a0 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400c490 con 0x559729a58dc0 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.495+0000 7fcb4c641740 10 client.0 _ll_register_callbacks cb 0x7fcb2c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:50406/0 (socket says 172.21.15.17:50406) 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 -- 172.21.15.17:0/3815248761 learned_addr learned my addr 172.21.15.17:0/3815248761 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb437fe640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a67c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 -- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 msgr2=0x559729a67c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a67c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 -- 172.21.15.17:0/3815248761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 msgr2=0x559729add230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729add230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.496+0000 7fcb43fff640 1 -- 172.21.15.17:0/3815248761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559729a68500 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.498+0000 7fcb43fff640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb340980c0 tx=0x7fcb340d2510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a7e0214c37dc64f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.498+0000 7fcb237fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.498+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34020040 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.499+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb3c012930 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.499+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcb34099790 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.499+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcb34009de0 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.500+0000 7fcb4c641740 10 client.25256 fetch_fsmap learned FSMap version 33 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.500+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559729b008b0 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.501+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb3c012930 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.501+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fcb34097d60 con 0x559729a584a0 2024-09-10T11:45:25.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 10 client.25256 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 20 client.25256 populate_metadata read hostname 'smithi017' 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729b03050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 4 client.25256 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597299c5d60 con 0x559729a73440 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.502+0000 7fcb437fe640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729b03050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.503+0000 7fcb437fe640 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729b03050 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2aec127135e9557 server_cookie=a90e0117889e11e4 in_seq=0 out_seq=0 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.503+0000 7fcb237fe640 10 client.25256 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.503+0000 7fcb237fe640 1 -- 172.21.15.17:0/3815248761 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5597299c5d60 con 0x559729a73440 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.503+0000 7fcb237fe640 10 client.25256 handle_command_reply: tid=0 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.503+0000 7fcb4c641740 1 client.25256 shutdown 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 msgr2=0x559729a67730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb340980c0 tx=0x7fcb340d2510 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 shutdown_connections 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559729a73440 0x559729b03050 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559729a58dc0 0x559729a67c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559729a60a50 0x559729add230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 --2- 172.21.15.17:0/3815248761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559729a584a0 0x559729a67730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 >> 172.21.15.17:0/3815248761 conn(0x559729a54a30 msgr2=0x559729a59f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb237fe640 0 client.25256 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 shutdown_connections 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 1 -- 172.21.15.17:0/3815248761 wait complete. 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.504+0000 7fcb4c641740 20 client.25256 trim_cache size 0 max 16384 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.505+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 msgr2=0x7fcb300a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.505+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 0x7fcb300a5140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c02aa30 tx=0x7fcb2c005a00 comp rx=0 tx=0).stop 2024-09-10T11:45:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.505+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 msgr2=0x7fcb44109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.505+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400d980 tx=0x7fcb3400de40 comp rx=0 tx=0).stop 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 shutdown_connections 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcb300a2c80 0x7fcb300a5140 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb44102ef0 0x7fcb4410a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb44102570 0x7fcb4410a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 --2- 172.21.15.17:0/2356454714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb44100e20 0x7fcb44109b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 >> 172.21.15.17:0/2356454714 conn(0x7fcb440fc7d0 msgr2=0x7fcb44104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 shutdown_connections 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:25.506+0000 7fcb4a268640 1 -- 172.21.15.17:0/2356454714 wait complete. 2024-09-10T11:45:25.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (110 inodes in the stack)", 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "59449390-a7a5-4275-bb63-805f417b979d": { 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "59449390-a7a5-4275-bb63-805f417b979d", 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:45:25.586 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:45:26.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:26 smithi017 ceph-mon[30817]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 279 KiB/s rd, 247 MiB/s wr, 22.52k op/s 2024-09-10T11:45:26.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:26 smithi081 ceph-mon[35059]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 279 KiB/s rd, 247 MiB/s wr, 22.52k op/s 2024-09-10T11:45:27.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:26 smithi026 ceph-mon[34817]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 279 KiB/s rd, 247 MiB/s wr, 22.52k op/s 2024-09-10T11:45:27.320 INFO:tasks.cephfs.filesystem:scrub status for tag:59449390-a7a5-4275-bb63-805f417b979d - {'path': '/', 'tag': '59449390-a7a5-4275-bb63-805f417b979d', 'options': 'recursive,force'} 2024-09-10T11:45:28.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:28 smithi081 ceph-mon[35059]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 331 KiB/s rd, 252 MiB/s wr, 23.24k op/s 2024-09-10T11:45:29.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:28 smithi026 ceph-mon[34817]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 331 KiB/s rd, 252 MiB/s wr, 23.24k op/s 2024-09-10T11:45:29.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:28 smithi017 ceph-mon[30817]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 58 GiB used, 1015 GiB / 1.0 TiB avail; 331 KiB/s rd, 252 MiB/s wr, 23.24k op/s 2024-09-10T11:45:30.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:30 smithi081 ceph-mon[35059]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 296 KiB/s rd, 229 MiB/s wr, 21.75k op/s 2024-09-10T11:45:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:30 smithi026 ceph-mon[34817]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 296 KiB/s rd, 229 MiB/s wr, 21.75k op/s 2024-09-10T11:45:31.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:30 smithi017 ceph-mon[30817]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 296 KiB/s rd, 229 MiB/s wr, 21.75k op/s 2024-09-10T11:45:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:32 smithi081 ceph-mon[35059]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 260 KiB/s rd, 199 MiB/s wr, 19.27k op/s 2024-09-10T11:45:33.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:32 smithi026 ceph-mon[34817]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 260 KiB/s rd, 199 MiB/s wr, 19.27k op/s 2024-09-10T11:45:33.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:32 smithi017 ceph-mon[30817]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 260 KiB/s rd, 199 MiB/s wr, 19.27k op/s 2024-09-10T11:45:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:34 smithi081 ceph-mon[35059]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 342 KiB/s rd, 246 MiB/s wr, 24.52k op/s 2024-09-10T11:45:35.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:34 smithi026 ceph-mon[34817]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 342 KiB/s rd, 246 MiB/s wr, 24.52k op/s 2024-09-10T11:45:35.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:34 smithi017 ceph-mon[30817]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 59 GiB used, 1014 GiB / 1.0 TiB avail; 342 KiB/s rd, 246 MiB/s wr, 24.52k op/s 2024-09-10T11:45:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:36 smithi081 ceph-mon[35059]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 219 KiB/s rd, 212 MiB/s wr, 21.84k op/s 2024-09-10T11:45:37.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:36 smithi026 ceph-mon[34817]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 219 KiB/s rd, 212 MiB/s wr, 21.84k op/s 2024-09-10T11:45:37.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:36 smithi017 ceph-mon[30817]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 219 KiB/s rd, 212 MiB/s wr, 21.84k op/s 2024-09-10T11:45:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:38 smithi081 ceph-mon[35059]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 234 KiB/s rd, 207 MiB/s wr, 21.59k op/s 2024-09-10T11:45:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:38 smithi026 ceph-mon[34817]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 234 KiB/s rd, 207 MiB/s wr, 21.59k op/s 2024-09-10T11:45:39.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:38 smithi017 ceph-mon[30817]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 60 GiB used, 1013 GiB / 1.0 TiB avail; 234 KiB/s rd, 207 MiB/s wr, 21.59k op/s 2024-09-10T11:45:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:40 smithi081 ceph-mon[35059]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 193 KiB/s rd, 217 MiB/s wr, 22.87k op/s 2024-09-10T11:45:41.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:40 smithi026 ceph-mon[34817]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 193 KiB/s rd, 217 MiB/s wr, 22.87k op/s 2024-09-10T11:45:41.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:40 smithi017 ceph-mon[30817]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 193 KiB/s rd, 217 MiB/s wr, 22.87k op/s 2024-09-10T11:45:43.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:42 smithi026 ceph-mon[34817]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 165 KiB/s rd, 189 MiB/s wr, 20.22k op/s 2024-09-10T11:45:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:42 smithi017 ceph-mon[30817]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 165 KiB/s rd, 189 MiB/s wr, 20.22k op/s 2024-09-10T11:45:43.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:42 smithi081 ceph-mon[35059]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1012 GiB / 1.0 TiB avail; 165 KiB/s rd, 189 MiB/s wr, 20.22k op/s 2024-09-10T11:45:45.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:44 smithi026 ceph-mon[34817]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 210 KiB/s rd, 237 MiB/s wr, 25.77k op/s 2024-09-10T11:45:45.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:44 smithi017 ceph-mon[30817]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 210 KiB/s rd, 237 MiB/s wr, 25.77k op/s 2024-09-10T11:45:45.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:44 smithi081 ceph-mon[35059]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 210 KiB/s rd, 237 MiB/s wr, 25.77k op/s 2024-09-10T11:45:47.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:46 smithi026 ceph-mon[34817]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 153 KiB/s rd, 204 MiB/s wr, 22.33k op/s 2024-09-10T11:45:47.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:46 smithi017 ceph-mon[30817]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 153 KiB/s rd, 204 MiB/s wr, 22.33k op/s 2024-09-10T11:45:47.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:46 smithi081 ceph-mon[35059]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 153 KiB/s rd, 204 MiB/s wr, 22.33k op/s 2024-09-10T11:45:49.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:48 smithi026 ceph-mon[34817]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 174 KiB/s rd, 196 MiB/s wr, 21.75k op/s 2024-09-10T11:45:49.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:48 smithi017 ceph-mon[30817]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 174 KiB/s rd, 196 MiB/s wr, 21.75k op/s 2024-09-10T11:45:49.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:48 smithi081 ceph-mon[35059]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 174 KiB/s rd, 196 MiB/s wr, 21.75k op/s 2024-09-10T11:45:50.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:49 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:45:50.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:49 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:45:50.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:49 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:45:51.172 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:50 smithi017 ceph-mon[30817]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 172 KiB/s rd, 218 MiB/s wr, 24.94k op/s 2024-09-10T11:45:51.172 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:45:51.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:45:51.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:45:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:50 smithi081 ceph-mon[35059]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 172 KiB/s rd, 218 MiB/s wr, 24.94k op/s 2024-09-10T11:45:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:45:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:45:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:45:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:50 smithi026 ceph-mon[34817]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 172 KiB/s rd, 218 MiB/s wr, 24.94k op/s 2024-09-10T11:45:51.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:45:51.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:45:51.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:45:53.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:52 smithi081 ceph-mon[35059]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 137 KiB/s rd, 175 MiB/s wr, 20.57k op/s 2024-09-10T11:45:53.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:52 smithi026 ceph-mon[34817]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 137 KiB/s rd, 175 MiB/s wr, 20.57k op/s 2024-09-10T11:45:53.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:52 smithi017 ceph-mon[30817]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 137 KiB/s rd, 175 MiB/s wr, 20.57k op/s 2024-09-10T11:45:55.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:54 smithi081 ceph-mon[35059]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 160 KiB/s rd, 213 MiB/s wr, 26.13k op/s 2024-09-10T11:45:55.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:54 smithi026 ceph-mon[34817]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 160 KiB/s rd, 213 MiB/s wr, 26.13k op/s 2024-09-10T11:45:55.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:54 smithi017 ceph-mon[30817]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 160 KiB/s rd, 213 MiB/s wr, 26.13k op/s 2024-09-10T11:45:57.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:56 smithi081 ceph-mon[35059]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 123 KiB/s rd, 174 MiB/s wr, 22.16k op/s 2024-09-10T11:45:57.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:56 smithi026 ceph-mon[34817]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 123 KiB/s rd, 174 MiB/s wr, 22.16k op/s 2024-09-10T11:45:57.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:56 smithi017 ceph-mon[30817]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 123 KiB/s rd, 174 MiB/s wr, 22.16k op/s 2024-09-10T11:45:57.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:45:57.632 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:45:58.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:58.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:57 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:58.206 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:57 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:58.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:57 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.987+0000 7fd4a917d640 1 -- 172.21.15.17:0/173585310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102570 msgr2=0x7fd4a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.987+0000 7fd4a917d640 1 --2- 172.21.15.17:0/173585310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102570 0x7fd4a41029b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd498009900 tx=0x7fd49802a480 comp rx=0 tx=0).stop 2024-09-10T11:45:59.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.987+0000 7fd4a917d640 1 -- 172.21.15.17:0/173585310 shutdown_connections 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.987+0000 7fd4a917d640 1 --2- 172.21.15.17:0/173585310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102ef0 0x7fd4a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.988+0000 7fd4a917d640 1 --2- 172.21.15.17:0/173585310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102570 0x7fd4a41029b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.988+0000 7fd4a917d640 1 --2- 172.21.15.17:0/173585310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.988+0000 7fd4a917d640 1 -- 172.21.15.17:0/173585310 >> 172.21.15.17:0/173585310 conn(0x7fd4a40fc7d0 msgr2=0x7fd4a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.988+0000 7fd4a917d640 1 -- 172.21.15.17:0/173585310 shutdown_connections 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.988+0000 7fd4a917d640 1 -- 172.21.15.17:0/173585310 wait complete. 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 Processor -- start 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 -- start start 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102570 0x7fd4a4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102ef0 0x7fd4a41a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a4110f50 con 0x7fd4a4102ef0 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a4110dd0 con 0x7fd4a4100e20 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a917d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41110d0 con 0x7fd4a4102570 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44918/0 (socket says 172.21.15.17:44918) 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/1140888826 learned_addr learned my addr 172.21.15.17:0/1140888826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.989+0000 7fd4a259c640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102570 0x7fd4a4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a359e640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102ef0 0x7fd4a41a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/1140888826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102570 msgr2=0x7fd4a4199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102570 0x7fd4a4199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102ef0 msgr2=0x7fd4a41a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102ef0 0x7fd4a41a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/1140888826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a41971b0 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9f0 tx=0x7fd49400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd48bfff640 1 -- 172.21.15.17:0/1140888826 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49400cd80 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd48bfff640 1 -- 172.21.15.17:0/1140888826 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd494010910 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd48bfff640 1 -- 172.21.15.17:0/1140888826 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494018990 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.990+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a41974a0 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.991+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a4197960 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd48bfff640 1 -- 172.21.15.17:0/1140888826 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd494010ac0 con 0x7fd4a4100e20 2024-09-10T11:45:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 Processor -- start 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 -- start start 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc919dc0 0x5585dc924140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 0x5585dc926a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5585dc87f2e0 con 0x5585dc9194a0 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5585dc826ce0 con 0x5585dc919dc0 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4ab556740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585dc87b2a0 con 0x5585dc924680 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38978/0 (socket says 172.21.15.17:38978) 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4a359e640 1 -- 172.21.15.17:0/976298114 learned_addr learned my addr 172.21.15.17:0/976298114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4a259c640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 0x5585dc926a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.994+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc919dc0 0x5585dc924140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 -- 172.21.15.17:0/976298114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc919dc0 msgr2=0x5585dc924140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc919dc0 0x5585dc924140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 -- 172.21.15.17:0/976298114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 msgr2=0x5585dc919880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 -- 172.21.15.17:0/976298114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dc80b440 con 0x5585dc924680 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a359e640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd48bfff640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 0x7fd48c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a259c640 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 0x5585dc926a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd498005940 tx=0x7fd498005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=420c3d00dac22dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4a359e640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 0x7fd48c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd48bfff640 1 -- 172.21.15.17:0/1140888826 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd4940cf3a0 con 0x7fd4a4100e20 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4897fa640 1 -- 172.21.15.17:0/976298114 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498035030 con 0x5585dc924680 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4897fa640 1 -- 172.21.15.17:0/976298114 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd498040070 con 0x5585dc924680 2024-09-10T11:45:59.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.995+0000 7fd4897fa640 1 -- 172.21.15.17:0/976298114 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498004d90 con 0x5585dc924680 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 -- 172.21.15.17:0/976298114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 msgr2=0x5585dc926a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 0x5585dc926a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd498005940 tx=0x7fd498005dd0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 -- 172.21.15.17:0/976298114 shutdown_connections 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc924680 0x5585dc926a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc919dc0 0x5585dc924140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 --2- 172.21.15.17:0/976298114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc919880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.996+0000 7fd4ab556740 1 -- 172.21.15.17:0/976298114 >> 172.21.15.17:0/976298114 conn(0x5585dc915a30 msgr2=0x5585dc915e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.997+0000 7fd4a359e640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 0x7fd48c0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0117b0 tx=0x7fd49c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.997+0000 7fd4ab556740 1 -- 172.21.15.17:0/976298114 shutdown_connections 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.997+0000 7fd4ab556740 1 -- 172.21.15.17:0/976298114 wait complete. 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.997+0000 7fd4ab556740 1 -- start start 2024-09-10T11:45:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.997+0000 7fd4ab556740 1 Processor -- start 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc9212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 0x5585dc921830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5585dc927250 con 0x5585dc924680 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5585dc83a050 con 0x5585dc9194a0 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585dc9273d0 con 0x5585dc919dc0 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4ab556740 10 client.0 _ll_register_callbacks cb 0x5585dc87a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 0x5585dc921830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 0x5585dc921830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38990/0 (socket says 172.21.15.17:38990) 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44924/0 (socket says 172.21.15.17:44924) 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a359e640 1 -- 172.21.15.17:0/626175984 learned_addr learned my addr 172.21.15.17:0/626175984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:59.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a259c640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc9212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 msgr2=0x5585dc9212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc9212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/626175984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 msgr2=0x5585dc921830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 0x5585dc921830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.998+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/626175984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dc5f03c0 con 0x5585dc9194a0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.999+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5585dc916890 tx=0x7fd494097f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a210718f43041de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.999+0000 7fd486ff5640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.999+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49409c2b0 con 0x5585dc9194a0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.999+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd494018b30 con 0x5585dc9194a0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:58.999+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd498040070 con 0x5585dc9194a0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd49409bbb0 con 0x5585dc9194a0 2024-09-10T11:45:59.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 10 client.25268 fetch_fsmap learned FSMap version 33 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5585dc932c40 con 0x5585dc9194a0 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd498040070 con 0x5585dc9194a0 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fd49409b090 con 0x5585dc9194a0 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 10 client.25268 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 20 client.25268 populate_metadata read hostname 'smithi017' 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc934500 0x5585dc9369c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 4 client.25268 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.000+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585dc88c850 con 0x5585dc934500 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.001+0000 7fd4a259c640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc934500 0x5585dc9369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.001+0000 7fd486ff5640 10 client.25268 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:59.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.001+0000 7fd4a259c640 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc934500 0x5585dc9369c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80901c2ee819543 server_cookie=50030171aa9cd7fa in_seq=0 out_seq=0 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd486ff5640 1 -- 172.21.15.17:0/626175984 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585dc88c850 con 0x5585dc934500 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd486ff5640 10 client.25268 handle_command_reply: tid=0 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 client.25268 shutdown 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 msgr2=0x5585dc924000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5585dc916890 tx=0x7fd494097f40 comp rx=0 tx=0).stop 2024-09-10T11:45:59.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 shutdown_connections 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc934500 0x5585dc9369c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc9212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc924680 0x5585dc921830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 --2- 172.21.15.17:0/626175984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc9194a0 0x5585dc924000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 >> 172.21.15.17:0/626175984 conn(0x5585dc915a30 msgr2=0x5585dc91b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd486ff5640 0 client.25268 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 shutdown_connections 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.002+0000 7fd4ab556740 1 -- 172.21.15.17:0/626175984 wait complete. 2024-09-10T11:45:59.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.003+0000 7fd4ab556740 20 client.25268 trim_cache size 0 max 16384 2024-09-10T11:45:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.025+0000 7fd4ab556740 1 Processor -- start 2024-09-10T11:45:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.025+0000 7fd4ab556740 1 -- start start 2024-09-10T11:45:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.025+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.025+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc91b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.025+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc93c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4ab556740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41af810 con 0x5585dc9194a0 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4ab556740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41b1440 con 0x5585dc924680 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4ab556740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41afee0 con 0x5585dc919dc0 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc91b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc93c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39004/0 (socket says 172.21.15.17:39004) 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/3500186457 learned_addr learned my addr 172.21.15.17:0/3500186457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/3500186457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 msgr2=0x5585dc91b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc91b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/3500186457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 msgr2=0x5585dc93c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc93c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 -- 172.21.15.17:0/3500186457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dc916bc0 con 0x5585dc9194a0 2024-09-10T11:45:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.026+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd494098530 tx=0x7fd49409a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4464dca9623e224 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.027+0000 7fd488ff9640 1 -- 172.21.15.17:0/3500186457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49409c2b0 con 0x5585dc9194a0 2024-09-10T11:45:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.027+0000 7fd488ff9640 1 -- 172.21.15.17:0/3500186457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4940d2e50 con 0x5585dc9194a0 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.027+0000 7fd488ff9640 1 -- 172.21.15.17:0/3500186457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494018d90 con 0x5585dc9194a0 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- 172.21.15.17:0/3500186457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 msgr2=0x5585dc9304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd494098530 tx=0x7fd49409a0c0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- 172.21.15.17:0/3500186457 shutdown_connections 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc919dc0 0x5585dc91b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc93c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3500186457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc9194a0 0x5585dc9304b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- 172.21.15.17:0/3500186457 >> 172.21.15.17:0/3500186457 conn(0x5585dc915a30 msgr2=0x5585dc91af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- 172.21.15.17:0/3500186457 shutdown_connections 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- 172.21.15.17:0/3500186457 wait complete. 2024-09-10T11:45:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 -- start start 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.028+0000 7fd4ab556740 1 Processor -- start 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc9194a0 0x5585dc9286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc99e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41b0cb0 con 0x5585dc919dc0 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41b05b0 con 0x5585dc924680 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a41ad7f0 con 0x5585dc9194a0 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc99e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc9194a0 0x5585dc9286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39018/0 (socket says 172.21.15.17:39018) 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 -- 172.21.15.17:0/3257545752 learned_addr learned my addr 172.21.15.17:0/3257545752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:45:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4ab556740 10 client.0 _ll_register_callbacks cb 0x7fd4940d2ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 -- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc9194a0 msgr2=0x5585dc9286b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc9194a0 0x5585dc9286b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 -- 172.21.15.17:0/3257545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 msgr2=0x5585dc99e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc99e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 -- 172.21.15.17:0/3257545752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dc929480 con 0x5585dc919dc0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a359e640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc99e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd4a259c640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd498031470 tx=0x7fd498004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e14243c6075da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.029+0000 7fd486ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49805c020 con 0x5585dc919dc0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd498004480 con 0x5585dc919dc0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4940d2e50 con 0x5585dc919dc0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd498035040 con 0x5585dc919dc0 2024-09-10T11:45:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 10 client.15615 fetch_fsmap learned FSMap version 33 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5585dc99f8c0 con 0x5585dc919dc0 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4940d2e50 con 0x5585dc919dc0 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fd49804fa30 con 0x5585dc919dc0 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 10 client.15615 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 20 client.15615 populate_metadata read hostname 'smithi017' 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc99fc70 0x5585dc9a2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 4 client.15615 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.030+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5585dc886d60 con 0x5585dc99fc70 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc99fc70 0x5585dc9a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd4a2d9d640 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc99fc70 0x5585dc9a2060 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c57eaac06800f691 server_cookie=a74c79c37e6cf5cf in_seq=0 out_seq=0 2024-09-10T11:45:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd486ff5640 10 client.15615 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd486ff5640 1 -- 172.21.15.17:0/3257545752 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5585dc886d60 con 0x5585dc99fc70 2024-09-10T11:45:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd486ff5640 10 client.15615 handle_command_reply: tid=0 2024-09-10T11:45:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd4ab556740 1 client.15615 shutdown 2024-09-10T11:45:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 msgr2=0x5585dc928bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.031+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd498031470 tx=0x7fd498004750 comp rx=0 tx=0).stop 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.032+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 shutdown_connections 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.032+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5585dc99fc70 0x5585dc9a2060 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.032+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5585dc924680 0x5585dc99e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd486ff5640 0 client.15615 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585dc919dc0 0x5585dc928bf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 1 --2- 172.21.15.17:0/3257545752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585dc9194a0 0x5585dc9286b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 >> 172.21.15.17:0/3257545752 conn(0x5585dc915a30 msgr2=0x5585dc922b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 shutdown_connections 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 1 -- 172.21.15.17:0/3257545752 wait complete. 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.033+0000 7fd4ab556740 20 client.15615 trim_cache size 0 max 16384 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "59449390-a7a5-4275-bb63-805f417b979d": { 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "59449390-a7a5-4275-bb63-805f417b979d", 2024-09-10T11:45:59.039 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:45:59.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:45:59.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:45:59.040 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:45:59.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 msgr2=0x7fd48c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 0x7fd48c0a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0117b0 tx=0x7fd49c009500 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 msgr2=0x7fd4a41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9f0 tx=0x7fd49400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 shutdown_connections 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd48c0a2c00 0x7fd48c0a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a4102570 0x7fd4a4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4a4102ef0 0x7fd4a41a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 --2- 172.21.15.17:0/1140888826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4a4100e20 0x7fd4a41993c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 >> 172.21.15.17:0/1140888826 conn(0x7fd4a40fc7d0 msgr2=0x7fd4a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 shutdown_connections 2024-09-10T11:45:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:45:59.034+0000 7fd4a917d640 1 -- 172.21.15.17:0/1140888826 wait complete. 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 107 KiB/s rd, 170 MiB/s wr, 22.46k op/s 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:45:58 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 107 KiB/s rd, 170 MiB/s wr, 22.46k op/s 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:45:58 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 107 KiB/s rd, 170 MiB/s wr, 22.46k op/s 2024-09-10T11:45:59.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:45:58 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:45:59.891 INFO:tasks.cephfs.filesystem:scrub status for tag:59449390-a7a5-4275-bb63-805f417b979d - {'path': '/', 'tag': '59449390-a7a5-4275-bb63-805f417b979d', 'options': 'recursive,force'} 2024-09-10T11:46:01.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:00 smithi081 ceph-mon[35059]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 91 KiB/s rd, 179 MiB/s wr, 24.52k op/s 2024-09-10T11:46:01.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:00 smithi026 ceph-mon[34817]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 91 KiB/s rd, 179 MiB/s wr, 24.52k op/s 2024-09-10T11:46:01.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:00 smithi017 ceph-mon[30817]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 91 KiB/s rd, 179 MiB/s wr, 24.52k op/s 2024-09-10T11:46:03.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:02 smithi081 ceph-mon[35059]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 129 MiB/s wr, 18.34k op/s 2024-09-10T11:46:03.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:02 smithi026 ceph-mon[34817]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 129 MiB/s wr, 18.34k op/s 2024-09-10T11:46:03.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:02 smithi017 ceph-mon[30817]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 129 MiB/s wr, 18.34k op/s 2024-09-10T11:46:05.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:04 smithi081 ceph-mon[35059]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 79 KiB/s rd, 131 MiB/s wr, 18.77k op/s 2024-09-10T11:46:05.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:04 smithi026 ceph-mon[34817]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 79 KiB/s rd, 131 MiB/s wr, 18.77k op/s 2024-09-10T11:46:05.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:04 smithi017 ceph-mon[30817]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 79 KiB/s rd, 131 MiB/s wr, 18.77k op/s 2024-09-10T11:46:07.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:06 smithi081 ceph-mon[35059]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 57 KiB/s rd, 90 MiB/s wr, 13.08k op/s 2024-09-10T11:46:07.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:06 smithi026 ceph-mon[34817]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 57 KiB/s rd, 90 MiB/s wr, 13.08k op/s 2024-09-10T11:46:07.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:06 smithi017 ceph-mon[30817]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 57 KiB/s rd, 90 MiB/s wr, 13.08k op/s 2024-09-10T11:46:09.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:08 smithi081 ceph-mon[35059]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 79 MiB/s wr, 11.53k op/s 2024-09-10T11:46:09.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:08 smithi026 ceph-mon[34817]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 79 MiB/s wr, 11.53k op/s 2024-09-10T11:46:09.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:08 smithi017 ceph-mon[30817]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 79 MiB/s wr, 11.53k op/s 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 45 KiB/s rd, 71 MiB/s wr, 10.45k op/s 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:11.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:10 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 45 KiB/s rd, 71 MiB/s wr, 10.45k op/s 2024-09-10T11:46:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:11.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:11.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:10 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:11.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 45 KiB/s rd, 71 MiB/s wr, 10.45k op/s 2024-09-10T11:46:11.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:11.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:11.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:10 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:13.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:12 smithi081 ceph-mon[35059]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 5.70k op/s 2024-09-10T11:46:13.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:12 smithi026 ceph-mon[34817]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 5.70k op/s 2024-09-10T11:46:13.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:12 smithi017 ceph-mon[30817]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 38 MiB/s wr, 5.70k op/s 2024-09-10T11:46:15.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:14 smithi081 ceph-mon[35059]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 36 KiB/s rd, 46 MiB/s wr, 7.13k op/s 2024-09-10T11:46:15.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:14 smithi026 ceph-mon[34817]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 36 KiB/s rd, 46 MiB/s wr, 7.13k op/s 2024-09-10T11:46:15.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:14 smithi017 ceph-mon[30817]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 36 KiB/s rd, 46 MiB/s wr, 7.13k op/s 2024-09-10T11:46:17.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:16 smithi081 ceph-mon[35059]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.21k op/s 2024-09-10T11:46:17.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:16 smithi026 ceph-mon[34817]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.21k op/s 2024-09-10T11:46:17.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:16 smithi017 ceph-mon[30817]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.21k op/s 2024-09-10T11:46:19.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:18 smithi081 ceph-mon[35059]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.33k op/s 2024-09-10T11:46:19.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:18 smithi026 ceph-mon[34817]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.33k op/s 2024-09-10T11:46:19.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:18 smithi017 ceph-mon[30817]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 6.33k op/s 2024-09-10T11:46:21.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:20 smithi081 ceph-mon[35059]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 7.39k op/s 2024-09-10T11:46:21.256 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:20 smithi026 ceph-mon[34817]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 7.39k op/s 2024-09-10T11:46:21.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:20 smithi017 ceph-mon[30817]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 45 MiB/s wr, 7.39k op/s 2024-09-10T11:46:23.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:22 smithi081 ceph-mon[35059]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 5.79k op/s 2024-09-10T11:46:23.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:22 smithi026 ceph-mon[34817]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 5.79k op/s 2024-09-10T11:46:23.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:22 smithi017 ceph-mon[30817]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 5.79k op/s 2024-09-10T11:46:25.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:24 smithi081 ceph-mon[35059]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 18 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-10T11:46:25.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:24 smithi026 ceph-mon[34817]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 18 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-10T11:46:25.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:24 smithi017 ceph-mon[30817]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 18 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-10T11:46:27.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:26 smithi081 ceph-mon[35059]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 6.27k op/s 2024-09-10T11:46:27.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:26 smithi026 ceph-mon[34817]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 6.27k op/s 2024-09-10T11:46:27.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:26 smithi017 ceph-mon[30817]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 6.27k op/s 2024-09-10T11:46:29.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:28 smithi081 ceph-mon[35059]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 6.61k op/s 2024-09-10T11:46:29.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:28 smithi026 ceph-mon[34817]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 6.61k op/s 2024-09-10T11:46:29.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:28 smithi017 ceph-mon[30817]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 6.61k op/s 2024-09-10T11:46:29.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:46:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 -- 172.21.15.17:0/2535157826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 msgr2=0x7fca4010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 --2- 172.21.15.17:0/2535157826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca4010da40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fca38009ca0 tx=0x7fca3802a950 comp rx=0 tx=0).stop 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 -- 172.21.15.17:0/2535157826 shutdown_connections 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 --2- 172.21.15.17:0/2535157826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 --2- 172.21.15.17:0/2535157826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca4010da40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 --2- 172.21.15.17:0/2535157826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 0x7fca40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 -- 172.21.15.17:0/2535157826 >> 172.21.15.17:0/2535157826 conn(0x7fca400fc7d0 msgr2=0x7fca400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 -- 172.21.15.17:0/2535157826 shutdown_connections 2024-09-10T11:46:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.726+0000 7fca465d8640 1 -- 172.21.15.17:0/2535157826 wait complete. 2024-09-10T11:46:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 Processor -- start 2024-09-10T11:46:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 -- start start 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 0x7fca400fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca400fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca40110f80 con 0x7fca40102ef0 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fca40110e00 con 0x7fca40100e20 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.727+0000 7fca465d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca40111100 con 0x7fca40102570 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:56934/0 (socket says 172.21.15.17:56934) 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 0x7fca400fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 -- 172.21.15.17:0/803023095 learned_addr learned my addr 172.21.15.17:0/803023095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca44b75640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca400fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 -- 172.21.15.17:0/803023095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 msgr2=0x7fca400fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 0x7fca400fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 -- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 msgr2=0x7fca400fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca400fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 -- 172.21.15.17:0/803023095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca401a6910 con 0x7fca40102570 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.728+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9f0 tx=0x7fca3400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.729+0000 7fca3d7fa640 1 -- 172.21.15.17:0/803023095 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cd80 con 0x7fca40102570 2024-09-10T11:46:30.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.729+0000 7fca3d7fa640 1 -- 172.21.15.17:0/803023095 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca34010910 con 0x7fca40102570 2024-09-10T11:46:30.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.729+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4006bc70 con 0x7fca40102570 2024-09-10T11:46:30.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.729+0000 7fca3d7fa640 1 -- 172.21.15.17:0/803023095 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34018980 con 0x7fca40102570 2024-09-10T11:46:30.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.729+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4006c200 con 0x7fca40102570 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.731+0000 7fca3d7fa640 1 -- 172.21.15.17:0/803023095 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca34010430 con 0x7fca40102570 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.732+0000 7fca3d7fa640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 0x7fca280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca3d7fa640 1 -- 172.21.15.17:0/803023095 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fca340cf340 con 0x7fca40102570 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca3ffff640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 0x7fca280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 Processor -- start 2024-09-10T11:46:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 -- start start 2024-09-10T11:46:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d274e9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e9dc0 0x562d274f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562d2744f2e0 con 0x562d274e94a0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562d273f6ce0 con 0x562d274e9dc0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca489b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d2744b2a0 con 0x562d274f4680 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.733+0000 7fca44b75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e9dc0 0x562d274f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:56948/0 (socket says 172.21.15.17:56948) 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 -- 172.21.15.17:0/3732005736 learned_addr learned my addr 172.21.15.17:0/3732005736 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca3ffff640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 0x7fca280a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca30009bd0 tx=0x7fca30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca3ffff640 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d274e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 -- 172.21.15.17:0/3732005736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e9dc0 msgr2=0x562d274f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e9dc0 0x562d274f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 -- 172.21.15.17:0/3732005736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 msgr2=0x562d274e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d274e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 -- 172.21.15.17:0/3732005736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d273db440 con 0x562d274f4680 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.734+0000 7fca44b75640 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca38030020 tx=0x7fca38009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f7b313f040bcc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca267fc640 1 -- 172.21.15.17:0/3732005736 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38034040 con 0x562d274f4680 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca267fc640 1 -- 172.21.15.17:0/3732005736 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3802fb30 con 0x562d274f4680 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca267fc640 1 -- 172.21.15.17:0/3732005736 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38004420 con 0x562d274f4680 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 -- 172.21.15.17:0/3732005736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 msgr2=0x562d274f6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca38030020 tx=0x7fca38009360 comp rx=0 tx=0).stop 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 -- 172.21.15.17:0/3732005736 shutdown_connections 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f6a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e9dc0 0x562d274f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 --2- 172.21.15.17:0/3732005736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d274e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.735+0000 7fca489b1740 1 -- 172.21.15.17:0/3732005736 >> 172.21.15.17:0/3732005736 conn(0x562d274e5a30 msgr2=0x562d274e5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.736+0000 7fca489b1740 1 -- 172.21.15.17:0/3732005736 shutdown_connections 2024-09-10T11:46:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.736+0000 7fca489b1740 1 -- 172.21.15.17:0/3732005736 wait complete. 2024-09-10T11:46:30.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.736+0000 7fca489b1740 1 -- start start 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.736+0000 7fca489b1740 1 Processor -- start 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d274f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562d274f7250 con 0x562d274e9dc0 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562d2740a050 con 0x562d274e94a0 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d274f73d0 con 0x562d274f4680 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:35210/0 (socket says 172.21.15.17:35210) 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 -- 172.21.15.17:0/2828614252 learned_addr learned my addr 172.21.15.17:0/2828614252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca44b75640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d274f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 10 client.0 _ll_register_callbacks cb 0x562d2744a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 -- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 msgr2=0x562d274f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 -- 172.21.15.17:0/2828614252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 msgr2=0x562d274f11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d274f11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 -- 172.21.15.17:0/2828614252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d271c03c0 con 0x562d274e94a0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca44b75640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca3802fb30 con 0x562d274e94a0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca3ffff640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca30005f60 tx=0x7fca30004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65bf0e47ad8a67c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.737+0000 7fca1f7fe640 10 client.25286 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca1f7fe640 1 -- 172.21.15.17:0/2828614252 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3000eb30 con 0x562d274e94a0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca1f7fe640 1 -- 172.21.15.17:0/2828614252 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fca3000ecd0 con 0x562d274e94a0 2024-09-10T11:46:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca1f7fe640 1 -- 172.21.15.17:0/2828614252 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca3001e320 con 0x562d274e94a0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 10 client.25286 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=33}) -- 0x562d2750b2e0 con 0x562d274e94a0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca1f7fe640 1 -- 172.21.15.17:0/2828614252 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fca30025070 con 0x562d274e94a0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 10 client.25286 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 10 client.25286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 20 client.25286 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d2750c6e0 0x562d2750eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 4 client.25286 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d2745c850 con 0x562d2750c6e0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.738+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d2750c6e0 0x562d2750eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.739+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d2750c6e0 0x562d2750eba0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414d1d09d6278ad3 server_cookie=cdab30ac0d67792c in_seq=0 out_seq=0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.739+0000 7fca1f7fe640 10 client.25286 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca1f7fe640 1 -- 172.21.15.17:0/2828614252 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d2745c850 con 0x562d2750c6e0 2024-09-10T11:46:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca1f7fe640 10 client.25286 handle_command_reply: tid=0 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 client.25286 shutdown 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 msgr2=0x562d274f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca30005f60 tx=0x7fca30004730 comp rx=0 tx=0).stop 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 shutdown_connections 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d2750c6e0 0x562d2750eba0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274f4680 0x562d274f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d274f11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 --2- 172.21.15.17:0/2828614252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e94a0 0x562d274f3f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 >> 172.21.15.17:0/2828614252 conn(0x562d274e5a30 msgr2=0x562d274eb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca1f7fe640 0 client.25286 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 shutdown_connections 2024-09-10T11:46:30.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 1 -- 172.21.15.17:0/2828614252 wait complete. 2024-09-10T11:46:30.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.740+0000 7fca489b1740 20 client.25286 trim_cache size 0 max 16384 2024-09-10T11:46:30.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 Processor -- start 2024-09-10T11:46:30.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 -- start start 2024-09-10T11:46:30.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d274ec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.762+0000 7fca489b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca40070390 con 0x562d274e9dc0 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca489b1740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fca40071fc0 con 0x562d274e5a30 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca489b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca40070a60 con 0x562d274e94a0 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca44b75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d274ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:56972/0 (socket says 172.21.15.17:56972) 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 -- 172.21.15.17:0/3585113148 learned_addr learned my addr 172.21.15.17:0/3585113148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca44b75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39796/0 (socket says 172.21.15.17:39796) 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 -- 172.21.15.17:0/3585113148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 msgr2=0x562d274ec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d274ec900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 -- 172.21.15.17:0/3585113148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 msgr2=0x562d27514470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 -- 172.21.15.17:0/3585113148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d274e5860 con 0x562d274e94a0 2024-09-10T11:46:30.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3ffff640 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d274ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:30.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca44b75640 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:30.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.763+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca3409bb40 tx=0x7fca3401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=898d48710eeb1c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.764+0000 7fca25ffb640 1 -- 172.21.15.17:0/3585113148 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34010720 con 0x562d274e94a0 2024-09-10T11:46:30.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.764+0000 7fca25ffb640 1 -- 172.21.15.17:0/3585113148 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca340ccf60 con 0x562d274e94a0 2024-09-10T11:46:30.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.764+0000 7fca25ffb640 1 -- 172.21.15.17:0/3585113148 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3409b000 con 0x562d274e94a0 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.764+0000 7fca489b1740 1 -- 172.21.15.17:0/3585113148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 msgr2=0x562d274f01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.764+0000 7fca489b1740 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca3409bb40 tx=0x7fca3401a040 comp rx=0 tx=0).stop 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 -- 172.21.15.17:0/3585113148 shutdown_connections 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e94a0 0x562d274f01b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e9dc0 0x562d27514470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 --2- 172.21.15.17:0/3585113148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d274ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 -- 172.21.15.17:0/3585113148 >> 172.21.15.17:0/3585113148 conn(0x562d274f1870 msgr2=0x562d274efaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 -- 172.21.15.17:0/3585113148 shutdown_connections 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 -- 172.21.15.17:0/3585113148 wait complete. 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 -- start start 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.765+0000 7fca489b1740 1 Processor -- start 2024-09-10T11:46:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d27505720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 0x562d27501040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca40071830 con 0x562d274e94a0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fca40071130 con 0x562d274e5a30 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca4006e370 con 0x562d274e9dc0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 0x562d27501040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca3f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39798/0 (socket says 172.21.15.17:39798) 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca3f7fe640 1 -- 172.21.15.17:0/3469640854 learned_addr learned my addr 172.21.15.17:0/3469640854 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca3ffff640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d27505720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca489b1740 10 client.0 _ll_register_callbacks cb 0x7fca30009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 -- 172.21.15.17:0/3469640854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 msgr2=0x562d27505720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d27505720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 -- 172.21.15.17:0/3469640854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 msgr2=0x562d27500a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 -- 172.21.15.17:0/3469640854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d27501870 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca3f7fe640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca44b75640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 0x562d27501040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca38005e30 tx=0x7fca3802a950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14737d4b027fef4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.766+0000 7fca1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38034040 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca340ccf60 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fca3805a040 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca3802afd0 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 10 client.25258 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562d27577550 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca340ccf60 con 0x562d274e9dc0 2024-09-10T11:46:30.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fca38053070 con 0x562d274e9dc0 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 10 client.25258 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 20 client.25258 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d274f4680 0x562d27579920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 4 client.25258 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.767+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d27456d60 con 0x562d274f4680 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca3ffff640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d274f4680 0x562d27579920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca1f7fe640 10 client.25258 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca3ffff640 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d274f4680 0x562d27579920 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65fbff3b6e74ea8e server_cookie=24c1b70840a8a950 in_seq=0 out_seq=0 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca1f7fe640 1 -- 172.21.15.17:0/3469640854 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562d27456d60 con 0x562d274f4680 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca1f7fe640 10 client.25258 handle_command_reply: tid=0 2024-09-10T11:46:30.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.768+0000 7fca489b1740 1 client.25258 shutdown 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 msgr2=0x562d27501040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 0x562d27501040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca38005e30 tx=0x7fca3802a950 comp rx=0 tx=0).stop 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 shutdown_connections 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x562d274f4680 0x562d27579920 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca1f7fe640 0 client.25258 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d274e9dc0 0x562d27501040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d274e94a0 0x562d27500a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 --2- 172.21.15.17:0/3469640854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562d274e5a30 0x562d27505720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 >> 172.21.15.17:0/3469640854 conn(0x562d274f1870 msgr2=0x562d274e4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 shutdown_connections 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 1 -- 172.21.15.17:0/3469640854 wait complete. 2024-09-10T11:46:30.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.769+0000 7fca489b1740 20 client.25258 trim_cache size 0 max 16384 2024-09-10T11:46:30.777 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:46:30.777 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:46:30.777 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:46:30.777 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 msgr2=0x7fca280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 0x7fca280a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca30009bd0 tx=0x7fca30005f90 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 msgr2=0x7fca400fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e9f0 tx=0x7fca3400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 shutdown_connections 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fca280a2c00 0x7fca280a50c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca40102570 0x7fca400fd1c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca40102ef0 0x7fca400fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 --2- 172.21.15.17:0/803023095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca40100e20 0x7fca400fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:30.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 >> 172.21.15.17:0/803023095 conn(0x7fca400fc7d0 msgr2=0x7fca4006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:30.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 shutdown_connections 2024-09-10T11:46:30.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:30.770+0000 7fca465d8640 1 -- 172.21.15.17:0/803023095 wait complete. 2024-09-10T11:46:31.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:30 smithi081 ceph-mon[35059]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 45 MiB/s wr, 7.68k op/s 2024-09-10T11:46:31.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:30 smithi026 ceph-mon[34817]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 45 MiB/s wr, 7.68k op/s 2024-09-10T11:46:31.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:30 smithi017 ceph-mon[30817]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 45 MiB/s wr, 7.68k op/s 2024-09-10T11:46:31.552 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:46:31.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:46:31.873 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 -- 172.21.15.17:0/4136695699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140955a0 msgr2=0x7fc814095a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 --2- 172.21.15.17:0/4136695699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140955a0 0x7fc814095a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc808009930 tx=0x7fc80802a440 comp rx=0 tx=0).stop 2024-09-10T11:46:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 -- 172.21.15.17:0/4136695699 shutdown_connections 2024-09-10T11:46:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 --2- 172.21.15.17:0/4136695699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140955a0 0x7fc814095a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 --2- 172.21.15.17:0/4136695699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc814095f40 0x7fc8140a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 --2- 172.21.15.17:0/4136695699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81409b650 0x7fc81409ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 -- 172.21.15.17:0/4136695699 >> 172.21.15.17:0/4136695699 conn(0x7fc814091260 msgr2=0x7fc814093680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 -- 172.21.15.17:0/4136695699 shutdown_connections 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.427+0000 7fc821382640 1 -- 172.21.15.17:0/4136695699 wait complete. 2024-09-10T11:46:32.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.428+0000 7fc821382640 1 Processor -- start 2024-09-10T11:46:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 -- start start 2024-09-10T11:46:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8140955a0 0x7fc8141419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc814095f40 0x7fc814141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140a37f0 con 0x7fc81409b650 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140a3670 con 0x7fc8140955a0 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.429+0000 7fc821382640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140a3970 con 0x7fc814095f40 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.430+0000 7fc820b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.430+0000 7fc820b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55738/0 (socket says 172.21.15.17:55738) 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.430+0000 7fc820b81640 1 -- 172.21.15.17:0/2574590709 learned_addr learned my addr 172.21.15.17:0/2574590709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 -- 172.21.15.17:0/2574590709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc814095f40 msgr2=0x7fc814141f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:46:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc814095f40 0x7fc814141f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 -- 172.21.15.17:0/2574590709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8140955a0 msgr2=0x7fc8141419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8140955a0 0x7fc8141419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 -- 172.21.15.17:0/2574590709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81413b520 con 0x7fc81409b650 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.431+0000 7fc820b81640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc81c067960 tx=0x7fc81c06cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.432+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c071690 con 0x7fc81409b650 2024-09-10T11:46:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.432+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc81c071d10 con 0x7fc81409b650 2024-09-10T11:46:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.432+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c071690 con 0x7fc81409b650 2024-09-10T11:46:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.432+0000 7fc821382640 1 -- 172.21.15.17:0/2574590709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81413b810 con 0x7fc81409b650 2024-09-10T11:46:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.432+0000 7fc821382640 1 -- 172.21.15.17:0/2574590709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81413f750 con 0x7fc81409b650 2024-09-10T11:46:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.434+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc814096cc0 con 0x7fc81409b650 2024-09-10T11:46:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.437+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc81c07e030 con 0x7fc81409b650 2024-09-10T11:46:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.438+0000 7fc8197fa640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 0x7fc80c0a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.439+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc81c07c070 con 0x7fc81409b650 2024-09-10T11:46:32.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.441+0000 7fc81bfff640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 0x7fc80c0a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.443+0000 7fc81bfff640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 0x7fc80c0a5490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8100058c0 tx=0x7fc810005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.448+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc81c085060 con 0x7fc81409b650 2024-09-10T11:46:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.721+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc814140350 con 0x7fc81409b650 2024-09-10T11:46:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.722+0000 7fc8197fa640 1 -- 172.21.15.17:0/2574590709 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11964 (secure 0 0 0) 0x7fc814140350 con 0x7fc81409b650 2024-09-10T11:46:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:46:32.725 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":33,"btime":"2024-09-10T11:44:49:930172+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:44:48.981935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:46:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 33 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 msgr2=0x7fc80c0a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 0x7fc80c0a5490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8100058c0 tx=0x7fc810005850 comp rx=0 tx=0).stop 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 msgr2=0x7fc81413ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc81c067960 tx=0x7fc81c06cb60 comp rx=0 tx=0).stop 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 shutdown_connections 2024-09-10T11:46:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc80c0a2fd0 0x7fc80c0a5490 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc814095f40 0x7fc814141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81409b650 0x7fc81413ac60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 --2- 172.21.15.17:0/2574590709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8140955a0 0x7fc8141419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 >> 172.21.15.17:0/2574590709 conn(0x7fc814091260 msgr2=0x7fc8140929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 shutdown_connections 2024-09-10T11:46:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:32.725+0000 7fc806ffd640 1 -- 172.21.15.17:0/2574590709 wait complete. 2024-09-10T11:46:33.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:32 smithi017 ceph-mon[30817]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.3 KiB/s rd, 34 MiB/s wr, 6.02k op/s 2024-09-10T11:46:33.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:32 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2574590709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:46:33.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:32 smithi081 ceph-mon[35059]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.3 KiB/s rd, 34 MiB/s wr, 6.02k op/s 2024-09-10T11:46:33.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:32 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2574590709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:46:33.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:32 smithi026 ceph-mon[34817]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.3 KiB/s rd, 34 MiB/s wr, 6.02k op/s 2024-09-10T11:46:33.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:32 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2574590709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:46:33.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:46:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 -- 172.21.15.17:0/1231606412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1082a0 msgr2=0x7f6a5c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 --2- 172.21.15.17:0/1231606412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c10ec40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009cd0 tx=0x7f6a5402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 -- 172.21.15.17:0/1231606412 shutdown_connections 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 --2- 172.21.15.17:0/1231606412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c10ec40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 --2- 172.21.15.17:0/1231606412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 --2- 172.21.15.17:0/1231606412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 -- 172.21.15.17:0/1231606412 >> 172.21.15.17:0/1231606412 conn(0x7f6a5c0fc7d0 msgr2=0x7f6a5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 -- 172.21.15.17:0/1231606412 shutdown_connections 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.556+0000 7f6a63499640 1 -- 172.21.15.17:0/1231606412 wait complete. 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 Processor -- start 2024-09-10T11:46:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 -- start start 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1120a0 con 0x7f6a5c1036e0 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c111f20 con 0x7f6a5c1082a0 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a63499640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c112220 con 0x7f6a5c102d30 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.557+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55754/0 (socket says 172.21.15.17:55754) 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40026/0 (socket says 172.21.15.17:40026) 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a60a34640 1 -- 172.21.15.17:0/2101747032 learned_addr learned my addr 172.21.15.17:0/2101747032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61a36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 -- 172.21.15.17:0/2101747032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 msgr2=0x7f6a5c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 -- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 msgr2=0x7f6a5c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 -- 172.21.15.17:0/2101747032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c19d4e0 con 0x7f6a5c102d30 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a61235640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e9f0 tx=0x7f6a5800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a527fc640 1 -- 172.21.15.17:0/2101747032 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800ccc0 con 0x7f6a5c102d30 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a527fc640 1 -- 172.21.15.17:0/2101747032 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a58010910 con 0x7f6a5c102d30 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c19d7d0 con 0x7f6a5c102d30 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.558+0000 7f6a527fc640 1 -- 172.21.15.17:0/2101747032 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580189c0 con 0x7f6a5c102d30 2024-09-10T11:46:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.559+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c1008c0 con 0x7f6a5c102d30 2024-09-10T11:46:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.561+0000 7f6a527fc640 1 -- 172.21.15.17:0/2101747032 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a58010ac0 con 0x7f6a5c102d30 2024-09-10T11:46:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 Processor -- start 2024-09-10T11:46:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 -- start start 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 0x560072038090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072038a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072043370 0x560072045760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560071f9e2f0 con 0x560072039b40 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560071f45cf0 con 0x560072043370 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.562+0000 7f6a65872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560071f9a2b0 con 0x5600720385d0 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 0x560072038090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072038a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40042/0 (socket says 172.21.15.17:40042) 2024-09-10T11:46:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61235640 1 -- 172.21.15.17:0/2265155657 learned_addr learned my addr 172.21.15.17:0/2265155657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a60a34640 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072043370 0x560072045760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a527fc640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 0x7f6a480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 -- 172.21.15.17:0/2265155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 msgr2=0x560072038a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072038a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 -- 172.21.15.17:0/2265155657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072043370 msgr2=0x560072045760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072043370 0x560072045760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 -- 172.21.15.17:0/2265155657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560071f2a3a0 con 0x560072039b40 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a527fc640 1 -- 172.21.15.17:0/2101747032 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6a580cf3c0 con 0x7f6a5c102d30 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.563+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 0x560072038090 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a54006010 tx=0x7f6a54009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed2e1ccd2818d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.564+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 0x7f6a480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.564+0000 7f6a477fe640 1 -- 172.21.15.17:0/2265155657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5404c070 con 0x560072039b40 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.564+0000 7f6a477fe640 1 -- 172.21.15.17:0/2265155657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54036040 con 0x560072039b40 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.564+0000 7f6a477fe640 1 -- 172.21.15.17:0/2265155657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403ce50 con 0x560072039b40 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 -- 172.21.15.17:0/2265155657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 msgr2=0x560072038090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a61a36640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 0x7f6a480a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a54046000 tx=0x7f6a540044b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 0x560072038090 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a54006010 tx=0x7f6a54009a20 comp rx=0 tx=0).stop 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 -- 172.21.15.17:0/2265155657 shutdown_connections 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072038a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072043370 0x560072045760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 --2- 172.21.15.17:0/2265155657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072039b40 0x560072038090 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 -- 172.21.15.17:0/2265155657 >> 172.21.15.17:0/2265155657 conn(0x560072001310 msgr2=0x560072034c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.565+0000 7f6a65872740 1 -- 172.21.15.17:0/2265155657 shutdown_connections 2024-09-10T11:46:34.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.566+0000 7f6a65872740 1 -- 172.21.15.17:0/2265155657 wait complete. 2024-09-10T11:46:34.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.566+0000 7f6a65872740 1 -- start start 2024-09-10T11:46:34.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.566+0000 7f6a65872740 1 Processor -- start 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.566+0000 7f6a65872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072042d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.566+0000 7f6a65872740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a65872740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x560072040600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a65872740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560072046010 con 0x560072043370 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a65872740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560071f59060 con 0x560072039b40 2024-09-10T11:46:34.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a65872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560072046190 con 0x5600720385d0 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a65872740 10 client.0 _ll_register_callbacks cb 0x560071cac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33110/0 (socket says 172.21.15.17:33110) 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 -- 172.21.15.17:0/1112775632 learned_addr learned my addr 172.21.15.17:0/1112775632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a61a36640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x560072040600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a61235640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072042d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 -- 172.21.15.17:0/1112775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 msgr2=0x560072042d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072042d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 -- 172.21.15.17:0/1112775632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 msgr2=0x560072040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x560072040600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a60a34640 1 -- 172.21.15.17:0/1112775632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560071d0f3c0 con 0x560072039b40 2024-09-10T11:46:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.567+0000 7f6a61a36640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x560072040600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c012770 tx=0x7f6a4c012c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e6c0ee116deb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00f8c0 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6a4c00fa60 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a54036040 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6a4c00fca0 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a65872740 10 client.25307 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560072051b10 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.568+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54036040 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6a4c01c4b0 con 0x560072039b40 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 10 client.25307 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 10 client.25307 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:46:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 20 client.25307 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x560072052fc0 0x560072055420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 4 client.25307 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560071fab860 con 0x560072052fc0 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.569+0000 7f6a61235640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x560072052fc0 0x560072055420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.570+0000 7f6a61235640 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x560072052fc0 0x560072055420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a623454912a919b5 server_cookie=2a864d2c8450c348 in_seq=0 out_seq=0 2024-09-10T11:46:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.570+0000 7f6a44ff9640 10 client.25307 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.570+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1112775632 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560071fab860 con 0x560072052fc0 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.570+0000 7f6a44ff9640 10 client.25307 handle_command_reply: tid=0 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.570+0000 7f6a65872740 1 client.25307 shutdown 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 msgr2=0x560072040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c012770 tx=0x7f6a4c012c30 comp rx=0 tx=0).stop 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 shutdown_connections 2024-09-10T11:46:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x560072052fc0 0x560072055420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x560072040600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072040010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a44ff9640 0 client.25307 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 --2- 172.21.15.17:0/1112775632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5600720385d0 0x560072042d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 >> 172.21.15.17:0/1112775632 conn(0x560072001310 msgr2=0x56007203a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 shutdown_connections 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 1 -- 172.21.15.17:0/1112775632 wait complete. 2024-09-10T11:46:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.571+0000 7f6a65872740 20 client.25307 trim_cache size 0 max 16384 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.586+0000 7f6a65872740 1 Processor -- start 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.586+0000 7f6a65872740 1 -- start start 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 0x56007203f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072041f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 0x56007203b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1ab3f0 con 0x5600720385d0 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1ad020 con 0x560072039b40 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a65872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1abac0 con 0x560072043370 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072041f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072041f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33120/0 (socket says 172.21.15.17:33120) 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a60a34640 1 -- 172.21.15.17:0/269020729 learned_addr learned my addr 172.21.15.17:0/269020729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a61a36640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 0x56007203b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a61235640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 0x56007203f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a61a36640 1 -- 172.21.15.17:0/269020729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 msgr2=0x560072041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.587+0000 7f6a61a36640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072041f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a61a36640 1 -- 172.21.15.17:0/269020729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 msgr2=0x56007203f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a61a36640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 0x56007203f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a61a36640 1 -- 172.21.15.17:0/269020729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560072034510 con 0x560072043370 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a61235640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 0x56007203f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:46:34.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a61a36640 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 0x56007203b120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402a920 tx=0x7f6a54053000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca692b3453b1116 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a46ffd640 1 -- 172.21.15.17:0/269020729 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54061070 con 0x560072043370 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a46ffd640 1 -- 172.21.15.17:0/269020729 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54058030 con 0x560072043370 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.588+0000 7f6a46ffd640 1 -- 172.21.15.17:0/269020729 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5404c040 con 0x560072043370 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- 172.21.15.17:0/269020729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 msgr2=0x56007203b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 0x56007203b120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402a920 tx=0x7f6a54053000 comp rx=0 tx=0).stop 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- 172.21.15.17:0/269020729 shutdown_connections 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072043370 0x56007203b120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560072039b40 0x560072041f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 --2- 172.21.15.17:0/269020729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600720385d0 0x56007203f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- 172.21.15.17:0/269020729 >> 172.21.15.17:0/269020729 conn(0x560072001310 msgr2=0x560072041870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- 172.21.15.17:0/269020729 shutdown_connections 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- 172.21.15.17:0/269020729 wait complete. 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.589+0000 7f6a65872740 1 -- start start 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 Processor -- start 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x56007203d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1ac890 con 0x560072043370 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1ac190 con 0x5600720385d0 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a65872740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1a93d0 con 0x560072039b40 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a61235640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40072/0 (socket says 172.21.15.17:40072) 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a61235640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33128/0 (socket says 172.21.15.17:33128) 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.590+0000 7f6a60a34640 1 -- 172.21.15.17:0/1139032553 learned_addr learned my addr 172.21.15.17:0/1139032553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a65872740 10 client.0 _ll_register_callbacks cb 0x7f6a4c0098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a61a36640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x56007203d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 -- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 msgr2=0x56007204ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 -- 172.21.15.17:0/1139032553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 msgr2=0x56007203d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x56007203d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 -- 172.21.15.17:0/1139032553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56007203d890 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a61235640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a60a34640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c01c950 tx=0x7f6a4c009730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77cc072b08a6d68e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c01c630 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.591+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6a4c00f790 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a54058030 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6a4c00f990 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 10 client.25279 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5600720c63b0 con 0x560072039b40 2024-09-10T11:46:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54058030 con 0x560072039b40 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6a4c003860 con 0x560072039b40 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 10 client.25279 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 10 client.25279 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 20 client.25279 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5600720c6bb0 0x5600720c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 4 client.25279 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.592+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560071fa5d70 con 0x5600720c6bb0 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a61235640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5600720c6bb0 0x5600720c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a61235640 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5600720c6bb0 0x5600720c8fd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1187201936b71f6 server_cookie=635a3cdfe53da542 in_seq=0 out_seq=0 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a44ff9640 10 client.25279 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a44ff9640 1 -- 172.21.15.17:0/1139032553 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560071fa5d70 con 0x5600720c6bb0 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a44ff9640 10 client.25279 handle_command_reply: tid=0 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.593+0000 7f6a65872740 1 client.25279 shutdown 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 msgr2=0x56007203cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c01c950 tx=0x7f6a4c009730 comp rx=0 tx=0).stop 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 shutdown_connections 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5600720c6bb0 0x5600720c8fd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560072039b40 0x56007203cc60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560072043370 0x56007203d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a44ff9640 0 client.25279 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 --2- 172.21.15.17:0/1139032553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5600720385d0 0x56007204ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 >> 172.21.15.17:0/1139032553 conn(0x560072001310 msgr2=0x560072033500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 shutdown_connections 2024-09-10T11:46:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 1 -- 172.21.15.17:0/1139032553 wait complete. 2024-09-10T11:46:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.594+0000 7f6a65872740 20 client.25279 trim_cache size 0 max 16384 2024-09-10T11:46:34.600 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:46:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 msgr2=0x7f6a480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 0x7f6a480a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a54046000 tx=0x7f6a540044b0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 msgr2=0x7f6a5c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e9f0 tx=0x7f6a5800eeb0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 shutdown_connections 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6a480a2c00 0x7f6a480a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a5c1082a0 0x7f6a5c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a5c1036e0 0x7f6a5c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 --2- 172.21.15.17:0/2101747032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5c102d30 0x7f6a5c198530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 >> 172.21.15.17:0/2101747032 conn(0x7f6a5c0fc7d0 msgr2=0x7f6a5c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 shutdown_connections 2024-09-10T11:46:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:34.595+0000 7f6a63499640 1 -- 172.21.15.17:0/2101747032 wait complete. 2024-09-10T11:46:35.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:34 smithi081 ceph-mon[35059]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.76k op/s 2024-09-10T11:46:35.227 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:34 smithi017 ceph-mon[30817]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.76k op/s 2024-09-10T11:46:35.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:34 smithi026 ceph-mon[34817]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.76k op/s 2024-09-10T11:46:35.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:46:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 -- 172.21.15.17:0/1648822331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8108300 msgr2=0x7fa5d810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 --2- 172.21.15.17:0/1648822331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8108300 0x7fa5d810ec70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009cd0 tx=0x7fa5d002a8d0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 -- 172.21.15.17:0/1648822331 shutdown_connections 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 --2- 172.21.15.17:0/1648822331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8108300 0x7fa5d810ec70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 --2- 172.21.15.17:0/1648822331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8103780 0x7fa5d8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 --2- 172.21.15.17:0/1648822331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 -- 172.21.15.17:0/1648822331 >> 172.21.15.17:0/1648822331 conn(0x7fa5d80fc7d0 msgr2=0x7fa5d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 -- 172.21.15.17:0/1648822331 shutdown_connections 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.406+0000 7fa5df99e640 1 -- 172.21.15.17:0/1648822331 wait complete. 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 Processor -- start 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 -- start start 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8103780 0x7fa5d8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8108300 0x7fa5d819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81120d0 con 0x7fa5d8103780 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d8111f50 con 0x7fa5d8108300 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5df99e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d8112250 con 0x7fa5d8102dd0 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5dcf39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8103780 0x7fa5d8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.407+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40088/0 (socket says 172.21.15.17:40088) 2024-09-10T11:46:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 -- 172.21.15.17:0/3988248269 learned_addr learned my addr 172.21.15.17:0/3988248269 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8108300 0x7fa5d819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 -- 172.21.15.17:0/3988248269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8108300 msgr2=0x7fa5d819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8108300 0x7fa5d819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 -- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8103780 msgr2=0x7fa5d8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8103780 0x7fa5d8198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 -- 172.21.15.17:0/3988248269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d819d500 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400e9f0 tx=0x7fa5d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5ce7fc640 1 -- 172.21.15.17:0/3988248269 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400cd80 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5ce7fc640 1 -- 172.21.15.17:0/3988248269 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5d4010910 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d819d7f0 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5ce7fc640 1 -- 172.21.15.17:0/3988248269 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4018990 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.408+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d81a50d0 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.411+0000 7fa5ce7fc640 1 -- 172.21.15.17:0/3988248269 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa5d4010ac0 con 0x7fa5d8102dd0 2024-09-10T11:46:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.411+0000 7fa5e1d77740 1 Processor -- start 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.411+0000 7fa5e1d77740 1 -- start start 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c6ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c76370 0x558450c78760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558450bd12f0 con 0x558450c6b5d0 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558450b78cf0 con 0x558450c76370 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558450bcd2b0 con 0x558450c6cb40 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c6ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ce7fc640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 0x7fa5c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40094/0 (socket says 172.21.15.17:40094) 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 -- 172.21.15.17:0/3909765932 learned_addr learned my addr 172.21.15.17:0/3909765932 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c76370 0x558450c78760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 0x7fa5c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ce7fc640 1 -- 172.21.15.17:0/3988248269 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa5d40cf2a0 con 0x7fa5d8102dd0 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 -- 172.21.15.17:0/3909765932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c76370 msgr2=0x558450c78760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c76370 0x558450c78760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 -- 172.21.15.17:0/3909765932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 msgr2=0x558450c6ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c6ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.412+0000 7fa5ddf3b640 1 -- 172.21.15.17:0/3909765932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558450b5d3a0 con 0x558450c6cb40 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.413+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5d002adf0 tx=0x7fa5d0031dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29980270cf30f3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.413+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 0x7fa5c40a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0048000 tx=0x7fa5d004a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.413+0000 7fa5c37fe640 1 -- 172.21.15.17:0/3909765932 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003a30 con 0x558450c6cb40 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.413+0000 7fa5c37fe640 1 -- 172.21.15.17:0/3909765932 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5d0036070 con 0x558450c6cb40 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.413+0000 7fa5c37fe640 1 -- 172.21.15.17:0/3909765932 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d002f850 con 0x558450c6cb40 2024-09-10T11:46:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3909765932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 msgr2=0x558450c6b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5d002adf0 tx=0x7fa5d0031dd0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3909765932 shutdown_connections 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c76370 0x558450c78760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c6ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3909765932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6b090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3909765932 >> 172.21.15.17:0/3909765932 conn(0x558450c34310 msgr2=0x558450c67c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3909765932 shutdown_connections 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3909765932 wait complete. 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.414+0000 7fa5e1d77740 1 -- start start 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 Processor -- start 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c75dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 0x558450c73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558450c7d480 con 0x558450c6b5d0 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558450b8c060 con 0x558450c6cb40 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558450c7d600 con 0x558450c76370 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5e1d77740 10 client.0 _ll_register_callbacks cb 0x5584508df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5dcf39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 0x558450c73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40102/0 (socket says 172.21.15.17:40102) 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5ddf3b640 1 -- 172.21.15.17:0/3053602658 learned_addr learned my addr 172.21.15.17:0/3053602658 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.415+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c75dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 -- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 msgr2=0x558450c73800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 -- 172.21.15.17:0/3053602658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 msgr2=0x558450c75dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c75dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 -- 172.21.15.17:0/3053602658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584509423c0 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 0x558450c73070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80fee10 tx=0x7fa5c8012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9eea8e1df6c49d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8004030 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa5c80041d0 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.416+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d0036070 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa5c80043d0 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 10 client.25325 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558450c89040 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5d0036070 con 0x558450c6cb40 2024-09-10T11:46:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fa5c8003a60 con 0x558450c6cb40 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 10 client.25325 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 10 client.25325 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 20 client.25325 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c8a500 0x558450c8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 4 client.25325 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.417+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558450bde860 con 0x558450c8a500 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.418+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c8a500 0x558450c8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.418+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c8a500 0x558450c8c910 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b13f3e791942bcfa server_cookie=48c787c3a4279a43 in_seq=0 out_seq=0 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.418+0000 7fa5c0ff9640 10 client.25325 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/3053602658 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558450bde860 con 0x558450c8a500 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5c0ff9640 10 client.25325 handle_command_reply: tid=0 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 client.25325 shutdown 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 msgr2=0x558450c73070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 0x558450c73070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80fee10 tx=0x7fa5c8012b60 comp rx=0 tx=0).stop 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 shutdown_connections 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c8a500 0x558450c8c910 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c76370 0x558450c73800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6cb40 0x558450c73070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5c0ff9640 0 client.25325 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/3053602658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c6b5d0 0x558450c75dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 >> 172.21.15.17:0/3053602658 conn(0x558450c34310 msgr2=0x558450c6d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 shutdown_connections 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 1 -- 172.21.15.17:0/3053602658 wait complete. 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.419+0000 7fa5e1d77740 20 client.25325 trim_cache size 0 max 16384 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.434+0000 7fa5e1d77740 1 Processor -- start 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.434+0000 7fa5e1d77740 1 -- start start 2024-09-10T11:46:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c74fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81ab390 con 0x558450c76370 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81acfc0 con 0x558450c6b5d0 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81aba60 con 0x558450c6cb40 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c74fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c74fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33182/0 (socket says 172.21.15.17:33182) 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dd73a640 1 -- 172.21.15.17:0/4122352614 learned_addr learned my addr 172.21.15.17:0/4122352614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 -- 172.21.15.17:0/4122352614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 msgr2=0x558450c74fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c74fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 -- 172.21.15.17:0/4122352614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 msgr2=0x558450c6e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c6e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5dcf39640 1 -- 172.21.15.17:0/4122352614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558450c715e0 con 0x558450c6cb40 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.435+0000 7fa5ddf3b640 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c6e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.436+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6e120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8000c00 tx=0x7fa5c8005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6faf2a1eee3044 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.436+0000 7fa5c2ffd640 1 -- 172.21.15.17:0/4122352614 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c801c550 con 0x558450c6cb40 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.436+0000 7fa5c2ffd640 1 -- 172.21.15.17:0/4122352614 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5c802b030 con 0x558450c6cb40 2024-09-10T11:46:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.436+0000 7fa5c2ffd640 1 -- 172.21.15.17:0/4122352614 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800fb50 con 0x558450c6cb40 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- 172.21.15.17:0/4122352614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 msgr2=0x558450c6e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6e120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8000c00 tx=0x7fa5c8005710 comp rx=0 tx=0).stop 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- 172.21.15.17:0/4122352614 shutdown_connections 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6e120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c6e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/4122352614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c74fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- 172.21.15.17:0/4122352614 >> 172.21.15.17:0/4122352614 conn(0x558450c34310 msgr2=0x558450c748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- 172.21.15.17:0/4122352614 shutdown_connections 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- 172.21.15.17:0/4122352614 wait complete. 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 -- start start 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.437+0000 7fa5e1d77740 1 Processor -- start 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c83110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81ac830 con 0x558450c76370 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81ac130 con 0x558450c6b5d0 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d81a9370 con 0x558450c6cb40 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5e1d77740 10 client.0 _ll_register_callbacks cb 0x7fa5c8009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dcf39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c83110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dcf39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40108/0 (socket says 172.21.15.17:40108) 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5ddf3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dcf39640 1 -- 172.21.15.17:0/173057452 learned_addr learned my addr 172.21.15.17:0/173057452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 -- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 msgr2=0x558450c6fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 -- 172.21.15.17:0/173057452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 msgr2=0x558450c704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dd73a640 1 -- 172.21.15.17:0/173057452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558450c70d20 con 0x558450c6b5d0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.438+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5dd73a640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c83110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ccdb0 tx=0x7fa5d40cf690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7148b300f2d2892 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40b3070 con 0x558450c6b5d0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5c802b030 con 0x558450c6b5d0 2024-09-10T11:46:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa5d4098230 con 0x558450c6b5d0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa5d4018b30 con 0x558450c6b5d0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5e1d77740 10 client.25331 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558450c78e30 con 0x558450c6b5d0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.439+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5d40ba020 con 0x558450c6b5d0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fa5d40ba1d0 con 0x558450c6b5d0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 10 client.25331 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 10 client.25331 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 20 client.25331 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c79500 0x558450c7b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 4 client.25331 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa5c802b030 con 0x558450c79500 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c79500 0x558450c7b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.440+0000 7fa5c0ff9640 10 client.25331 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5dcf39640 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c79500 0x558450c7b8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6cc7faf4473b1e5b server_cookie=55875dc6fe1f4eda in_seq=0 out_seq=0 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5c0ff9640 1 -- 172.21.15.17:0/173057452 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa5c802b030 con 0x558450c79500 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5c0ff9640 10 client.25331 handle_command_reply: tid=0 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5e1d77740 1 client.25331 shutdown 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 msgr2=0x558450c83110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.441+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c83110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ccdb0 tx=0x7fa5d40cf690 comp rx=0 tx=0).stop 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 shutdown_connections 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x558450c79500 0x558450c7b8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558450c6cb40 0x558450c6fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558450c76370 0x558450c704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5c0ff9640 0 client.25331 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 --2- 172.21.15.17:0/173057452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558450c6b5d0 0x558450c83110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 >> 172.21.15.17:0/173057452 conn(0x558450c34310 msgr2=0x558450c750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 shutdown_connections 2024-09-10T11:46:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 1 -- 172.21.15.17:0/173057452 wait complete. 2024-09-10T11:46:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.442+0000 7fa5e1d77740 20 client.25331 trim_cache size 0 max 16384 2024-09-10T11:46:36.457 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:46:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 msgr2=0x7fa5c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 0x7fa5c40a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0048000 tx=0x7fa5d004a000 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 msgr2=0x7fa5d8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400e9f0 tx=0x7fa5d400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 shutdown_connections 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa5c40a2c00 0x7fa5c40a50c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5d8108300 0x7fa5d819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5d8103780 0x7fa5d8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 --2- 172.21.15.17:0/3988248269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d8102dd0 0x7fa5d8198550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 >> 172.21.15.17:0/3988248269 conn(0x7fa5d80fc7d0 msgr2=0x7fa5d8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 shutdown_connections 2024-09-10T11:46:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:36.443+0000 7fa5df99e640 1 -- 172.21.15.17:0/3988248269 wait complete. 2024-09-10T11:46:37.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:36 smithi081 ceph-mon[35059]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 MiB/s wr, 5.29k op/s 2024-09-10T11:46:37.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:36 smithi026 ceph-mon[34817]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 MiB/s wr, 5.29k op/s 2024-09-10T11:46:37.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:36 smithi017 ceph-mon[30817]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 MiB/s wr, 5.29k op/s 2024-09-10T11:46:37.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:46:37.905 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 -- 172.21.15.17:0/1891300516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 msgr2=0x7f30d810e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 --2- 172.21.15.17:0/1891300516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d810e350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009900 tx=0x7f30c802a440 comp rx=0 tx=0).stop 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 -- 172.21.15.17:0/1891300516 shutdown_connections 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 --2- 172.21.15.17:0/1891300516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 --2- 172.21.15.17:0/1891300516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d810e350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 --2- 172.21.15.17:0/1891300516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d8109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 -- 172.21.15.17:0/1891300516 >> 172.21.15.17:0/1891300516 conn(0x7f30d806e2d0 msgr2=0x7f30d806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 -- 172.21.15.17:0/1891300516 shutdown_connections 2024-09-10T11:46:38.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.564+0000 7f30dd193640 1 -- 172.21.15.17:0/1891300516 wait complete. 2024-09-10T11:46:38.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 Processor -- start 2024-09-10T11:46:38.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 -- start start 2024-09-10T11:46:38.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d81a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d81a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8118590 con 0x7f30d810ea80 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8118410 con 0x7f30d8109e00 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.566+0000 7f30dd193640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8118710 con 0x7f30d8109450 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.567+0000 7f30d659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d81a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.567+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d81a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.568+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d81a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40122/0 (socket says 172.21.15.17:40122) 2024-09-10T11:46:38.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.568+0000 7f30d6d9d640 1 -- 172.21.15.17:0/3364653400 learned_addr learned my addr 172.21.15.17:0/3364653400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:38.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.570+0000 7f30d759e640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.571+0000 7f30d759e640 1 -- 172.21.15.17:0/3364653400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 msgr2=0x7f30d81a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.571+0000 7f30d759e640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d81a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.571+0000 7f30d759e640 1 -- 172.21.15.17:0/3364653400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 msgr2=0x7f30d81a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.571+0000 7f30d759e640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d81a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.571+0000 7f30d759e640 1 -- 172.21.15.17:0/3364653400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d81a11d0 con 0x7f30d810ea80 2024-09-10T11:46:38.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.572+0000 7f30d759e640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81a0aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e970 tx=0x7f30cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.572+0000 7f30bffff640 1 -- 172.21.15.17:0/3364653400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00ccc0 con 0x7f30d810ea80 2024-09-10T11:46:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.573+0000 7f30bffff640 1 -- 172.21.15.17:0/3364653400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30cc005020 con 0x7f30d810ea80 2024-09-10T11:46:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.573+0000 7f30bffff640 1 -- 172.21.15.17:0/3364653400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc004a00 con 0x7f30d810ea80 2024-09-10T11:46:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.573+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d81a14c0 con 0x7f30d810ea80 2024-09-10T11:46:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.573+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d807a450 con 0x7f30d810ea80 2024-09-10T11:46:38.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.577+0000 7f30bffff640 1 -- 172.21.15.17:0/3364653400 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f30cc0051d0 con 0x7f30d810ea80 2024-09-10T11:46:38.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.578+0000 7f30bffff640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 0x7f30c00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.579+0000 7f30bffff640 1 -- 172.21.15.17:0/3364653400 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f30cc0cefb0 con 0x7f30d810ea80 2024-09-10T11:46:38.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.580+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 0x7f30c00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.581+0000 7f30df56c740 1 Processor -- start 2024-09-10T11:46:38.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.582+0000 7f30df56c740 1 -- start start 2024-09-10T11:46:38.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.582+0000 7f30df56c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 0x55c36ed0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.582+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 0x7f30c00a5140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30d81a1be0 tx=0x7f30d00094e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30df56c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 0x55c36ed0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 0x55c36ed0e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33204/0 (socket says 172.21.15.17:33204) 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40132/0 (socket says 172.21.15.17:40132) 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30d6d9d640 1 -- 172.21.15.17:0/723988025 learned_addr learned my addr 172.21.15.17:0/723988025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.583+0000 7f30df56c740 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed1b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c36ec742f0 con 0x55c36ed19370 2024-09-10T11:46:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c36ec1bcf0 con 0x55c36ed0fb40 2024-09-10T11:46:38.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c36ec702b0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d759e640 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed1b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d659c640 1 -- 172.21.15.17:0/723988025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 msgr2=0x55c36ed0e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d659c640 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 0x55c36ed0e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d659c640 1 -- 172.21.15.17:0/723988025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 msgr2=0x55c36ed1b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d659c640 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed1b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.584+0000 7f30d659c640 1 -- 172.21.15.17:0/723988025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36ec003a0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.585+0000 7f30d659c640 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000c00 tx=0x7f30c8009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1a9f2edf29ce50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.585+0000 7f30bd7fa640 1 -- 172.21.15.17:0/723988025 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8035030 con 0x55c36ed0e5d0 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.586+0000 7f30bd7fa640 1 -- 172.21.15.17:0/723988025 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c8005520 con 0x55c36ed0e5d0 2024-09-10T11:46:38.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.586+0000 7f30bd7fa640 1 -- 172.21.15.17:0/723988025 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8004e40 con 0x55c36ed0e5d0 2024-09-10T11:46:38.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.587+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 msgr2=0x55c36ed0ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.587+0000 7f30df56c740 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000c00 tx=0x7f30c8009680 comp rx=0 tx=0).stop 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.587+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 shutdown_connections 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.587+0000 7f30df56c740 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed0ea10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.587+0000 7f30df56c740 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed1b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.588+0000 7f30df56c740 1 --2- 172.21.15.17:0/723988025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0fb40 0x55c36ed0e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.588+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 >> 172.21.15.17:0/723988025 conn(0x55c36ecd7310 msgr2=0x55c36ed0ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.589+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 shutdown_connections 2024-09-10T11:46:38.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.591+0000 7f30df56c740 1 -- 172.21.15.17:0/723988025 wait complete. 2024-09-10T11:46:38.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.592+0000 7f30df56c740 1 -- start start 2024-09-10T11:46:38.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.592+0000 7f30df56c740 1 Processor -- start 2024-09-10T11:46:38.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.592+0000 7f30df56c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed16110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.592+0000 7f30df56c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 0x55c36ed16650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.592+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed16110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed16110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40144/0 (socket says 172.21.15.17:40144) 2024-09-10T11:46:38.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30d6d9d640 1 -- 172.21.15.17:0/3497509569 learned_addr learned my addr 172.21.15.17:0/3497509569 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30d659c640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 0x55c36ed16650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed16b90 0x55c36ed2dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c36ed1c060 con 0x55c36ed16b90 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c36ec2f060 con 0x55c36ed19370 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c36ed1c1e0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.593+0000 7f30df56c740 10 client.0 _ll_register_callbacks cb 0x55c36e9828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 -- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 msgr2=0x55c36ed16110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed16110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 -- 172.21.15.17:0/3497509569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed16b90 msgr2=0x55c36ed2dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed16b90 0x55c36ed2dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36e9e53c0 con 0x55c36ed19370 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30d659c640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 0x55c36ed16650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005ec0 tx=0x7f30c8031810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553ed8124cbd4ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.594+0000 7f30baff5640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.595+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8051060 con 0x55c36ed19370 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.595+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f30c8031b10 con 0x55c36ed19370 2024-09-10T11:46:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.595+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c8005520 con 0x55c36ed19370 2024-09-10T11:46:38.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.597+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30c8035070 con 0x55c36ed19370 2024-09-10T11:46:38.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.597+0000 7f30df56c740 10 client.25343 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:38.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.597+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c36ed30810 con 0x55c36ed19370 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c8031400 con 0x55c36ed19370 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f30c8004ac0 con 0x55c36ed19370 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30df56c740 10 client.25343 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30df56c740 10 client.25343 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30df56c740 20 client.25343 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.598+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed31b60 0x55c36ed33f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.599+0000 7f30df56c740 4 client.25343 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.599+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f30c8005520 con 0x55c36ed31b60 2024-09-10T11:46:38.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.599+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed31b60 0x55c36ed33f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.601+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed31b60 0x55c36ed33f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a138e87239683984 server_cookie=a1f0214230711660 in_seq=0 out_seq=0 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.601+0000 7f30baff5640 10 client.25343 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.602+0000 7f30baff5640 1 -- 172.21.15.17:0/3497509569 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f30c8005520 con 0x55c36ed31b60 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.602+0000 7f30baff5640 10 client.25343 handle_command_reply: tid=0 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.602+0000 7f30df56c740 1 client.25343 shutdown 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.602+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 msgr2=0x55c36ed16650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.603+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 0x55c36ed16650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005ec0 tx=0x7f30c8031810 comp rx=0 tx=0).stop 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.605+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 shutdown_connections 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.606+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed31b60 0x55c36ed33f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.606+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed16b90 0x55c36ed2dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.606+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed19370 0x55c36ed16650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.606+0000 7f30df56c740 1 --2- 172.21.15.17:0/3497509569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed16110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.606+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 >> 172.21.15.17:0/3497509569 conn(0x55c36ecd7310 msgr2=0x55c36ed10960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.607+0000 7f30baff5640 0 client.25343 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:46:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.607+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 shutdown_connections 2024-09-10T11:46:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.608+0000 7f30df56c740 1 -- 172.21.15.17:0/3497509569 wait complete. 2024-09-10T11:46:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.608+0000 7f30df56c740 20 client.25343 trim_cache size 0 max 16384 2024-09-10T11:46:38.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.633+0000 7f30df56c740 1 Processor -- start 2024-09-10T11:46:38.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.633+0000 7f30df56c740 1 -- start start 2024-09-10T11:46:38.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.633+0000 7f30df56c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30df56c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 0x55c36ed18080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40158/0 (socket says 172.21.15.17:40158) 2024-09-10T11:46:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30d659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 0x55c36ed18080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30d659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 0x55c36ed18080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33216/0 (socket says 172.21.15.17:33216) 2024-09-10T11:46:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30d6d9d640 1 -- 172.21.15.17:0/447543277 learned_addr learned my addr 172.21.15.17:0/447543277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.634+0000 7f30df56c740 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed2dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.635+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8080850 con 0x55c36ed19370 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.635+0000 7f30d759e640 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed2dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.635+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8082480 con 0x55c36ed16b90 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.635+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8080f20 con 0x55c36ed0e5d0 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 -- 172.21.15.17:0/447543277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 msgr2=0x55c36ed18080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 0x55c36ed18080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 -- 172.21.15.17:0/447543277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 msgr2=0x55c36ed2dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed2dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 -- 172.21.15.17:0/447543277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36ed0a4f0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.636+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30d0010bd0 tx=0x7f30d0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a383a255a406ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.640+0000 7f30bcff9640 1 -- 172.21.15.17:0/447543277 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d00229a0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.640+0000 7f30bcff9640 1 -- 172.21.15.17:0/447543277 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0030070 con 0x55c36ed0e5d0 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.640+0000 7f30bcff9640 1 -- 172.21.15.17:0/447543277 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0020430 con 0x55c36ed0e5d0 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 msgr2=0x55c36ed15090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30d0010bd0 tx=0x7f30d0016000 comp rx=0 tx=0).stop 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 shutdown_connections 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed2dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed16b90 0x55c36ed18080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 --2- 172.21.15.17:0/447543277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed0e5d0 0x55c36ed15090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.641+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 >> 172.21.15.17:0/447543277 conn(0x55c36ecd7310 msgr2=0x55c36ed17970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.642+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 shutdown_connections 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.642+0000 7f30df56c740 1 -- 172.21.15.17:0/447543277 wait complete. 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.642+0000 7f30df56c740 1 -- start start 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.642+0000 7f30df56c740 1 Processor -- start 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0e5d0 0x55c36ed33b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed345f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8081cf0 con 0x55c36ed19370 2024-09-10T11:46:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30d80815f0 con 0x55c36ed0e5d0 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30d807e830 con 0x55c36ed16b90 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30df56c740 10 client.0 _ll_register_callbacks cb 0x7f30cc0973a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40174/0 (socket says 172.21.15.17:40174) 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.643+0000 7f30d659c640 1 -- 172.21.15.17:0/2605666689 learned_addr learned my addr 172.21.15.17:0/2605666689 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 -- 172.21.15.17:0/2605666689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0e5d0 msgr2=0x55c36ed33b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0e5d0 0x55c36ed33b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 -- 172.21.15.17:0/2605666689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 msgr2=0x55c36ed345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 -- 172.21.15.17:0/2605666689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36ed9a5c0 con 0x55c36ed16b90 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.644+0000 7f30d659c640 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005bb0 tx=0x7f30c80052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17bfecd013df5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30baff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8051070 con 0x55c36ed16b90 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30d0030070 con 0x55c36ed16b90 2024-09-10T11:46:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f30c8004be0 con 0x55c36ed16b90 2024-09-10T11:46:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30c805b080 con 0x55c36ed16b90 2024-09-10T11:46:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.645+0000 7f30df56c740 10 client.25315 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c36ed9b840 con 0x55c36ed16b90 2024-09-10T11:46:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0030070 con 0x55c36ed16b90 2024-09-10T11:46:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f30c8003bf0 con 0x55c36ed16b90 2024-09-10T11:46:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 10 client.25315 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 10 client.25315 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 20 client.25315 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed9bf00 0x55c36ed9e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 4 client.25315 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c36ec81860 con 0x55c36ed9bf00 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.646+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed9bf00 0x55c36ed9e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30baff5640 10 client.25315 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30d6d9d640 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed9bf00 0x55c36ed9e320 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e304c6de912912d1 server_cookie=9e4db543863a5def in_seq=0 out_seq=0 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30baff5640 1 -- 172.21.15.17:0/2605666689 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c36ec81860 con 0x55c36ed9bf00 2024-09-10T11:46:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30baff5640 10 client.25315 handle_command_reply: tid=0 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30df56c740 1 client.25315 shutdown 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 msgr2=0x55c36ed340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.649+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30c8005bb0 tx=0x7f30c80052b0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 shutdown_connections 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55c36ed9bf00 0x55c36ed9e320 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c36ed16b90 0x55c36ed340b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36ed19370 0x55c36ed345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 --2- 172.21.15.17:0/2605666689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c36ed0e5d0 0x55c36ed33b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 >> 172.21.15.17:0/2605666689 conn(0x55c36ecd7310 msgr2=0x55c36ed09d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30baff5640 0 client.25315 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:46:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.650+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 shutdown_connections 2024-09-10T11:46:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.651+0000 7f30df56c740 1 -- 172.21.15.17:0/2605666689 wait complete. 2024-09-10T11:46:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.651+0000 7f30df56c740 20 client.25315 trim_cache size 0 max 16384 2024-09-10T11:46:38.657 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:46:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.656+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 msgr2=0x7f30c00a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 0x7f30c00a5140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30d81a1be0 tx=0x7f30d00094e0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 msgr2=0x7f30d81a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81a0aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00e970 tx=0x7f30cc00ee30 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 shutdown_connections 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f30c00a2c80 0x7f30c00a5140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30d810ea80 0x7f30d81a0aa0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30d8109e00 0x7f30d81a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 --2- 172.21.15.17:0/3364653400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30d8109450 0x7f30d81a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 >> 172.21.15.17:0/3364653400 conn(0x7f30d806e2d0 msgr2=0x7f30d8113ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 shutdown_connections 2024-09-10T11:46:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:38.657+0000 7f30dd193640 1 -- 172.21.15.17:0/3364653400 wait complete. 2024-09-10T11:46:39.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:38 smithi081 ceph-mon[35059]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 25 MiB/s wr, 4.69k op/s 2024-09-10T11:46:39.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:38 smithi026 ceph-mon[34817]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 25 MiB/s wr, 4.69k op/s 2024-09-10T11:46:39.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:38 smithi017 ceph-mon[30817]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 25 MiB/s wr, 4.69k op/s 2024-09-10T11:46:39.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:46:39.900 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 -- 172.21.15.17:0/4024179551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4101df0 msgr2=0x7f1be41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 --2- 172.21.15.17:0/4024179551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4101df0 0x7f1be41021d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009900 tx=0x7f1bd402a410 comp rx=0 tx=0).stop 2024-09-10T11:46:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 -- 172.21.15.17:0/4024179551 shutdown_connections 2024-09-10T11:46:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 --2- 172.21.15.17:0/4024179551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 --2- 172.21.15.17:0/4024179551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4106f20 0x7f1be410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 --2- 172.21.15.17:0/4024179551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4101df0 0x7f1be41021d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 -- 172.21.15.17:0/4024179551 >> 172.21.15.17:0/4024179551 conn(0x7f1be40fd8f0 msgr2=0x7f1be40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 -- 172.21.15.17:0/4024179551 shutdown_connections 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.908+0000 7f1be9e30640 1 -- 172.21.15.17:0/4024179551 wait complete. 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 Processor -- start 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 -- start start 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 0x7f1be40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4106f20 0x7f1be4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4111f80 con 0x7f1be4106f20 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4111e00 con 0x7f1be4101df0 2024-09-10T11:46:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be9e30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4112100 con 0x7f1be41027a0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 0x7f1be40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4106f20 0x7f1be4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 0x7f1be40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33234/0 (socket says 172.21.15.17:33234) 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40184/0 (socket says 172.21.15.17:40184) 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.909+0000 7f1be2ffd640 1 -- 172.21.15.17:0/227084776 learned_addr learned my addr 172.21.15.17:0/227084776 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 -- 172.21.15.17:0/227084776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 msgr2=0x7f1be40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 0x7f1be40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 -- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4106f20 msgr2=0x7f1be4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4106f20 0x7f1be4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 -- 172.21.15.17:0/227084776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be41a6920 con 0x7f1be41027a0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9f0 tx=0x7f1bd800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be0ff9640 1 -- 172.21.15.17:0/227084776 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800cd80 con 0x7f1be41027a0 2024-09-10T11:46:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be41a6c10 con 0x7f1be41027a0 2024-09-10T11:46:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be0ff9640 1 -- 172.21.15.17:0/227084776 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd8005500 con 0x7f1be41027a0 2024-09-10T11:46:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be0ff9640 1 -- 172.21.15.17:0/227084776 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8010690 con 0x7f1be41027a0 2024-09-10T11:46:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.910+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be41a7150 con 0x7f1be41027a0 2024-09-10T11:46:40.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1be0ff9640 1 -- 172.21.15.17:0/227084776 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1bd80046c0 con 0x7f1be41027a0 2024-09-10T11:46:40.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 Processor -- start 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 -- start start 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83b5b40 0x5573e83b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 0x5573e83c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5573e831a2f0 con 0x5573e83b45d0 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5573e82c1cf0 con 0x5573e83bf370 2024-09-10T11:46:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.913+0000 7f1bec209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573e83162b0 con 0x5573e83b5b40 2024-09-10T11:46:40.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 0x5573e83c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83b5b40 0x5573e83b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55918/0 (socket says 172.21.15.17:55918) 2024-09-10T11:46:40.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be37fe640 1 -- 172.21.15.17:0/4239209173 learned_addr learned my addr 172.21.15.17:0/4239209173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be0ff9640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 0x7f1bcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be3fff640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 0x7f1bcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be0ff9640 1 -- 172.21.15.17:0/227084776 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f1bd80cf450 con 0x7f1be41027a0 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 -- 172.21.15.17:0/4239209173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83b5b40 msgr2=0x5573e83b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83b5b40 0x5573e83b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 -- 172.21.15.17:0/4239209173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 msgr2=0x5573e83b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 -- 172.21.15.17:0/4239209173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e82a63a0 con 0x5573e83bf370 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be37fe640 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.914+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 0x5573e83c1760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bd809bc50 tx=0x7f1bd8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f7571573128c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1be3fff640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 0x7f1bcc0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009fd0 tx=0x7f1bdc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1bc9ffb640 1 -- 172.21.15.17:0/4239209173 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809c3c0 con 0x5573e83bf370 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1bc9ffb640 1 -- 172.21.15.17:0/4239209173 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd809bcc0 con 0x5573e83bf370 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1bc9ffb640 1 -- 172.21.15.17:0/4239209173 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809bf20 con 0x5573e83bf370 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1bec209740 1 -- 172.21.15.17:0/4239209173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 msgr2=0x5573e83c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.915+0000 7f1bec209740 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 0x5573e83c1760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bd809bc50 tx=0x7f1bd8004a40 comp rx=0 tx=0).stop 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 -- 172.21.15.17:0/4239209173 shutdown_connections 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83bf370 0x5573e83c1760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b45d0 0x5573e83b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 --2- 172.21.15.17:0/4239209173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83b5b40 0x5573e83b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 -- 172.21.15.17:0/4239209173 >> 172.21.15.17:0/4239209173 conn(0x5573e837d310 msgr2=0x5573e83b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 -- 172.21.15.17:0/4239209173 shutdown_connections 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 -- 172.21.15.17:0/4239209173 wait complete. 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 -- start start 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.916+0000 7f1bec209740 1 Processor -- start 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5573e83c2000 con 0x5573e83b5b40 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5573e82d5060 con 0x5573e83b45d0 2024-09-10T11:46:40.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573e83c2180 con 0x5573e83bf370 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1bec209740 10 client.0 _ll_register_callbacks cb 0x5573e80288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40198/0 (socket says 172.21.15.17:40198) 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 -- 172.21.15.17:0/4186608471 learned_addr learned my addr 172.21.15.17:0/4186608471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 -- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 msgr2=0x5573e83beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 -- 172.21.15.17:0/4186608471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 msgr2=0x5573e83bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be3fff640 1 -- 172.21.15.17:0/4186608471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e808b3c0 con 0x5573e83bf370 2024-09-10T11:46:40.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.917+0000 7f1be37fe640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1be3fff640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc010b70 tx=0x7f1bdc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9370056871286c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc012c10 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd809bcc0 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f1bdc012db0 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1bdc029430 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bec209740 10 client.25327 fetch_fsmap learned FSMap version 33 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.918+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5573e83cdb90 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd809bcc0 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1bdc01f860 con 0x5573e83bf370 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 10 client.25327 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T11:46:40.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 10 client.25327 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 20 client.25327 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e83cefa0 0x5573e83d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 4 client.25327 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573e8327860 con 0x5573e83cefa0 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.919+0000 7f1be37fe640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e83cefa0 0x5573e83d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.920+0000 7f1bc2ffd640 10 client.25327 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.920+0000 7f1be37fe640 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e83cefa0 0x5573e83d1390 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a9752905eff9543 server_cookie=fdb07d4ca526759e in_seq=0 out_seq=0 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.920+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/4186608471 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573e8327860 con 0x5573e83cefa0 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.920+0000 7f1bc2ffd640 10 client.25327 handle_command_reply: tid=0 2024-09-10T11:46:40.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 client.25327 shutdown 2024-09-10T11:46:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 msgr2=0x5573e83bc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc010b70 tx=0x7f1bdc004a40 comp rx=0 tx=0).stop 2024-09-10T11:46:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 shutdown_connections 2024-09-10T11:46:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e83cefa0 0x5573e83d1390 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83bc7e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 --2- 172.21.15.17:0/4186608471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bc2ffd640 0 client.25327 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 >> 172.21.15.17:0/4186608471 conn(0x5573e837d310 msgr2=0x5573e83b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 shutdown_connections 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 1 -- 172.21.15.17:0/4186608471 wait complete. 2024-09-10T11:46:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.921+0000 7f1bec209740 20 client.25327 trim_cache size 0 max 16384 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 Processor -- start 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 -- start start 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41af6c0 con 0x5573e83b5b40 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41b12f0 con 0x5573e83b45d0 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1bec209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41afd90 con 0x5573e83bf370 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33250/0 (socket says 172.21.15.17:33250) 2024-09-10T11:46:40.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.938+0000 7f1be37fe640 1 -- 172.21.15.17:0/3365421609 learned_addr learned my addr 172.21.15.17:0/3365421609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:40.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be3fff640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 -- 172.21.15.17:0/3365421609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 msgr2=0x5573e83d71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83d71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 -- 172.21.15.17:0/3365421609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 msgr2=0x5573e83b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 -- 172.21.15.17:0/3365421609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e83ba5a0 con 0x5573e83b5b40 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be37fe640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.939+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83d6c60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5573e83b5070 tx=0x7f1bd8009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d217eaa0f8142ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.940+0000 7f1bc97fa640 1 -- 172.21.15.17:0/3365421609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809c3c0 con 0x5573e83b5b40 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.940+0000 7f1bc97fa640 1 -- 172.21.15.17:0/3365421609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd80a0070 con 0x5573e83b5b40 2024-09-10T11:46:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.940+0000 7f1bc97fa640 1 -- 172.21.15.17:0/3365421609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd809bf20 con 0x5573e83b5b40 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 -- 172.21.15.17:0/3365421609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 msgr2=0x5573e83d6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83d6c60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5573e83b5070 tx=0x7f1bd8009720 comp rx=0 tx=0).stop 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 -- 172.21.15.17:0/3365421609 shutdown_connections 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e83d71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83d6c60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 --2- 172.21.15.17:0/3365421609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 -- 172.21.15.17:0/3365421609 >> 172.21.15.17:0/3365421609 conn(0x5573e837d310 msgr2=0x5573e83b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 -- 172.21.15.17:0/3365421609 shutdown_connections 2024-09-10T11:46:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.941+0000 7f1bec209740 1 -- 172.21.15.17:0/3365421609 wait complete. 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.942+0000 7f1bec209740 1 -- start start 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.942+0000 7f1bec209740 1 Processor -- start 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.942+0000 7f1bec209740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41b0b60 con 0x5573e83b5b40 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41b0460 con 0x5573e83b45d0 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41ad6a0 con 0x5573e83bf370 2024-09-10T11:46:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bec209740 10 client.0 _ll_register_callbacks cb 0x7f1bdc013410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40208/0 (socket says 172.21.15.17:40208) 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 -- 172.21.15.17:0/1410768352 learned_addr learned my addr 172.21.15.17:0/1410768352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be37fe640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be2ffd640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 -- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 msgr2=0x5573e83c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 -- 172.21.15.17:0/1410768352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 msgr2=0x5573e83c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 -- 172.21.15.17:0/1410768352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e8439170 con 0x5573e83bf370 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be37fe640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1be3fff640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009270 tx=0x7f1bdc005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99196915c2210af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:40.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.943+0000 7f1bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc004d20 con 0x5573e83bf370 2024-09-10T11:46:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f1bdc012a10 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd80a0070 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1bdc012c10 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bec209740 10 client.25333 fetch_fsmap learned FSMap version 34 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.948+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5573e843a380 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd80a0070 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7f1bdc020a10 con 0x5573e83bf370 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 10 client.25333 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 10 client.25333 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 20 client.25333 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e843aab0 0x5573e843cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 4 client.25333 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:46:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573e8321d70 con 0x5573e843aab0 2024-09-10T11:46:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.949+0000 7f1be37fe640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e843aab0 0x5573e843cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bc2ffd640 10 client.25333 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:46:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1be37fe640 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e843aab0 0x5573e843cef0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5079e1c121c25def server_cookie=a4778fcf392934ba in_seq=0 out_seq=0 2024-09-10T11:46:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/1410768352 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573e8321d70 con 0x5573e843aab0 2024-09-10T11:46:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bc2ffd640 10 client.25333 handle_command_reply: tid=0 2024-09-10T11:46:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 client.25333 shutdown 2024-09-10T11:46:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 msgr2=0x5573e8438c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009270 tx=0x7f1bdc005d30 comp rx=0 tx=0).stop 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 shutdown_connections 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x5573e843aab0 0x5573e843cef0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573e83bf370 0x5573e8438c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bc2ffd640 0 client.25333 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573e83b5b40 0x5573e83c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 --2- 172.21.15.17:0/1410768352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5573e83b45d0 0x5573e83c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 >> 172.21.15.17:0/1410768352 conn(0x5573e837d310 msgr2=0x5573e83af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 shutdown_connections 2024-09-10T11:46:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.950+0000 7f1bec209740 1 -- 172.21.15.17:0/1410768352 wait complete. 2024-09-10T11:46:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1bec209740 20 client.25333 trim_cache size 0 max 16384 2024-09-10T11:46:40.955 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 msgr2=0x7f1bcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 0x7f1bcc0a5040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009fd0 tx=0x7f1bdc004ab0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 msgr2=0x7f1be4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9f0 tx=0x7f1bd800edf0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 shutdown_connections 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1bcc0a2b80 0x7f1bcc0a5040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be41027a0 0x7f1be4074a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be4106f20 0x7f1be4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 --2- 172.21.15.17:0/227084776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be4101df0 0x7f1be40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.951+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 >> 172.21.15.17:0/227084776 conn(0x7f1be40fd8f0 msgr2=0x7f1be40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.952+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 shutdown_connections 2024-09-10T11:46:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:40.952+0000 7f1be9e30640 1 -- 172.21.15.17:0/227084776 wait complete. 2024-09-10T11:46:41.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:40 smithi081 ceph-mon[35059]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 5.84k op/s 2024-09-10T11:46:41.257 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:40 smithi026 ceph-mon[34817]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 5.84k op/s 2024-09-10T11:46:41.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:40 smithi017 ceph-mon[30817]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 5.84k op/s 2024-09-10T11:46:42.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:41 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:42.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:41 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:42.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:41 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:42.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:46:43.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:42 smithi017 ceph-mon[30817]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 MiB/s wr, 4.11k op/s 2024-09-10T11:46:43.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:42 smithi026 ceph-mon[34817]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 MiB/s wr, 4.11k op/s 2024-09-10T11:46:43.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:42 smithi081 ceph-mon[35059]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 13 KiB/s rd, 22 MiB/s wr, 4.11k op/s 2024-09-10T11:46:43.505 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 -- 172.21.15.17:0/3452981268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 msgr2=0x7f75a4102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 --2- 172.21.15.17:0/3452981268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a4102f70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7594009900 tx=0x7f759402a480 comp rx=0 tx=0).stop 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 -- 172.21.15.17:0/3452981268 shutdown_connections 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 --2- 172.21.15.17:0/3452981268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a410bfc0 0x7f75a410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 --2- 172.21.15.17:0/3452981268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a41034b0 0x7f75a410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 --2- 172.21.15.17:0/3452981268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a4102f70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 -- 172.21.15.17:0/3452981268 >> 172.21.15.17:0/3452981268 conn(0x7f75a40fc610 msgr2=0x7f75a40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 -- 172.21.15.17:0/3452981268 shutdown_connections 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.098+0000 7f75a359e640 1 -- 172.21.15.17:0/3452981268 wait complete. 2024-09-10T11:46:44.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.099+0000 7f75a359e640 1 Processor -- start 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.099+0000 7f75a359e640 1 -- start start 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.099+0000 7f75a359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.099+0000 7f75a359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 0x7f75a419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111dc0 con 0x7f75a4102b90 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111c40 con 0x7f75a410bfc0 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a359e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4111f40 con 0x7f75a41034b0 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f759bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 0x7f75a419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f759bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51826/0 (socket says 172.21.15.17:51826) 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f759bfff640 1 -- 172.21.15.17:0/3115717934 learned_addr learned my addr 172.21.15.17:0/3115717934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a259c640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 -- 172.21.15.17:0/3115717934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 msgr2=0x7f75a41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 -- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 msgr2=0x7f75a41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 -- 172.21.15.17:0/3115717934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a419d250 con 0x7f75a410bfc0 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f759bfff640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a259c640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.100+0000 7f75a2d9d640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 0x7f75a419cb70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f759c009fd0 tx=0x7f759c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.101+0000 7f759b7fe640 1 -- 172.21.15.17:0/3115717934 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c00ce20 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.101+0000 7f759b7fe640 1 -- 172.21.15.17:0/3115717934 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f759c005020 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.101+0000 7f759b7fe640 1 -- 172.21.15.17:0/3115717934 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c010720 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.101+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a419d540 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.101+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41a4e20 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.104+0000 7f759b7fe640 1 -- 172.21.15.17:0/3115717934 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f759c005540 con 0x7f75a410bfc0 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.104+0000 7f75ab1dc740 1 Processor -- start 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.104+0000 7f75ab1dc740 1 -- start start 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6738270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b6747960 0x5622b6749d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5622b669e2f0 con 0x5622b67387b0 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5622b6645cf0 con 0x5622b6739d20 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5622b669a2b0 con 0x5622b6747960 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f759b7fe640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 0x7f75900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f759bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b6747960 0x5622b6749d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58436/0 (socket says 172.21.15.17:58436) 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 -- 172.21.15.17:0/4276398590 learned_addr learned my addr 172.21.15.17:0/4276398590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a2d9d640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 0x7f75900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f759b7fe640 1 -- 172.21.15.17:0/3115717934 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f759c0cf6b0 con 0x7f75a410bfc0 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 -- 172.21.15.17:0/4276398590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b6747960 msgr2=0x5622b6749d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b6747960 0x5622b6749d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f75a259c640 1 -- 172.21.15.17:0/4276398590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 msgr2=0x5622b6738270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.105+0000 7f759bfff640 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6738270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f75a259c640 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6738270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f75a2d9d640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 0x7f75900a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c760 tx=0x7f759c013b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f75a259c640 1 -- 172.21.15.17:0/4276398590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b662a3a0 con 0x5622b67387b0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f759bfff640 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6738270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f75a259c640 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7594009900 tx=0x7f7594005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bb7c752ee5e7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f7598ff9640 1 -- 172.21.15.17:0/4276398590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594035040 con 0x5622b67387b0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f7598ff9640 1 -- 172.21.15.17:0/4276398590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7594031830 con 0x5622b67387b0 2024-09-10T11:46:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.106+0000 7f7598ff9640 1 -- 172.21.15.17:0/4276398590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75940047a0 con 0x5622b67387b0 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4276398590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 msgr2=0x5622b6738bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7594009900 tx=0x7f7594005d50 comp rx=0 tx=0).stop 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4276398590 shutdown_connections 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b6747960 0x5622b6749d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b67387b0 0x5622b6738bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4276398590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6738270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4276398590 >> 172.21.15.17:0/4276398590 conn(0x5622b6701310 msgr2=0x5622b6734e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4276398590 shutdown_connections 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.107+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4276398590 wait complete. 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f75ab1dc740 1 -- start start 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f75ab1dc740 1 Processor -- start 2024-09-10T11:46:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6747960 0x5622b6744d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f759bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.108+0000 7f759bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:48008/0 (socket says 172.21.15.17:48008) 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 -- 172.21.15.17:0/3166225967 learned_addr learned my addr 172.21.15.17:0/3166225967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75a259c640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6747960 0x5622b6744d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5622b674a600 con 0x5622b6747960 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5622b6659060 con 0x5622b6739d20 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5622b674a780 con 0x5622b67452a0 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f75ab1dc740 10 client.0 _ll_register_callbacks cb 0x5622b63ac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 -- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 msgr2=0x5622b6753ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 -- 172.21.15.17:0/3166225967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6747960 msgr2=0x5622b6744d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6747960 0x5622b6744d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b640f3c0 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f759bfff640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f758c010e30 tx=0x7f758c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58add1a29487eda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.109+0000 7f7589ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c004250 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7594031830 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f758c0043f0 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f758c0035f0 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 10 client.25370 fetch_fsmap learned FSMap version 34 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622b67566d0 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7594031830 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7f758c01f8d0 con 0x5622b6739d20 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 10 client.25370 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T11:46:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 10 client.25370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 20 client.25370 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b6757ae0 0x5622b6759f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 4 client.25370 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.110+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622b66ab860 con 0x5622b6757ae0 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.111+0000 7f75a259c640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b6757ae0 0x5622b6759f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.111+0000 7f75a259c640 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b6757ae0 0x5622b6759f10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b90b731c5955172 server_cookie=62633a7b379d85b8 in_seq=0 out_seq=0 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.111+0000 7f7589ffb640 10 client.25370 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f7589ffb640 1 -- 172.21.15.17:0/3166225967 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622b66ab860 con 0x5622b6757ae0 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f7589ffb640 10 client.25370 handle_command_reply: tid=0 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 client.25370 shutdown 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 msgr2=0x5622b6744820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f758c010e30 tx=0x7f758c005f90 comp rx=0 tx=0).stop 2024-09-10T11:46:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 shutdown_connections 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b6757ae0 0x5622b6759f10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f7589ffb640 0 client.25370 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6747960 0x5622b6744d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/3166225967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6739d20 0x5622b6744820 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 >> 172.21.15.17:0/3166225967 conn(0x5622b6701310 msgr2=0x5622b673ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 shutdown_connections 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 1 -- 172.21.15.17:0/3166225967 wait complete. 2024-09-10T11:46:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.112+0000 7f75ab1dc740 20 client.25370 trim_cache size 0 max 16384 2024-09-10T11:46:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 Processor -- start 2024-09-10T11:46:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 -- start start 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b675f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ab1c0 con 0x5622b6739d20 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41acdc0 con 0x5622b6747960 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ab890 con 0x5622b67452a0 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.129+0000 7f759bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f759bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58444/0 (socket says 172.21.15.17:58444) 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f759bfff640 1 -- 172.21.15.17:0/4015905620 learned_addr learned my addr 172.21.15.17:0/4015905620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f759bfff640 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b675f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 -- 172.21.15.17:0/4015905620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 msgr2=0x5622b675f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b675f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 -- 172.21.15.17:0/4015905620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 msgr2=0x5622b67538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 -- 172.21.15.17:0/4015905620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b675a590 con 0x5622b67452a0 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f759bfff640 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f75a259c640 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5622b67392d0 tx=0x7f75940053f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88df74376912567c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f758bfff640 1 -- 172.21.15.17:0/4015905620 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594035040 con 0x5622b67452a0 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f758bfff640 1 -- 172.21.15.17:0/4015905620 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75940317b0 con 0x5622b67452a0 2024-09-10T11:46:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.130+0000 7f758bfff640 1 -- 172.21.15.17:0/4015905620 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594003a90 con 0x5622b67452a0 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4015905620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 msgr2=0x5622b6753e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5622b67392d0 tx=0x7f75940053f0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4015905620 shutdown_connections 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b6753e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b675f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/4015905620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4015905620 >> 172.21.15.17:0/4015905620 conn(0x5622b6701310 msgr2=0x5622b6743970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.131+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4015905620 shutdown_connections 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 -- 172.21.15.17:0/4015905620 wait complete. 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 -- start start 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 Processor -- start 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41ac660 con 0x5622b6739d20 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41abf60 con 0x5622b6747960 2024-09-10T11:46:44.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.132+0000 7f75ab1dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75a41a91a0 con 0x5622b67452a0 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f75ab1dc740 10 client.0 _ll_register_callbacks cb 0x7f758c009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f75a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:48024/0 (socket says 172.21.15.17:48024) 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f75a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51872/0 (socket says 172.21.15.17:51872) 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 -- 172.21.15.17:0/1798905844 learned_addr learned my addr 172.21.15.17:0/1798905844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 -- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 msgr2=0x5622b674fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 -- 172.21.15.17:0/1798905844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 msgr2=0x5622b67421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:44.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 -- 172.21.15.17:0/1798905844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b6750570 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f75a259c640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f759bfff640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f758c01fcf0 tx=0x7f758c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af108d9a136877e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.133+0000 7f7589ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c033040 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f758c01f7e0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75940317b0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f758c01f9e0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f75ab1dc740 10 client.25376 fetch_fsmap learned FSMap version 34 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622b67c27b0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75940317b0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7f758c004bf0 con 0x5622b6747960 2024-09-10T11:46:44.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.134+0000 7f75ab1dc740 10 client.25376 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75ab1dc740 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75ab1dc740 20 client.25376 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b67c2f30 0x5622b67c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75ab1dc740 4 client.25376 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622b66a5d70 con 0x5622b67c2f30 2024-09-10T11:46:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75a259c640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b67c2f30 0x5622b67c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f75a259c640 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b67c2f30 0x5622b67c5350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2e741eaad9765b2 server_cookie=bb7700f415e631a9 in_seq=0 out_seq=0 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.135+0000 7f7589ffb640 10 client.25376 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f7589ffb640 1 -- 172.21.15.17:0/1798905844 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622b66a5d70 con 0x5622b67c2f30 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f7589ffb640 10 client.25376 handle_command_reply: tid=0 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 client.25376 shutdown 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 msgr2=0x5622b674ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f758c01fcf0 tx=0x7f758c000bc0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 shutdown_connections 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5622b67c2f30 0x5622b67c5350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5622b67452a0 0x5622b674fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f7589ffb640 0 client.25376 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5622b6747960 0x5622b674ff80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 --2- 172.21.15.17:0/1798905844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622b6739d20 0x5622b67421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 >> 172.21.15.17:0/1798905844 conn(0x5622b6701310 msgr2=0x5622b6733780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 shutdown_connections 2024-09-10T11:46:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 1 -- 172.21.15.17:0/1798905844 wait complete. 2024-09-10T11:46:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.136+0000 7f75ab1dc740 20 client.25376 trim_cache size 0 max 16384 2024-09-10T11:46:44.143 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 msgr2=0x7f75900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 0x7f75900a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c760 tx=0x7f759c013b60 comp rx=0 tx=0).stop 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 msgr2=0x7f75a419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 0x7f75a419cb70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f759c009fd0 tx=0x7f759c00ef10 comp rx=0 tx=0).stop 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 shutdown_connections 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f75900a2b80 0x7f75900a5040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75a41034b0 0x7f75a41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a410bfc0 0x7f75a419cb70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 --2- 172.21.15.17:0/3115717934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a4102b90 0x7f75a41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 >> 172.21.15.17:0/3115717934 conn(0x7f75a40fc610 msgr2=0x7f75a40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.137+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 shutdown_connections 2024-09-10T11:46:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:44.138+0000 7f75a359e640 1 -- 172.21.15.17:0/3115717934 wait complete. 2024-09-10T11:46:45.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:44 smithi026 ceph-mon[34817]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 5.31k op/s 2024-09-10T11:46:45.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:44 smithi017 ceph-mon[30817]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 5.31k op/s 2024-09-10T11:46:45.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:44 smithi081 ceph-mon[35059]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 5.31k op/s 2024-09-10T11:46:45.956 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:46:45.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:46:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 -- 172.21.15.17:0/3043697466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc106f20 msgr2=0x7f29dc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 --2- 172.21.15.17:0/3043697466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc106f20 0x7f29dc10eaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009ca0 tx=0x7f29d402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 -- 172.21.15.17:0/3043697466 shutdown_connections 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 --2- 172.21.15.17:0/3043697466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc106f20 0x7f29dc10eaa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 --2- 172.21.15.17:0/3043697466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc1027a0 0x7f29dc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 --2- 172.21.15.17:0/3043697466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc101df0 0x7f29dc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 -- 172.21.15.17:0/3043697466 >> 172.21.15.17:0/3043697466 conn(0x7f29dc0fd8f0 msgr2=0x7f29dc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 -- 172.21.15.17:0/3043697466 shutdown_connections 2024-09-10T11:46:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.776+0000 7f29e1810640 1 -- 172.21.15.17:0/3043697466 wait complete. 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.777+0000 7f29e1810640 1 Processor -- start 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.777+0000 7f29e1810640 1 -- start start 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc106f20 0x7f29dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc111f80 con 0x7f29dc1027a0 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc111e00 con 0x7f29dc101df0 2024-09-10T11:46:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29e1810640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc112100 con 0x7f29dc106f20 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:48044/0 (socket says 172.21.15.17:48044) 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58468/0 (socket says 172.21.15.17:58468) 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 -- 172.21.15.17:0/2468484452 learned_addr learned my addr 172.21.15.17:0/2468484452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29db7fe640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc106f20 0x7f29dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 -- 172.21.15.17:0/2468484452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc106f20 msgr2=0x7f29dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc106f20 0x7f29dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 -- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 msgr2=0x7f29dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29daffd640 1 -- 172.21.15.17:0/2468484452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1a68c0 con 0x7f29dc101df0 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.778+0000 7f29da7fc640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29daffd640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00e9f0 tx=0x7f29cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29e080e640 1 -- 172.21.15.17:0/2468484452 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00cd80 con 0x7f29dc101df0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc1a6bb0 con 0x7f29dc101df0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29e080e640 1 -- 172.21.15.17:0/2468484452 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc010910 con 0x7f29dc101df0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29e080e640 1 -- 172.21.15.17:0/2468484452 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc018990 con 0x7f29dc101df0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.779+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc1a70f0 con 0x7f29dc101df0 2024-09-10T11:46:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.781+0000 7f29e080e640 1 -- 172.21.15.17:0/2468484452 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f29cc010ac0 con 0x7f29dc101df0 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 Processor -- start 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 -- start start 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 0x55b905029f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905037130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b904f8f280 con 0x55b905034d40 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b904f36b10 con 0x55b905029b60 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e3be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b904f8b240 con 0x55b90502a480 2024-09-10T11:46:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29e080e640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 0x7f29c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51892/0 (socket says 172.21.15.17:51892) 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29daffd640 1 -- 172.21.15.17:0/4064380343 learned_addr learned my addr 172.21.15.17:0/4064380343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.782+0000 7f29da7fc640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905037130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29db7fe640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 0x7f29c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29e080e640 1 -- 172.21.15.17:0/2468484452 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f29cc0cf320 con 0x7f29dc101df0 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29db7fe640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 0x55b905029f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 -- 172.21.15.17:0/4064380343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 msgr2=0x55b905029f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 0x55b905029f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 -- 172.21.15.17:0/4064380343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 msgr2=0x55b905037130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905037130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 -- 172.21.15.17:0/4064380343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b904f431f0 con 0x55b90502a480 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29db7fe640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 0x55b905029f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29da7fc640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905037130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29db7fe640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 0x7f29c40a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29d4004af0 tx=0x7f29d403e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.783+0000 7f29daffd640 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0a42d0 tx=0x7f29cc09b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccde00a8d287152 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.784+0000 7f29c1ffb640 1 -- 172.21.15.17:0/4064380343 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc09ff40 con 0x55b90502a480 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.784+0000 7f29c1ffb640 1 -- 172.21.15.17:0/4064380343 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0a4800 con 0x55b90502a480 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.784+0000 7f29c1ffb640 1 -- 172.21.15.17:0/4064380343 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0982b0 con 0x55b90502a480 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- 172.21.15.17:0/4064380343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 msgr2=0x55b905034800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0a42d0 tx=0x7f29cc09b660 comp rx=0 tx=0).stop 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- 172.21.15.17:0/4064380343 shutdown_connections 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905034800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905037130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 --2- 172.21.15.17:0/4064380343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905029b60 0x55b905029f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- 172.21.15.17:0/4064380343 >> 172.21.15.17:0/4064380343 conn(0x55b9050260f0 msgr2=0x55b9050264d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- 172.21.15.17:0/4064380343 shutdown_connections 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- 172.21.15.17:0/4064380343 wait complete. 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.785+0000 7f29e3be9740 1 -- start start 2024-09-10T11:46:46.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 Processor -- start 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b90502a480 0x55b905032110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b905032650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b905037960 con 0x55b90502a480 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b904f49f10 con 0x55b905034d40 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b905037ae0 con 0x55b905029b60 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51902/0 (socket says 172.21.15.17:51902) 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 -- 172.21.15.17:0/3234087852 learned_addr learned my addr 172.21.15.17:0/3234087852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29da7fc640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b90502a480 0x55b905032110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29e3be9740 10 client.0 _ll_register_callbacks cb 0x55b904f12a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29db7fe640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b905032650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 -- 172.21.15.17:0/3234087852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 msgr2=0x55b905032650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b905032650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 -- 172.21.15.17:0/3234087852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b90502a480 msgr2=0x55b905032110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.786+0000 7f29daffd640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b90502a480 0x55b905032110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29daffd640 1 -- 172.21.15.17:0/3234087852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b904d006a0 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29daffd640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29cc09b710 tx=0x7f29cc09bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b01f2322d833ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc09bfe0 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc0a4800 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f29cc09c340 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f29cc0b9050 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29e3be9740 10 client.25363 fetch_fsmap learned FSMap version 35 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b905037960 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0a4800 con 0x55b905029b60 2024-09-10T11:46:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.787+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8370+0+0 (secure 0 0 0) 0x7f29cc0ce030 con 0x55b905029b60 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 10 client.25363 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 10 client.25363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 20 client.25363 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050445f0 0x55b9050469e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 4 client.25363 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b904f9c7f0 con 0x55b9050445f0 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29da7fc640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050445f0 0x55b9050469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29baffd640 10 client.25363 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.788+0000 7f29da7fc640 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050445f0 0x55b9050469e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eecebcc6d269275 server_cookie=8bd08aa4a13c9c02 in_seq=0 out_seq=0 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.789+0000 7f29baffd640 1 -- 172.21.15.17:0/3234087852 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b904f9c7f0 con 0x55b9050445f0 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.789+0000 7f29baffd640 10 client.25363 handle_command_reply: tid=0 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.789+0000 7f29e3be9740 1 client.25363 shutdown 2024-09-10T11:46:46.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.789+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 msgr2=0x55b905031bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.789+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29cc09b710 tx=0x7f29cc09bdb0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 shutdown_connections 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050445f0 0x55b9050469e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b905032650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b90502a480 0x55b905032110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 --2- 172.21.15.17:0/3234087852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905031bd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 >> 172.21.15.17:0/3234087852 conn(0x55b9050260f0 msgr2=0x55b905025270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29baffd640 0 client.25363 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 shutdown_connections 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 1 -- 172.21.15.17:0/3234087852 wait complete. 2024-09-10T11:46:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.790+0000 7f29e3be9740 20 client.25363 trim_cache size 0 max 16384 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.809+0000 7f29e3be9740 1 Processor -- start 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.809+0000 7f29e3be9740 1 -- start start 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905033a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b90504c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1af750 con 0x55b905029b60 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b12f0 con 0x55b905034d40 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29e3be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1afe20 con 0x55b90502a480 2024-09-10T11:46:46.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905033a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58504/0 (socket says 172.21.15.17:58504) 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905033a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51916/0 (socket says 172.21.15.17:51916) 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 -- 172.21.15.17:0/2851466972 learned_addr learned my addr 172.21.15.17:0/2851466972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29db7fe640 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b90504c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 -- 172.21.15.17:0/2851466972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 msgr2=0x55b905033a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905033a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 -- 172.21.15.17:0/2851466972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 msgr2=0x55b90504c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b90504c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 -- 172.21.15.17:0/2851466972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b905025f20 con 0x55b905029b60 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29db7fe640 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b90504c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.810+0000 7f29daffd640 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f29cc098610 tx=0x7f29cc09b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d2ca8e8a97e0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29c17fa640 1 -- 172.21.15.17:0/2851466972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc09bfe0 con 0x55b905029b60 2024-09-10T11:46:46.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29c17fa640 1 -- 172.21.15.17:0/2851466972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0ba450 con 0x55b905029b60 2024-09-10T11:46:46.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29c17fa640 1 -- 172.21.15.17:0/2851466972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc09c540 con 0x55b905029b60 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 -- 172.21.15.17:0/2851466972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 msgr2=0x55b90502c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f29cc098610 tx=0x7f29cc09b660 comp rx=0 tx=0).stop 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 -- 172.21.15.17:0/2851466972 shutdown_connections 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b90502a480 0x55b905033a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b905034d40 0x55b90504c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 --2- 172.21.15.17:0/2851466972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905029b60 0x55b90502c5c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.811+0000 7f29e3be9740 1 -- 172.21.15.17:0/2851466972 >> 172.21.15.17:0/2851466972 conn(0x55b9050260f0 msgr2=0x55b905033320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.812+0000 7f29e3be9740 1 -- 172.21.15.17:0/2851466972 shutdown_connections 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.812+0000 7f29e3be9740 1 -- 172.21.15.17:0/2851466972 wait complete. 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.812+0000 7f29e3be9740 1 -- start start 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.812+0000 7f29e3be9740 1 Processor -- start 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b90502a480 0x55b905039010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905039550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b0bf0 con 0x55b905034d40 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b04f0 con 0x55b90502a480 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1ad730 con 0x55b905029b60 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29e3be9740 10 client.0 _ll_register_callbacks cb 0x7f29cc009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905039550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b90502a480 0x55b905039010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51920/0 (socket says 172.21.15.17:51920) 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905039550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58514/0 (socket says 172.21.15.17:58514) 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 -- 172.21.15.17:0/180677478 learned_addr learned my addr 172.21.15.17:0/180677478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 -- 172.21.15.17:0/180677478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b90502a480 msgr2=0x55b905039010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b90502a480 0x55b905039010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 -- 172.21.15.17:0/180677478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 msgr2=0x55b905039550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905039550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 -- 172.21.15.17:0/180677478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9050ae150 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29daffd640 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c6a0 tx=0x7f29cc09cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe10e16f9441511f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.813+0000 7f29baffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0a4800 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f29cc018d40 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc0ba450 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f29cc010430 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 10 client.25369 fetch_fsmap learned FSMap version 35 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b9050ae150 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0ba450 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8370+0+0 (secure 0 0 0) 0x7f29cc0ce030 con 0x55b905029b60 2024-09-10T11:46:46.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 10 client.25369 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 10 client.25369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 20 client.25369 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.814+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050af650 0x55b9050b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.815+0000 7f29e3be9740 4 client.25369 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.815+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b904f96d00 con 0x55b9050af650 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.815+0000 7f29da7fc640 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050af650 0x55b9050b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.815+0000 7f29baffd640 10 client.25369 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.815+0000 7f29da7fc640 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050af650 0x55b9050b1a40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1bacb4e7635c8a server_cookie=68ab7156fc8ffbc2 in_seq=0 out_seq=0 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29baffd640 1 -- 172.21.15.17:0/180677478 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b904f96d00 con 0x55b9050af650 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29baffd640 10 client.25369 handle_command_reply: tid=0 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 client.25369 shutdown 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 msgr2=0x55b905038ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c6a0 tx=0x7f29cc09cdc0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 shutdown_connections 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55b9050af650 0x55b9050b1a40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b905034d40 0x55b905039550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b90502a480 0x55b905039010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 --2- 172.21.15.17:0/180677478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b905029b60 0x55b905038ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 >> 172.21.15.17:0/180677478 conn(0x55b9050260f0 msgr2=0x55b905025270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.816+0000 7f29baffd640 0 client.25369 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 shutdown_connections 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e3be9740 1 -- 172.21.15.17:0/180677478 wait complete. 2024-09-10T11:46:46.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e3be9740 20 client.25369 trim_cache size 0 max 16384 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "bacee183-0c31-43a8-944e-d5dc4425831b", 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 msgr2=0x7f29c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 0x7f29c40a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29d4004af0 tx=0x7f29d403e040 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 msgr2=0x7f29dc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00e9f0 tx=0x7f29cc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 shutdown_connections 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f29c40a2b80 0x7f29c40a5040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc106f20 0x7f29dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc1027a0 0x7f29dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 --2- 172.21.15.17:0/2468484452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc101df0 0x7f29dc0744f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.817+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 >> 172.21.15.17:0/2468484452 conn(0x7f29dc0fd8f0 msgr2=0x7f29dc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.818+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 shutdown_connections 2024-09-10T11:46:46.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:46.818+0000 7f29e1810640 1 -- 172.21.15.17:0/2468484452 wait complete. 2024-09-10T11:46:47.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:46 smithi026 ceph-mon[34817]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 5.89k op/s 2024-09-10T11:46:47.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:46 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:47.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:46 smithi017 ceph-mon[30817]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 5.89k op/s 2024-09-10T11:46:47.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:46 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:46 smithi081 ceph-mon[35059]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 5.89k op/s 2024-09-10T11:46:47.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:46 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:47.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:46:48.172 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:46:48.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:46:48.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:46:48.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:46:48.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:47 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:46:48.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:47 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:47 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:46:48.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1408778056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0100a70 msgr2=0x7f9fd0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1408778056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0100a70 0x7f9fd0100ed0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009930 tx=0x7f9fc002a420 comp rx=0 tx=0).stop 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1408778056 shutdown_connections 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1408778056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0101410 0x7f9fd010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1408778056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0100a70 0x7f9fd0100ed0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1408778056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0106a70 0x7f9fd0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1408778056 >> 172.21.15.17:0/1408778056 conn(0x7f9fd00fc790 msgr2=0x7f9fd00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1408778056 shutdown_connections 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.715+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1408778056 wait complete. 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 Processor -- start 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 -- start start 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 0x7f9fd00fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0106a70 0x7f9fd00fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110e30 con 0x7f9fd0106a70 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110cb0 con 0x7f9fd0101410 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd7ded640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110fb0 con 0x7f9fd0100a70 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0106a70 0x7f9fd00fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd5388640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 0x7f9fd00fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51938/0 (socket says 172.21.15.17:51938) 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.716+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1322711003 learned_addr learned my addr 172.21.15.17:0/1322711003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 -- 172.21.15.17:0/1322711003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 msgr2=0x7f9fd00fce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 -- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0106a70 msgr2=0x7f9fd00fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0106a70 0x7f9fd00fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 -- 172.21.15.17:0/1322711003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01a68f0 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 0x7f9fd00fd3a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005940 tx=0x7f9fc0031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fc6ffd640 1 -- 172.21.15.17:0/1322711003 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc003f070 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01a6b80 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.717+0000 7f9fc6ffd640 1 -- 172.21.15.17:0/1322711003 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc0003ad0 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.718+0000 7f9fc6ffd640 1 -- 172.21.15.17:0/1322711003 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0035070 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.718+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a7060 con 0x7f9fd0101410 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.720+0000 7f9fda1c6740 1 Processor -- start 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 -- start start 2024-09-10T11:46:48.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fc6ffd640 1 -- 172.21.15.17:0/1322711003 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9fc00035f0 con 0x7f9fd0101410 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 0x55ed39e91140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e91680 0x55ed39e93a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ed39dec2e0 con 0x55ed39e864a0 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ed39d93ce0 con 0x55ed39e91680 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ed39de82a0 con 0x55ed39e86dc0 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58534/0 (socket says 172.21.15.17:58534) 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 0x55ed39e91140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 -- 172.21.15.17:0/269634120 learned_addr learned my addr 172.21.15.17:0/269634120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd5388640 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e91680 0x55ed39e93a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 -- 172.21.15.17:0/269634120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 msgr2=0x55ed39e91140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 0x55ed39e91140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 -- 172.21.15.17:0/269634120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e91680 msgr2=0x55ed39e93a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e91680 0x55ed39e93a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd638a640 1 -- 172.21.15.17:0/269634120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed39d78440 con 0x55ed39e864a0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.721+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 0x55ed39e91140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fc6ffd640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fd638a640 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009fd0 tx=0x7f9fc80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd11968f272d81c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fbbfff640 1 -- 172.21.15.17:0/269634120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8004d20 con 0x55ed39e864a0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fc6ffd640 1 -- 172.21.15.17:0/1322711003 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9fc00ef3e0 con 0x7f9fd0101410 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fbbfff640 1 -- 172.21.15.17:0/269634120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8004050 con 0x55ed39e864a0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.722+0000 7f9fbbfff640 1 -- 172.21.15.17:0/269634120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8005260 con 0x55ed39e864a0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- 172.21.15.17:0/269634120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 msgr2=0x55ed39e86880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55ed39e83890 tx=0x7f9fcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009fd0 tx=0x7f9fc80118d0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- 172.21.15.17:0/269634120 shutdown_connections 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e86dc0 0x55ed39e91140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e91680 0x55ed39e93a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/269634120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e864a0 0x55ed39e86880 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- 172.21.15.17:0/269634120 >> 172.21.15.17:0/269634120 conn(0x55ed39e82a30 msgr2=0x55ed39e82e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- 172.21.15.17:0/269634120 shutdown_connections 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- 172.21.15.17:0/269634120 wait complete. 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 -- start start 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.723+0000 7f9fda1c6740 1 Processor -- start 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 0x55ed39e8e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e91680 0x55ed39e8e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ed39e94250 con 0x55ed39e91680 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55ed39da7050 con 0x55ed39e86dc0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ed39e943d0 con 0x55ed39e864a0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fda1c6740 10 client.0 _ll_register_callbacks cb 0x55ed39de7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51956/0 (socket says 172.21.15.17:51956) 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5388640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 0x55ed39e8e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1253577099 learned_addr learned my addr 172.21.15.17:0/1253577099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e91680 0x55ed39e8e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1253577099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 msgr2=0x55ed39e8e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 0x55ed39e8e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1253577099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e91680 msgr2=0x55ed39e8e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e91680 0x55ed39e8e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1253577099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed39b5d3c0 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.724+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 0x55ed39e8e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009db0 tx=0x7f9fcc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b5dec4eb918deb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc02e060 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9fcc018030 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc8004050 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9fcc012e30 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fda1c6740 10 client.25381 fetch_fsmap learned FSMap version 35 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.725+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ed39e9fbd0 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8004050 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8370+0+0 (secure 0 0 0) 0x7f9fcc029b50 con 0x55ed39e864a0 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 10 client.25381 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T11:46:48.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 10 client.25381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 20 client.25381 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39ea1090 0x55ed39ea34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 4 client.25381 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:46:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed39df9850 con 0x55ed39ea1090 2024-09-10T11:46:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.726+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39ea1090 0x55ed39ea34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.727+0000 7f9fb97fa640 10 client.25381 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.727+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39ea1090 0x55ed39ea34c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c3c6e7e360a07a server_cookie=f8c7e5463421387 in_seq=0 out_seq=0 2024-09-10T11:46:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1253577099 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed39df9850 con 0x55ed39ea1090 2024-09-10T11:46:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fb97fa640 10 client.25381 handle_command_reply: tid=0 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 client.25381 shutdown 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 msgr2=0x55ed39e90ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009db0 tx=0x7f9fcc004730 comp rx=0 tx=0).stop 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 shutdown_connections 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39ea1090 0x55ed39ea34c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e91680 0x55ed39e8e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fb97fa640 0 client.25381 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e86dc0 0x55ed39e8e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1253577099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e90ee0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 >> 172.21.15.17:0/1253577099 conn(0x55ed39e82a30 msgr2=0x55ed39e81b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 shutdown_connections 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1253577099 wait complete. 2024-09-10T11:46:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.728+0000 7f9fda1c6740 20 client.25381 trim_cache size 0 max 16384 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 Processor -- start 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 -- start start 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e82a30 0x55ed39e89760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 0x55ed39ea8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01af750 con 0x55ed39e86dc0 2024-09-10T11:46:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b12f0 con 0x55ed39e864a0 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01afe20 con 0x55ed39e82a30 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e82a30 0x55ed39e89760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fd5388640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 0x55ed39ea8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58544/0 (socket says 172.21.15.17:58544) 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.748+0000 7f9fd638a640 1 -- 172.21.15.17:0/2593592368 learned_addr learned my addr 172.21.15.17:0/2593592368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 -- 172.21.15.17:0/2593592368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e82a30 msgr2=0x55ed39e89760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e82a30 0x55ed39e89760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 -- 172.21.15.17:0/2593592368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 msgr2=0x55ed39ea92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 -- 172.21.15.17:0/2593592368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed39e824d0 con 0x55ed39e864a0 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd638a640 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:46:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fd5388640 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 0x55ed39ea8d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ecf40 tx=0x7f9fc00f4040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2045499548af2878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fbb7fe640 1 -- 172.21.15.17:0/2593592368 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0048040 con 0x55ed39e864a0 2024-09-10T11:46:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fbb7fe640 1 -- 172.21.15.17:0/2593592368 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc00bbd00 con 0x55ed39e864a0 2024-09-10T11:46:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.749+0000 7f9fbb7fe640 1 -- 172.21.15.17:0/2593592368 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00038e0 con 0x55ed39e864a0 2024-09-10T11:46:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 -- 172.21.15.17:0/2593592368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 msgr2=0x55ed39ea8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 0x55ed39ea8d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ecf40 tx=0x7f9fc00f4040 comp rx=0 tx=0).stop 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 -- 172.21.15.17:0/2593592368 shutdown_connections 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39ea92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e864a0 0x55ed39ea8d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/2593592368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e82a30 0x55ed39e89760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.750+0000 7f9fda1c6740 1 -- 172.21.15.17:0/2593592368 >> 172.21.15.17:0/2593592368 conn(0x55ed39e8e830 msgr2=0x55ed39e89050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.751+0000 7f9fda1c6740 1 -- 172.21.15.17:0/2593592368 shutdown_connections 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.751+0000 7f9fda1c6740 1 -- 172.21.15.17:0/2593592368 wait complete. 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.751+0000 7f9fda1c6740 1 -- start start 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.751+0000 7f9fda1c6740 1 Processor -- start 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e8ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39e8b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b0bf0 con 0x55ed39e86dc0 2024-09-10T11:46:48.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b04f0 con 0x55ed39e82a30 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ad730 con 0x55ed39e864a0 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd638a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39e8b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5388640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e8ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:48112/0 (socket says 172.21.15.17:48112) 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5388640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e8ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51960/0 (socket says 172.21.15.17:51960) 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1140613079 learned_addr learned my addr 172.21.15.17:0/1140613079 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fda1c6740 10 client.0 _ll_register_callbacks cb 0x7f9fcc00fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 msgr2=0x55ed39e8ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e8ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1140613079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 msgr2=0x55ed39e8b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:46:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39e8b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.752+0000 7f9fd5b89640 1 -- 172.21.15.17:0/1140613079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed39e8b750 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fd5b89640 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009620 tx=0x7f9fcc029a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7134dddcc6fe527 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc041060 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9fcc01e7f0 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc00bbd00 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9fcc038050 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fda1c6740 10 client.25409 fetch_fsmap learned FSMap version 35 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ed39f0ba80 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.753+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc00bbd00 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 35) ==== 8370+0+0 (secure 0 0 0) 0x7f9fcc01cb80 con 0x55ed39e82a30 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 10 client.25409 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T11:46:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 20 client.25409 populate_metadata read hostname 'smithi017' 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39e91680 0x55ed39f0e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 4 client.25409 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ed39df3d60 con 0x55ed39e91680 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39e91680 0x55ed39f0e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fd5388640 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39e91680 0x55ed39f0e2a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816b94bb7636ff59 server_cookie=8d7ae0a4467b3812 in_seq=0 out_seq=0 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.754+0000 7f9fb97fa640 10 client.25409 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fb97fa640 1 -- 172.21.15.17:0/1140613079 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ed39df3d60 con 0x55ed39e91680 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fb97fa640 10 client.25409 handle_command_reply: tid=0 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 client.25409 shutdown 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 msgr2=0x55ed39e99b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009620 tx=0x7f9fcc029a50 comp rx=0 tx=0).stop 2024-09-10T11:46:48.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 shutdown_connections 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55ed39e91680 0x55ed39f0e2a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fb97fa640 0 client.25409 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39e864a0 0x55ed39e8ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed39e86dc0 0x55ed39e8b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 --2- 172.21.15.17:0/1140613079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ed39e82a30 0x55ed39e99b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 >> 172.21.15.17:0/1140613079 conn(0x55ed39e8e830 msgr2=0x55ed39e89870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 shutdown_connections 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 1 -- 172.21.15.17:0/1140613079 wait complete. 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:46:48.762 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "bacee183-0c31-43a8-944e-d5dc4425831b": { 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "bacee183-0c31-43a8-944e-d5dc4425831b", 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:46:48.763 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.755+0000 7f9fda1c6740 20 client.25409 trim_cache size 0 max 16384 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 msgr2=0x7f9fbc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55ed39e83890 tx=0x7f9fcc005f90 comp rx=0 tx=0).stop 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 msgr2=0x7f9fd00fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 0x7f9fd00fd3a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005940 tx=0x7f9fc0031b50 comp rx=0 tx=0).stop 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 shutdown_connections 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9fbc0a2b80 0x7f9fbc0a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd0106a70 0x7f9fd00fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd0101410 0x7f9fd00fd3a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 --2- 172.21.15.17:0/1322711003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd0100a70 0x7f9fd00fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:46:48.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 >> 172.21.15.17:0/1322711003 conn(0x7f9fd00fc790 msgr2=0x7f9fd006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:46:48.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 shutdown_connections 2024-09-10T11:46:48.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:46:48.756+0000 7f9fd7ded640 1 -- 172.21.15.17:0/1322711003 wait complete. 2024-09-10T11:46:49.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:48 smithi026 ceph-mon[34817]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 5.99k op/s 2024-09-10T11:46:49.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:48 smithi017 ceph-mon[30817]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 5.99k op/s 2024-09-10T11:46:49.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:48 smithi081 ceph-mon[35059]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 5.99k op/s 2024-09-10T11:46:49.581 INFO:tasks.cephfs.filesystem:scrub status for tag:bacee183-0c31-43a8-944e-d5dc4425831b - {'path': '/', 'tag': 'bacee183-0c31-43a8-944e-d5dc4425831b', 'options': 'recursive,force'} 2024-09-10T11:46:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:50 smithi026 ceph-mon[34817]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 6.73k op/s 2024-09-10T11:46:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:46:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:46:51.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:46:51.255 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:50 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:46:51.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:50 smithi017 ceph-mon[30817]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 6.73k op/s 2024-09-10T11:46:51.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:46:51.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:46:51.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:46:51.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:50 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:46:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:50 smithi081 ceph-mon[35059]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 6.73k op/s 2024-09-10T11:46:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:46:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:46:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:46:51.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:50 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:46:52.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:51 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:52.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:51 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:52.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:51 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:46:53.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:53 smithi026 ceph-mon[34817]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 4.63k op/s 2024-09-10T11:46:53.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:52 smithi017 ceph-mon[30817]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 4.63k op/s 2024-09-10T11:46:53.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:53 smithi081 ceph-mon[35059]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 4.63k op/s 2024-09-10T11:46:55.254 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:55 smithi026 ceph-mon[34817]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 5.21k op/s 2024-09-10T11:46:55.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:55 smithi017 ceph-mon[30817]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 5.21k op/s 2024-09-10T11:46:55.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:55 smithi081 ceph-mon[35059]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 5.21k op/s 2024-09-10T11:46:56.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:56 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:56.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:56 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:56.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:56 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:56.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:56 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:56.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:56 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:46:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:56 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:56 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:56 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:56 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:56.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:56 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:46:56.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:56 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:56.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:56 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:56.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:56 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:56.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:56 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:56.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:56 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:46:57.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:57 smithi017 ceph-mon[30817]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 27 MiB/s wr, 4.96k op/s 2024-09-10T11:46:57.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:57 smithi081 ceph-mon[35059]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 27 MiB/s wr, 4.96k op/s 2024-09-10T11:46:57.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:57 smithi026 ceph-mon[34817]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 27 MiB/s wr, 4.96k op/s 2024-09-10T11:46:59.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:46:59 smithi081 ceph-mon[35059]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 3.55k op/s 2024-09-10T11:46:59.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:46:59 smithi026 ceph-mon[34817]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 3.55k op/s 2024-09-10T11:46:59.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:46:59 smithi017 ceph-mon[30817]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 3.55k op/s 2024-09-10T11:47:01.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:01 smithi081 ceph-mon[35059]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.20k op/s 2024-09-10T11:47:01.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:01 smithi026 ceph-mon[34817]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.20k op/s 2024-09-10T11:47:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:01 smithi017 ceph-mon[30817]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.20k op/s 2024-09-10T11:47:03.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:03 smithi081 ceph-mon[35059]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-10T11:47:03.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:03 smithi026 ceph-mon[34817]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-10T11:47:03.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:03 smithi017 ceph-mon[30817]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.0 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-10T11:47:05.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:05 smithi081 ceph-mon[35059]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 23 KiB/s rd, 34 MiB/s wr, 6.39k op/s 2024-09-10T11:47:05.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:05 smithi026 ceph-mon[34817]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 23 KiB/s rd, 34 MiB/s wr, 6.39k op/s 2024-09-10T11:47:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:05 smithi017 ceph-mon[30817]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 23 KiB/s rd, 34 MiB/s wr, 6.39k op/s 2024-09-10T11:47:07.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:07 smithi081 ceph-mon[35059]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 43 MiB/s wr, 7.99k op/s 2024-09-10T11:47:07.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:07 smithi026 ceph-mon[34817]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 43 MiB/s wr, 7.99k op/s 2024-09-10T11:47:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:07 smithi017 ceph-mon[30817]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 43 MiB/s wr, 7.99k op/s 2024-09-10T11:47:09.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:09 smithi081 ceph-mon[35059]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 7.19k op/s 2024-09-10T11:47:09.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:09 smithi026 ceph-mon[34817]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 7.19k op/s 2024-09-10T11:47:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:09 smithi017 ceph-mon[30817]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 7.19k op/s 2024-09-10T11:47:11.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:11 smithi081 ceph-mon[35059]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 63 KiB/s rd, 85 MiB/s wr, 14.56k op/s 2024-09-10T11:47:11.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:11 smithi026 ceph-mon[34817]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 63 KiB/s rd, 85 MiB/s wr, 14.56k op/s 2024-09-10T11:47:11.540 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:11 smithi017 ceph-mon[30817]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 63 KiB/s rd, 85 MiB/s wr, 14.56k op/s 2024-09-10T11:47:13.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:13 smithi081 ceph-mon[35059]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 12.55k op/s 2024-09-10T11:47:13.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:13 smithi026 ceph-mon[34817]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 12.55k op/s 2024-09-10T11:47:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:13 smithi017 ceph-mon[30817]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 12.55k op/s 2024-09-10T11:47:15.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:15 smithi081 ceph-mon[35059]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 74 MiB/s wr, 12.25k op/s 2024-09-10T11:47:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:15 smithi026 ceph-mon[34817]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 74 MiB/s wr, 12.25k op/s 2024-09-10T11:47:15.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:15 smithi017 ceph-mon[30817]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 59 KiB/s rd, 74 MiB/s wr, 12.25k op/s 2024-09-10T11:47:17.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:17 smithi081 ceph-mon[35059]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 66 KiB/s rd, 117 MiB/s wr, 19.27k op/s 2024-09-10T11:47:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:17 smithi026 ceph-mon[34817]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 66 KiB/s rd, 117 MiB/s wr, 19.27k op/s 2024-09-10T11:47:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:17 smithi017 ceph-mon[30817]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 66 KiB/s rd, 117 MiB/s wr, 19.27k op/s 2024-09-10T11:47:19.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:19 smithi081 ceph-mon[35059]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 106 MiB/s wr, 17.37k op/s 2024-09-10T11:47:19.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:19 smithi026 ceph-mon[34817]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 106 MiB/s wr, 17.37k op/s 2024-09-10T11:47:19.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:19 smithi017 ceph-mon[30817]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 53 KiB/s rd, 106 MiB/s wr, 17.37k op/s 2024-09-10T11:47:19.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:47:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 -- 172.21.15.17:0/709664650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14106a90 msgr2=0x7f9d14106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/709664650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14106a90 0x7f9d14106e70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009930 tx=0x7f9d0402a420 comp rx=0 tx=0).stop 2024-09-10T11:47:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 -- 172.21.15.17:0/709664650 shutdown_connections 2024-09-10T11:47:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/709664650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14100a90 0x7f9d14100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/709664650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/709664650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14106a90 0x7f9d14106e70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 -- 172.21.15.17:0/709664650 >> 172.21.15.17:0/709664650 conn(0x7f9d140fc7d0 msgr2=0x7f9d140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 -- 172.21.15.17:0/709664650 shutdown_connections 2024-09-10T11:47:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.669+0000 7f9d19ec1640 1 -- 172.21.15.17:0/709664650 wait complete. 2024-09-10T11:47:20.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.670+0000 7f9d19ec1640 1 Processor -- start 2024-09-10T11:47:20.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.670+0000 7f9d19ec1640 1 -- start start 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 0x7f9d1419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 0x7f9d1419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14110ee0 con 0x7f9d14100a90 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14110d60 con 0x7f9d14101430 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d19ec1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14111060 con 0x7f9d14106a90 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 0x7f9d1419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 0x7f9d1419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39942/0 (socket says 172.21.15.17:39942) 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d137fe640 1 -- 172.21.15.17:0/3727277582 learned_addr learned my addr 172.21.15.17:0/3727277582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 0x7f9d1419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 -- 172.21.15.17:0/3727277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 msgr2=0x7f9d1419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 -- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 msgr2=0x7f9d1419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 0x7f9d1419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d13fff640 1 -- 172.21.15.17:0/3727277582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1419f600 con 0x7f9d14106a90 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.671+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d13fff640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 0x7f9d1419ef20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d10ff9640 1 -- 172.21.15.17:0/3727277582 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00ce20 con 0x7f9d14106a90 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d10ff9640 1 -- 172.21.15.17:0/3727277582 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c005020 con 0x7f9d14106a90 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1419f8f0 con 0x7f9d14106a90 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d10ff9640 1 -- 172.21.15.17:0/3727277582 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c010720 con 0x7f9d14106a90 2024-09-10T11:47:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.672+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d141a71d0 con 0x7f9d14106a90 2024-09-10T11:47:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.675+0000 7f9d10ff9640 1 -- 172.21.15.17:0/3727277582 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d0c005540 con 0x7f9d14106a90 2024-09-10T11:47:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.676+0000 7f9d1c29a740 1 Processor -- start 2024-09-10T11:47:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.676+0000 7f9d1c29a740 1 -- start start 2024-09-10T11:47:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.676+0000 7f9d10ff9640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 0x7f9cfc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.676+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0f6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.676+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed101140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed05c2e0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed003ce0 con 0x55f8ed101680 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed0582a0 con 0x55f8ed0f64a0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43774/0 (socket says 172.21.15.17:43774) 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 -- 172.21.15.17:0/4094851100 learned_addr learned my addr 172.21.15.17:0/4094851100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d137fe640 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 0x7f9cfc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d10ff9640 1 -- 172.21.15.17:0/3727277582 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9d0c0cf760 con 0x7f9d14106a90 2024-09-10T11:47:20.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 -- 172.21.15.17:0/4094851100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 msgr2=0x55f8ed0f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 -- 172.21.15.17:0/4094851100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 msgr2=0x55f8ed101140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed101140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 -- 172.21.15.17:0/4094851100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ecfe8440 con 0x55f8ed101680 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.677+0000 7f9d13fff640 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c09bf60 tx=0x7f9d0c005940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744519b178210151 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9cf9ffb640 1 -- 172.21.15.17:0/4094851100 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0bc0d0 con 0x55f8ed101680 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9cf9ffb640 1 -- 172.21.15.17:0/4094851100 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c09c6d0 con 0x55f8ed101680 2024-09-10T11:47:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9cf9ffb640 1 -- 172.21.15.17:0/4094851100 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c01cdb0 con 0x55f8ed101680 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9d1c29a740 1 -- 172.21.15.17:0/4094851100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 msgr2=0x55f8ed103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 0x7f9cfc0a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f8ed0f3890 tx=0x7f9d08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.678+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c09bf60 tx=0x7f9d0c005940 comp rx=0 tx=0).stop 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 -- 172.21.15.17:0/4094851100 shutdown_connections 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed101680 0x55f8ed103a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/4094851100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 -- 172.21.15.17:0/4094851100 >> 172.21.15.17:0/4094851100 conn(0x55f8ed0f2a30 msgr2=0x55f8ed0f2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 -- 172.21.15.17:0/4094851100 shutdown_connections 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 -- 172.21.15.17:0/4094851100 wait complete. 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 -- start start 2024-09-10T11:47:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.679+0000 7f9d1c29a740 1 Processor -- start 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f64a0 0x55f8ed100fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed101680 0x55f8ed0fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed104250 con 0x55f8ed0f64a0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed017050 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f8ed1043d0 con 0x55f8ed101680 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d1c29a740 10 client.0 _ll_register_callbacks cb 0x55f8ed057160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f64a0 0x55f8ed100fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43786/0 (socket says 172.21.15.17:43786) 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed101680 0x55f8ed0fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 -- 172.21.15.17:0/3626933150 learned_addr learned my addr 172.21.15.17:0/3626933150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 -- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed101680 msgr2=0x55f8ed0fe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed101680 0x55f8ed0fe7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 -- 172.21.15.17:0/3626933150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f64a0 msgr2=0x55f8ed100fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f64a0 0x55f8ed100fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.680+0000 7f9d12ffd640 1 -- 172.21.15.17:0/3626933150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ecdcd3c0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800dbd0 tx=0x7f9d08004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=318a7912adfc2cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9cf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0801e460 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0c09c6d0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9d0801e600 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9d0801e800 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9d1c29a740 10 client.25421 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.681+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f8ed10fc60 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c09c6d0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f9d08032070 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 10 client.25421 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 10 client.25421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 20 client.25421 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed111170 0x55f8ed1135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 4 client.25421 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8ed069850 con 0x55f8ed111170 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d137fe640 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed111170 0x55f8ed1135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9d137fe640 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed111170 0x55f8ed1135c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9f4d51c09e1029 server_cookie=8ebca52f4b116c30 in_seq=0 out_seq=0 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.682+0000 7f9cf2ffd640 10 client.25421 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.683+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/3626933150 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8ed069850 con 0x55f8ed111170 2024-09-10T11:47:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.683+0000 7f9cf2ffd640 10 client.25421 handle_command_reply: tid=0 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.683+0000 7f9d1c29a740 1 client.25421 shutdown 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.683+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 msgr2=0x55f8ed0fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.683+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800dbd0 tx=0x7f9d08004730 comp rx=0 tx=0).stop 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 shutdown_connections 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed111170 0x55f8ed1135c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed101680 0x55f8ed0fe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed0fe260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/3626933150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f64a0 0x55f8ed100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 >> 172.21.15.17:0/3626933150 conn(0x55f8ed0f2a30 msgr2=0x55f8ed0f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9cf2ffd640 0 client.25421 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 shutdown_connections 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 1 -- 172.21.15.17:0/3626933150 wait complete. 2024-09-10T11:47:20.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.684+0000 7f9d1c29a740 20 client.25421 trim_cache size 0 max 16384 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 Processor -- start 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 -- start start 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 0x55f8ed10d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed118e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141af7f0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.705+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141b1360 con 0x55f8ed0f2a30 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141afec0 con 0x55f8ed0f64a0 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58410/0 (socket says 172.21.15.17:58410) 2024-09-10T11:47:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d12ffd640 1 -- 172.21.15.17:0/779913425 learned_addr learned my addr 172.21.15.17:0/779913425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed118e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d137fe640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 0x55f8ed10d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 -- 172.21.15.17:0/779913425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 msgr2=0x55f8ed0fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 -- 172.21.15.17:0/779913425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 msgr2=0x55f8ed10d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 0x55f8ed10d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 -- 172.21.15.17:0/779913425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ed103dc0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d137fe640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 0x55f8ed10d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.706+0000 7f9d13fff640 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed118e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c09c880 tx=0x7f9d0c009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa5197c0fc52502 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.707+0000 7f9cf97fa640 1 -- 172.21.15.17:0/779913425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0a4c40 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.707+0000 7f9cf97fa640 1 -- 172.21.15.17:0/779913425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c09a070 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.707+0000 7f9cf97fa640 1 -- 172.21.15.17:0/779913425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c085170 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- 172.21.15.17:0/779913425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 msgr2=0x55f8ed118e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed118e90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c09c880 tx=0x7f9d0c009590 comp rx=0 tx=0).stop 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- 172.21.15.17:0/779913425 shutdown_connections 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f64a0 0x55f8ed0fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed118e90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/779913425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f2a30 0x55f8ed10d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- 172.21.15.17:0/779913425 >> 172.21.15.17:0/779913425 conn(0x55f8ed0fe900 msgr2=0x55f8ed0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- 172.21.15.17:0/779913425 shutdown_connections 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- 172.21.15.17:0/779913425 wait complete. 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.708+0000 7f9d1c29a740 1 -- start start 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 Processor -- start 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f2a30 0x55f8ed1098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed104d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141b0c90 con 0x55f8ed0f2a30 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141b0590 con 0x55f8ed0f64a0 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141ad7d0 con 0x55f8ed0f6dc0 2024-09-10T11:47:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d1c29a740 10 client.0 _ll_register_callbacks cb 0x7f9d08009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d12ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43796/0 (socket says 172.21.15.17:43796) 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d12ffd640 1 -- 172.21.15.17:0/1104968207 learned_addr learned my addr 172.21.15.17:0/1104968207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d137fe640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f2a30 0x55f8ed1098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.709+0000 7f9d13fff640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 -- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f6dc0 msgr2=0x55f8ed104d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed104d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 -- 172.21.15.17:0/1104968207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f2a30 msgr2=0x55f8ed1098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f2a30 0x55f8ed1098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 -- 172.21.15.17:0/1104968207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ed105570 con 0x55f8ed0f64a0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9d12ffd640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d08029e40 tx=0x7f9d0801f620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771d5535f1170609 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9cf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08038020 con 0x55f8ed0f64a0 2024-09-10T11:47:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.710+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9d0801edb0 con 0x55f8ed0f64a0 2024-09-10T11:47:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.711+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8ed063d60 con 0x55f8ed0f64a0 2024-09-10T11:47:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.711+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9d0800d760 con 0x55f8ed0f64a0 2024-09-10T11:47:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.711+0000 7f9d1c29a740 10 client.25427 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.711+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f8ed17ba40 con 0x55f8ed0f64a0 2024-09-10T11:47:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.711+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f8ed063d60 con 0x55f8ed0f64a0 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f9d08032070 con 0x55f8ed0f64a0 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 10 client.25427 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 20 client.25427 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed101680 0x55f8ed17e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 4 client.25427 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:47:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.712+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8ecfe0210 con 0x55f8ed101680 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9d137fe640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed101680 0x55f8ed17e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9d137fe640 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed101680 0x55f8ed17e230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7eb3564865785c server_cookie=8cb2017f423ac792 in_seq=0 out_seq=0 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9cf2ffd640 10 client.25427 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9cf2ffd640 1 -- 172.21.15.17:0/1104968207 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f8ecfe0210 con 0x55f8ed101680 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9cf2ffd640 10 client.25427 handle_command_reply: tid=0 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.713+0000 7f9d1c29a740 1 client.25427 shutdown 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 msgr2=0x55f8ed109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d08029e40 tx=0x7f9d0801f620 comp rx=0 tx=0).stop 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 shutdown_connections 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f8ed101680 0x55f8ed17e230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8ed0f6dc0 0x55f8ed104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9cf2ffd640 0 client.25427 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f8ed0f64a0 0x55f8ed109e30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 --2- 172.21.15.17:0/1104968207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f8ed0f2a30 0x55f8ed1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 >> 172.21.15.17:0/1104968207 conn(0x55f8ed0fe900 msgr2=0x55f8ed0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 shutdown_connections 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 1 -- 172.21.15.17:0/1104968207 wait complete. 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.715+0000 7f9d1c29a740 20 client.25427 trim_cache size 0 max 16384 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:47:20.719 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:47:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 msgr2=0x7f9cfc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 0x7f9cfc0a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55f8ed0f3890 tx=0x7f9d08005f90 comp rx=0 tx=0).stop 2024-09-10T11:47:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 msgr2=0x7f9d1419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 0x7f9d1419ef20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c00ef10 comp rx=0 tx=0).stop 2024-09-10T11:47:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 shutdown_connections 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f9cfc0a2b80 0x7f9cfc0a5040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d14106a90 0x7f9d1419ef20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d14101430 0x7f9d1419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 --2- 172.21.15.17:0/3727277582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d14100a90 0x7f9d1419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 >> 172.21.15.17:0/3727277582 conn(0x7f9d140fc7d0 msgr2=0x7f9d1406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 shutdown_connections 2024-09-10T11:47:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:20.716+0000 7f9d19ec1640 1 -- 172.21.15.17:0/3727277582 wait complete. 2024-09-10T11:47:21.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:21 smithi017 ceph-mon[30817]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 64 KiB/s rd, 112 MiB/s wr, 18.34k op/s 2024-09-10T11:47:21.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:21 smithi081 ceph-mon[35059]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 64 KiB/s rd, 112 MiB/s wr, 18.34k op/s 2024-09-10T11:47:21.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:21 smithi026 ceph-mon[34817]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 64 KiB/s rd, 112 MiB/s wr, 18.34k op/s 2024-09-10T11:47:22.683 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:47:22.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:47:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:23.405 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:23 smithi017 ceph-mon[30817]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 69 MiB/s wr, 11.45k op/s 2024-09-10T11:47:23.452 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:23 smithi081 ceph-mon[35059]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 69 MiB/s wr, 11.45k op/s 2024-09-10T11:47:23.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:23 smithi026 ceph-mon[34817]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 69 MiB/s wr, 11.45k op/s 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 -- 172.21.15.17:0/519974759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 msgr2=0x7f14541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 --2- 172.21.15.17:0/519974759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f14541029b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1444009900 tx=0x7f144402a480 comp rx=0 tx=0).stop 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 -- 172.21.15.17:0/519974759 shutdown_connections 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 --2- 172.21.15.17:0/519974759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454102ef0 0x7f145410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 --2- 172.21.15.17:0/519974759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f14541029b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 --2- 172.21.15.17:0/519974759 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454100e20 0x7f1454101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 -- 172.21.15.17:0/519974759 >> 172.21.15.17:0/519974759 conn(0x7f14540fc7d0 msgr2=0x7f14540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 -- 172.21.15.17:0/519974759 shutdown_connections 2024-09-10T11:47:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.500+0000 7f145bc37640 1 -- 172.21.15.17:0/519974759 wait complete. 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 Processor -- start 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 -- start start 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 0x7f14541985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f1454198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1454110f80 con 0x7f1454102570 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1454110e00 con 0x7f1454102ef0 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145bc37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1454111100 con 0x7f1454100e20 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145a1d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f14599d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 0x7f14541985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145a1d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33532/0 (socket says 172.21.15.17:33532) 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f145a1d4640 1 -- 172.21.15.17:0/2138509777 learned_addr learned my addr 172.21.15.17:0/2138509777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.501+0000 7f14591d2640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f1454198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 -- 172.21.15.17:0/2138509777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 msgr2=0x7f145419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 -- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 msgr2=0x7f1454198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f1454198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 -- 172.21.15.17:0/2138509777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145419d570 con 0x7f1454100e20 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f145a1d4640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14591d2640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f1454198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f14599d3640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 0x7f14541985c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f145000e9f0 tx=0x7f145000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145000ccc0 con 0x7f1454100e20 2024-09-10T11:47:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1450010910 con 0x7f1454100e20 2024-09-10T11:47:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145419d860 con 0x7f1454100e20 2024-09-10T11:47:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450018960 con 0x7f1454100e20 2024-09-10T11:47:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.502+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14541a5140 con 0x7f1454100e20 2024-09-10T11:47:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.503+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1454101200 con 0x7f1454100e20 2024-09-10T11:47:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.505+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1450010ac0 con 0x7f1454100e20 2024-09-10T11:47:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.505+0000 7f144affd640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 0x7f14400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.505+0000 7f14591d2640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 0x7f14400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.505+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f14500cf8e0 con 0x7f1454100e20 2024-09-10T11:47:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.506+0000 7f14591d2640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 0x7f14400a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1444009230 tx=0x7f14440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.509+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f145009c1a0 con 0x7f1454100e20 2024-09-10T11:47:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.822+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f145410a0a0 con 0x7f1454100e20 2024-09-10T11:47:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.825+0000 7f144affd640 1 -- 172.21.15.17:0/2138509777 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11957 (secure 0 0 0) 0x7f14500a04a0 con 0x7f1454100e20 2024-09-10T11:47:23.827 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:47:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 36 2024-09-10T11:47:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":36,"btime":"2024-09-10T11:46:50:979702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:46:50.016695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:47:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.828+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 msgr2=0x7f14400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.828+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 0x7f14400a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1444009230 tx=0x7f14440058d0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.828+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 msgr2=0x7f14541985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.828+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 0x7f14541985c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f145000e9f0 tx=0x7f145000eeb0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 shutdown_connections 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f14400a2b80 0x7f14400a5040 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1444009230 tx=0x7f14440058d0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1454102ef0 0x7f145419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1454102570 0x7f1454198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 --2- 172.21.15.17:0/2138509777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454100e20 0x7f14541985c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.829+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 >> 172.21.15.17:0/2138509777 conn(0x7f14540fc7d0 msgr2=0x7f145406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.830+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 shutdown_connections 2024-09-10T11:47:23.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:23.830+0000 7f145bc37640 1 -- 172.21.15.17:0/2138509777 wait complete. 2024-09-10T11:47:24.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:24 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2138509777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:47:24.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:24 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2138509777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:47:24.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:24 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2138509777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:47:24.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:47:25.241 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:25.452 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:25 smithi017 ceph-mon[30817]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 63 MiB/s wr, 10.43k op/s 2024-09-10T11:47:25.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:25 smithi081 ceph-mon[35059]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 63 MiB/s wr, 10.43k op/s 2024-09-10T11:47:25.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:25 smithi026 ceph-mon[34817]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 34 KiB/s rd, 63 MiB/s wr, 10.43k op/s 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 -- 172.21.15.17:0/2975761366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c10c180 msgr2=0x7f256c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2975761366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c10c180 0x7f256c10e610 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2564009ca0 tx=0x7f256402a950 comp rx=0 tx=0).stop 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 -- 172.21.15.17:0/2975761366 shutdown_connections 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2975761366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c103700 0x7f256c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2975761366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c10c180 0x7f256c10e610 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2975761366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 -- 172.21.15.17:0/2975761366 >> 172.21.15.17:0/2975761366 conn(0x7f256c0fc7a0 msgr2=0x7f256c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 -- 172.21.15.17:0/2975761366 shutdown_connections 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.809+0000 7f2570d7a640 1 -- 172.21.15.17:0/2975761366 wait complete. 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.810+0000 7f2570d7a640 1 Processor -- start 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.810+0000 7f2570d7a640 1 -- start start 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.810+0000 7f2570d7a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.810+0000 7f2570d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2570d7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 0x7f256c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2570d7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f256c111f30 con 0x7f256c103700 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2570d7a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f256c111db0 con 0x7f256c102de0 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2570d7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1120b0 con 0x7f256c10c180 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2563fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33556/0 (socket says 172.21.15.17:33556) 2024-09-10T11:47:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 -- 172.21.15.17:0/2621543993 learned_addr learned my addr 172.21.15.17:0/2621543993 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2563fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40810/0 (socket says 172.21.15.17:40810) 2024-09-10T11:47:25.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 0x7f256c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 -- 172.21.15.17:0/2621543993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 msgr2=0x7f256c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 0x7f256c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 -- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 msgr2=0x7f256c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 -- 172.21.15.17:0/2621543993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c19d3e0 con 0x7f256c102de0 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f2563fff640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 0x7f256c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.811+0000 7f256a59c640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e9f0 tx=0x7f255c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.812+0000 7f25637fe640 1 -- 172.21.15.17:0/2621543993 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00cd80 con 0x7f256c102de0 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.812+0000 7f25637fe640 1 -- 172.21.15.17:0/2621543993 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c010910 con 0x7f256c102de0 2024-09-10T11:47:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.812+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c19d6d0 con 0x7f256c102de0 2024-09-10T11:47:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.812+0000 7f25637fe640 1 -- 172.21.15.17:0/2621543993 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c018990 con 0x7f256c102de0 2024-09-10T11:47:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.812+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c1a4fb0 con 0x7f256c102de0 2024-09-10T11:47:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.814+0000 7f25637fe640 1 -- 172.21.15.17:0/2621543993 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f255c018b30 con 0x7f256c102de0 2024-09-10T11:47:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.815+0000 7f2573153740 1 Processor -- start 2024-09-10T11:47:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.815+0000 7f2573153740 1 -- start start 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.815+0000 7f2573153740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce198030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2573153740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2573153740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2573153740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5636ce0f82f0 con 0x5636ce197c50 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2573153740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5636ce09fcf0 con 0x5636ce196f20 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2573153740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5636ce0f42b0 con 0x5636ce1964a0 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f25637fe640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 0x7f25580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60134/0 (socket says 172.21.15.17:60134) 2024-09-10T11:47:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 -- 172.21.15.17:0/2268498086 learned_addr learned my addr 172.21.15.17:0/2268498086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f2563fff640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 0x7f25580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f25637fe640 1 -- 172.21.15.17:0/2621543993 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f255c0cf3f0 con 0x7f256c102de0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 -- 172.21.15.17:0/2268498086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 msgr2=0x5636ce1a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 -- 172.21.15.17:0/2268498086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 msgr2=0x5636ce198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 -- 172.21.15.17:0/2268498086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ce0843a0 con 0x5636ce1964a0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.816+0000 7f256a59c640 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f255c0980c0 tx=0x7f255c097920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b9d765b6f1dccf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.817+0000 7f2560ff9640 1 -- 172.21.15.17:0/2268498086 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c09ffb0 con 0x5636ce1964a0 2024-09-10T11:47:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.817+0000 7f2560ff9640 1 -- 172.21.15.17:0/2268498086 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c099fb0 con 0x5636ce1964a0 2024-09-10T11:47:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.817+0000 7f2560ff9640 1 -- 172.21.15.17:0/2268498086 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c098320 con 0x5636ce1964a0 2024-09-10T11:47:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f256ad9d640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 0x7f25580a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2564009430 tx=0x7f2564005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- 172.21.15.17:0/2268498086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 msgr2=0x5636ce196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f255c0980c0 tx=0x7f255c097920 comp rx=0 tx=0).stop 2024-09-10T11:47:25.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- 172.21.15.17:0/2268498086 shutdown_connections 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce196900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 --2- 172.21.15.17:0/2268498086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- 172.21.15.17:0/2268498086 >> 172.21.15.17:0/2268498086 conn(0x5636ce15b310 msgr2=0x5636ce192fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- 172.21.15.17:0/2268498086 shutdown_connections 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- 172.21.15.17:0/2268498086 wait complete. 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.818+0000 7f2573153740 1 -- start start 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 Processor -- start 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce196f20 0x5636ce1a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 0x5636ce1a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5636ce1a8890 con 0x5636ce196f20 2024-09-10T11:47:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5636ce0b3060 con 0x5636ce197c50 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5636ce1a8a10 con 0x5636ce1964a0 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2573153740 10 client.0 _ll_register_callbacks cb 0x5636cde068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 0x5636ce1a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60140/0 (socket says 172.21.15.17:60140) 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f2563fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce196f20 0x5636ce1a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 0x5636ce1a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33578/0 (socket says 172.21.15.17:33578) 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 -- 172.21.15.17:0/1368407212 learned_addr learned my addr 172.21.15.17:0/1368407212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 -- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 msgr2=0x5636ce1a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 0x5636ce1a55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 -- 172.21.15.17:0/1368407212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce196f20 msgr2=0x5636ce1a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce196f20 0x5636ce1a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.819+0000 7f256a59c640 1 -- 172.21.15.17:0/1368407212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636cde693c0 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f256a59c640 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f255c09b9b0 tx=0x7f255c018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d0f2facebca10f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0104a0 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f255c0b4030 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c099fb0 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f255c098320 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2573153740 10 client.25423 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5636ce1a8890 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.820+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c099fb0 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f255c0a4c50 con 0x5636ce1964a0 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 10 client.25423 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 10 client.25423 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 20 client.25423 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce1b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 4 client.25423 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636ce105860 con 0x5636ce1b53c0 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2563fff640 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce1b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2563fff640 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce1b77b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=78cfd6b7c6f5fd5b server_cookie=2905b267c5f135cb in_seq=0 out_seq=0 2024-09-10T11:47:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.821+0000 7f2551ffb640 10 client.25423 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:47:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2551ffb640 1 -- 172.21.15.17:0/1368407212 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636ce105860 con 0x5636ce1b53c0 2024-09-10T11:47:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2551ffb640 10 client.25423 handle_command_reply: tid=0 2024-09-10T11:47:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 client.25423 shutdown 2024-09-10T11:47:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 msgr2=0x5636ce1a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f255c09b9b0 tx=0x7f255c018420 comp rx=0 tx=0).stop 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 shutdown_connections 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce1b77b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce197c50 0x5636ce1a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2551ffb640 0 client.25423 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce196f20 0x5636ce1a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 --2- 172.21.15.17:0/1368407212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1a7de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.822+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 >> 172.21.15.17:0/1368407212 conn(0x5636ce15b310 msgr2=0x5636ce198850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.823+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 shutdown_connections 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.823+0000 7f2573153740 1 -- 172.21.15.17:0/1368407212 wait complete. 2024-09-10T11:47:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.823+0000 7f2573153740 20 client.25423 trim_cache size 0 max 16384 2024-09-10T11:47:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 Processor -- start 2024-09-10T11:47:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 -- start start 2024-09-10T11:47:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce199040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce197c50 0x5636ce1a2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1ab430 con 0x5636ce1964a0 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1acfa0 con 0x5636ce196f20 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2573153740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1abb00 con 0x5636ce197c50 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f256a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f256a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40832/0 (socket says 172.21.15.17:40832) 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f256a59c640 1 -- 172.21.15.17:0/3830327439 learned_addr learned my addr 172.21.15.17:0/3830327439 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f256ad9d640 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce197c50 0x5636ce1a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.840+0000 7f2563fff640 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 -- 172.21.15.17:0/3830327439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce197c50 msgr2=0x5636ce1a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce197c50 0x5636ce1a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 -- 172.21.15.17:0/3830327439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 msgr2=0x5636ce199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 -- 172.21.15.17:0/3830327439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ce194200 con 0x5636ce1964a0 2024-09-10T11:47:25.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f256a59c640 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f255c0a0170 tx=0x7f255c09ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ea036f156829cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f2553fff640 1 -- 172.21.15.17:0/3830327439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a4870 con 0x5636ce1964a0 2024-09-10T11:47:25.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f2553fff640 1 -- 172.21.15.17:0/3830327439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c0a8020 con 0x5636ce1964a0 2024-09-10T11:47:25.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.841+0000 7f2553fff640 1 -- 172.21.15.17:0/3830327439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a1210 con 0x5636ce1964a0 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- 172.21.15.17:0/3830327439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 msgr2=0x5636ce192270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f255c0a0170 tx=0x7f255c09ffb0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- 172.21.15.17:0/3830327439 shutdown_connections 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce197c50 0x5636ce1a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 --2- 172.21.15.17:0/3830327439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce1964a0 0x5636ce192270 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- 172.21.15.17:0/3830327439 >> 172.21.15.17:0/3830327439 conn(0x5636ce15b310 msgr2=0x5636ce1a1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- 172.21.15.17:0/3830327439 shutdown_connections 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- 172.21.15.17:0/3830327439 wait complete. 2024-09-10T11:47:25.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.842+0000 7f2573153740 1 -- start start 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 Processor -- start 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce1adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1ac8d0 con 0x5636ce197c50 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f256a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60160/0 (socket says 172.21.15.17:60160) 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f256a59c640 1 -- 172.21.15.17:0/840214817 learned_addr learned my addr 172.21.15.17:0/840214817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2563fff640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1ac1d0 con 0x5636ce196f20 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1a9410 con 0x5636ce1964a0 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.843+0000 7f256ad9d640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce1adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2573153740 10 client.0 _ll_register_callbacks cb 0x7f2554009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 -- 172.21.15.17:0/840214817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 msgr2=0x5636ce1ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 -- 172.21.15.17:0/840214817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 msgr2=0x5636ce1adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce1adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ce1ae0e0 con 0x5636ce196f20 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f256a59c640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2563fff640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1ab9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5636ce1a6640 tx=0x7f2554012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c21ead73d06325 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255401fab0 con 0x5636ce196f20 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.844+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f255401fc50 con 0x5636ce196f20 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c0a8020 con 0x5636ce196f20 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2554005020 con 0x5636ce196f20 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 10 client.25451 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:25.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5636ce21faa0 con 0x5636ce196f20 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c0a8020 con 0x5636ce196f20 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f2554027480 con 0x5636ce196f20 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 10 client.25451 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 10 client.25451 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 20 client.25451 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce222260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 4 client.25451 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636ce0ffd70 con 0x5636ce1b53c0 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.845+0000 7f256a59c640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce222260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.846+0000 7f2551ffb640 10 client.25451 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.846+0000 7f256a59c640 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce222260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2936b4d8685bbda8 server_cookie=716513ea006a3c33 in_seq=0 out_seq=0 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2551ffb640 1 -- 172.21.15.17:0/840214817 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636ce0ffd70 con 0x5636ce1b53c0 2024-09-10T11:47:25.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2551ffb640 10 client.25451 handle_command_reply: tid=0 2024-09-10T11:47:25.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 client.25451 shutdown 2024-09-10T11:47:25.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 msgr2=0x5636ce1ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1ab9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5636ce1a6640 tx=0x7f2554012bc0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 shutdown_connections 2024-09-10T11:47:25.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5636ce1b53c0 0x5636ce222260 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ce197c50 0x5636ce1adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5636ce196f20 0x5636ce1ab9f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 --2- 172.21.15.17:0/840214817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5636ce1964a0 0x5636ce1ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2551ffb640 0 client.25451 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 >> 172.21.15.17:0/840214817 conn(0x5636ce15b310 msgr2=0x5636ce1a68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 shutdown_connections 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.847+0000 7f2573153740 1 -- 172.21.15.17:0/840214817 wait complete. 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.848+0000 7f2573153740 20 client.25451 trim_cache size 0 max 16384 2024-09-10T11:47:25.853 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:47:25.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 msgr2=0x7f25580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 0x7f25580a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2564009430 tx=0x7f2564005c50 comp rx=0 tx=0).stop 2024-09-10T11:47:25.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 msgr2=0x7f256c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:25.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e9f0 tx=0x7f255c00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 shutdown_connections 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f25580a2b80 0x7f25580a5040 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f256c10c180 0x7f256c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f256c103700 0x7f256c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 --2- 172.21.15.17:0/2621543993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f256c102de0 0x7f256c198430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.849+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 >> 172.21.15.17:0/2621543993 conn(0x7f256c0fc7a0 msgr2=0x7f256c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.850+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 shutdown_connections 2024-09-10T11:47:25.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:25.850+0000 7f2570d7a640 1 -- 172.21.15.17:0/2621543993 wait complete. 2024-09-10T11:47:26.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:47:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:27.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:27 smithi081 ceph-mon[35059]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 40 KiB/s rd, 81 MiB/s wr, 13.35k op/s 2024-09-10T11:47:27.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:27 smithi026 ceph-mon[34817]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 40 KiB/s rd, 81 MiB/s wr, 13.35k op/s 2024-09-10T11:47:27.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:27 smithi017 ceph-mon[30817]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 40 KiB/s rd, 81 MiB/s wr, 13.35k op/s 2024-09-10T11:47:27.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 -- 172.21.15.17:0/4087674857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e081082a0 msgr2=0x7f7e0810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/4087674857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e081082a0 0x7f7e0810ec40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009cd0 tx=0x7f7e0002a8e0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 -- 172.21.15.17:0/4087674857 shutdown_connections 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/4087674857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/4087674857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e081082a0 0x7f7e0810ec40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/4087674857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e08102d30 0x7f7e08103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 -- 172.21.15.17:0/4087674857 >> 172.21.15.17:0/4087674857 conn(0x7f7e080fc7d0 msgr2=0x7f7e080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 -- 172.21.15.17:0/4087674857 shutdown_connections 2024-09-10T11:47:27.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.771+0000 7f7e0e98a640 1 -- 172.21.15.17:0/4087674857 wait complete. 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 Processor -- start 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 -- start start 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 0x7f7e08101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081120a0 con 0x7f7e08102d30 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08111f20 con 0x7f7e081082a0 2024-09-10T11:47:27.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0e98a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08112220 con 0x7f7e081036e0 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40856/0 (socket says 172.21.15.17:40856) 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e07fff640 1 -- 172.21.15.17:0/2710846387 learned_addr learned my addr 172.21.15.17:0/2710846387 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.772+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 0x7f7e08101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 -- 172.21.15.17:0/2710846387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 msgr2=0x7f7e08100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 -- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 msgr2=0x7f7e08100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 -- 172.21.15.17:0/2710846387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e081a6a00 con 0x7f7e081082a0 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e07fff640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:27.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 0x7f7e08101410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002ae00 tx=0x7f7e00031df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e057fa640 1 -- 172.21.15.17:0/2710846387 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00003d80 con 0x7f7e081082a0 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e057fa640 1 -- 172.21.15.17:0/2710846387 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e00004520 con 0x7f7e081082a0 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e081a6c90 con 0x7f7e081082a0 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e057fa640 1 -- 172.21.15.17:0/2710846387 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00030d00 con 0x7f7e081082a0 2024-09-10T11:47:27.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.773+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e081a7220 con 0x7f7e081082a0 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e057fa640 1 -- 172.21.15.17:0/2710846387 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e000046d0 con 0x7f7e081082a0 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 Processor -- start 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 -- start start 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be874a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be87f370 0x5605be881760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5605be7da2f0 con 0x5605be87f370 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5605be781cf0 con 0x5605be875b40 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.776+0000 7f7e10d63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5605be7d62b0 con 0x5605be8745d0 2024-09-10T11:47:27.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e057fa640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 0x7f7df00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33620/0 (socket says 172.21.15.17:33620) 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 -- 172.21.15.17:0/546216845 learned_addr learned my addr 172.21.15.17:0/546216845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 0x7f7df00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be87f370 0x5605be881760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e057fa640 1 -- 172.21.15.17:0/2710846387 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7e0002e030 con 0x7f7e081082a0 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 -- 172.21.15.17:0/546216845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 msgr2=0x5605be874a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be874a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 -- 172.21.15.17:0/546216845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be87f370 msgr2=0x5605be881760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.777+0000 7f7e077fe640 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be87f370 0x5605be881760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7e0cf27640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 0x7f7df00a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e000b7860 tx=0x7f7e00091040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7e077fe640 1 -- 172.21.15.17:0/546216845 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605be7663a0 con 0x5605be875b40 2024-09-10T11:47:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7e077fe640 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0058c0 tx=0x7f7dfc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bbed0d66a2c52d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7dee7fc640 1 -- 172.21.15.17:0/546216845 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc004030 con 0x5605be875b40 2024-09-10T11:47:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7dee7fc640 1 -- 172.21.15.17:0/546216845 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc011d80 con 0x5605be875b40 2024-09-10T11:47:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.778+0000 7f7dee7fc640 1 -- 172.21.15.17:0/546216845 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc005600 con 0x5605be875b40 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 -- 172.21.15.17:0/546216845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 msgr2=0x5605be874090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0058c0 tx=0x7f7dfc005850 comp rx=0 tx=0).stop 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 -- 172.21.15.17:0/546216845 shutdown_connections 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be874a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be87f370 0x5605be881760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 --2- 172.21.15.17:0/546216845 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be875b40 0x5605be874090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 -- 172.21.15.17:0/546216845 >> 172.21.15.17:0/546216845 conn(0x5605be83d310 msgr2=0x5605be870c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 -- 172.21.15.17:0/546216845 shutdown_connections 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.779+0000 7f7e10d63740 1 -- 172.21.15.17:0/546216845 wait complete. 2024-09-10T11:47:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 -- start start 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 Processor -- start 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 0x5605be87bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be87c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5605be882070 con 0x5605be8745d0 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5605be795060 con 0x5605be87f370 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.780+0000 7f7e10d63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5605be8821f0 con 0x5605be875b40 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40876/0 (socket says 172.21.15.17:40876) 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e077fe640 1 -- 172.21.15.17:0/856790584 learned_addr learned my addr 172.21.15.17:0/856790584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e077fe640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be87c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 0x5605be87bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e10d63740 10 client.0 _ll_register_callbacks cb 0x5605be4e88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 -- 172.21.15.17:0/856790584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 msgr2=0x5605be87c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be87c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 -- 172.21.15.17:0/856790584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 msgr2=0x5605be87ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 -- 172.21.15.17:0/856790584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605be54b3c0 con 0x5605be875b40 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e077fe640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7e07fff640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 0x5605be87bfb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df80119d0 tx=0x7f7df8011e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573bb9b8c74eba8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.781+0000 7f7de77fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df800fcb0 con 0x5605be875b40 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dfc011d80 con 0x5605be875b40 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7df8005020 con 0x5605be875b40 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7df800fe50 con 0x5605be875b40 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 10 client.25438 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5605be88db20 con 0x5605be875b40 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc011d80 con 0x5605be875b40 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f7df8019410 con 0x5605be875b40 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 10 client.25438 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 10 client.25438 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.782+0000 7f7e10d63740 20 client.25438 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be88ef80 0x5605be8913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7e10d63740 4 client.25438 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605be7e7860 con 0x5605be88ef80 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7e077fe640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be88ef80 0x5605be8913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7de77fe640 10 client.25438 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:47:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.783+0000 7f7e077fe640 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be88ef80 0x5605be8913e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e00c4e960fc93150 server_cookie=de10ccb849a10b1b in_seq=0 out_seq=0 2024-09-10T11:47:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7de77fe640 1 -- 172.21.15.17:0/856790584 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605be7e7860 con 0x5605be88ef80 2024-09-10T11:47:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7de77fe640 10 client.25438 handle_command_reply: tid=0 2024-09-10T11:47:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 client.25438 shutdown 2024-09-10T11:47:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 msgr2=0x5605be87bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 0x5605be87bfb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df80119d0 tx=0x7f7df8011e90 comp rx=0 tx=0).stop 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 shutdown_connections 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be88ef80 0x5605be8913e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be875b40 0x5605be87bfb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be87c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 --2- 172.21.15.17:0/856790584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be8745d0 0x5605be87ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 >> 172.21.15.17:0/856790584 conn(0x5605be83d310 msgr2=0x5605be876960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.784+0000 7f7de77fe640 0 client.25438 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.785+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 shutdown_connections 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.785+0000 7f7e10d63740 1 -- 172.21.15.17:0/856790584 wait complete. 2024-09-10T11:47:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.785+0000 7f7e10d63740 20 client.25438 trim_cache size 0 max 16384 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 Processor -- start 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 -- start start 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be88b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be896cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.800+0000 7f7e10d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081af630 con 0x5605be875b40 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e10d63740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081b11a0 con 0x5605be87f370 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e10d63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081afd00 con 0x5605be8745d0 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be88b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be896cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be896cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40886/0 (socket says 172.21.15.17:40886) 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e07fff640 1 -- 172.21.15.17:0/1548201414 learned_addr learned my addr 172.21.15.17:0/1548201414 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 -- 172.21.15.17:0/1548201414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 msgr2=0x5605be8971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 -- 172.21.15.17:0/1548201414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 msgr2=0x5605be896cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be896cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 -- 172.21.15.17:0/1548201414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605be8704f0 con 0x5605be8745d0 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.801+0000 7f7e077fe640 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be88b340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5605be891c20 tx=0x7f7dfc0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98738e16331efded server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.802+0000 7f7dedffb640 1 -- 172.21.15.17:0/1548201414 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0056c0 con 0x5605be8745d0 2024-09-10T11:47:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.802+0000 7f7dedffb640 1 -- 172.21.15.17:0/1548201414 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc017040 con 0x5605be8745d0 2024-09-10T11:47:27.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.802+0000 7f7dedffb640 1 -- 172.21.15.17:0/1548201414 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc02d640 con 0x5605be8745d0 2024-09-10T11:47:27.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.802+0000 7f7e10d63740 1 -- 172.21.15.17:0/1548201414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 msgr2=0x5605be88b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.802+0000 7f7e10d63740 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be88b340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5605be891c20 tx=0x7f7dfc0052e0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 -- 172.21.15.17:0/1548201414 shutdown_connections 2024-09-10T11:47:27.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be896cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 --2- 172.21.15.17:0/1548201414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be88b340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 -- 172.21.15.17:0/1548201414 >> 172.21.15.17:0/1548201414 conn(0x5605be83d310 msgr2=0x5605be87e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 -- 172.21.15.17:0/1548201414 shutdown_connections 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 -- 172.21.15.17:0/1548201414 wait complete. 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 -- start start 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.803+0000 7f7e10d63740 1 Processor -- start 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be882db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081b0ad0 con 0x5605be875b40 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081b03d0 con 0x5605be87f370 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081ad610 con 0x5605be8745d0 2024-09-10T11:47:27.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e10d63740 10 client.0 _ll_register_callbacks cb 0x7f7df8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60196/0 (socket says 172.21.15.17:60196) 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 -- 172.21.15.17:0/2011370729 learned_addr learned my addr 172.21.15.17:0/2011370729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e07fff640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be882db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 -- 172.21.15.17:0/2011370729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 msgr2=0x5605be8832f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8832f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 -- 172.21.15.17:0/2011370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 msgr2=0x5605be882db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be882db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 -- 172.21.15.17:0/2011370729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605be883990 con 0x5605be8745d0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7e077fe640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0052b0 tx=0x7f7dfc005500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63923def1df8e277 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.804+0000 7f7de77fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc005640 con 0x5605be8745d0 2024-09-10T11:47:27.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7dfc0035f0 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dfc017040 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7dfc0037f0 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 10 client.25444 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5605be8f9af0 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc017040 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f7dfc02d9e0 con 0x5605be8745d0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 10 client.25444 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 10 client.25444 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 20 client.25444 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.805+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be8f9f10 0x5605be8fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7e10d63740 4 client.25444 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605be7e1d70 con 0x5605be8f9f10 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7e07fff640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be8f9f10 0x5605be8fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7de77fe640 10 client.25444 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:47:27.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7e07fff640 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be8f9f10 0x5605be8fc300 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=657dcd50366ef979 server_cookie=43781c49f7335732 in_seq=0 out_seq=0 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7de77fe640 1 -- 172.21.15.17:0/2011370729 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605be7e1d70 con 0x5605be8f9f10 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7de77fe640 10 client.25444 handle_command_reply: tid=0 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.806+0000 7f7e10d63740 1 client.25444 shutdown 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 msgr2=0x5605be887a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0052b0 tx=0x7f7dfc005500 comp rx=0 tx=0).stop 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 shutdown_connections 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x5605be8f9f10 0x5605be8fc300 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5605be87f370 0x5605be8832f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5605be875b40 0x5605be882db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 --2- 172.21.15.17:0/2011370729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605be8745d0 0x5605be887a80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7de77fe640 0 client.25444 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:47:27.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 >> 172.21.15.17:0/2011370729 conn(0x5605be83d310 msgr2=0x5605be87d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 shutdown_connections 2024-09-10T11:47:27.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 1 -- 172.21.15.17:0/2011370729 wait complete. 2024-09-10T11:47:27.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.807+0000 7f7e10d63740 20 client.25444 trim_cache size 0 max 16384 2024-09-10T11:47:27.814 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 msgr2=0x7f7df00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 0x7f7df00a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e000b7860 tx=0x7f7e00091040 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 msgr2=0x7f7e08101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 0x7f7e08101410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002ae00 tx=0x7f7e00031df0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 shutdown_connections 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f7df00a2c00 0x7f7df00a50c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e081036e0 0x7f7e08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e081082a0 0x7f7e08101410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 --2- 172.21.15.17:0/2710846387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e08102d30 0x7f7e08100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:27.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 >> 172.21.15.17:0/2710846387 conn(0x7f7e080fc7d0 msgr2=0x7f7e08105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:27.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 shutdown_connections 2024-09-10T11:47:27.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:27.808+0000 7f7e0e98a640 1 -- 172.21.15.17:0/2710846387 wait complete. 2024-09-10T11:47:28.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:47:29.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:29 smithi081 ceph-mon[35059]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 5.83k op/s 2024-09-10T11:47:29.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:29 smithi026 ceph-mon[34817]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 5.83k op/s 2024-09-10T11:47:29.510 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:29.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:29 smithi017 ceph-mon[30817]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 16 KiB/s rd, 35 MiB/s wr, 5.83k op/s 2024-09-10T11:47:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 -- 172.21.15.17:0/1767171284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590112b90 msgr2=0x7f7590114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 --2- 172.21.15.17:0/1767171284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590112b90 0x7f7590114f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7588009900 tx=0x7f758802a4d0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 -- 172.21.15.17:0/1767171284 shutdown_connections 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 --2- 172.21.15.17:0/1767171284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590112b90 0x7f7590114f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 --2- 172.21.15.17:0/1767171284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590074eb0 0x7f7590112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 --2- 172.21.15.17:0/1767171284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7590074590 0x7f7590074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.197+0000 7f7594c20640 1 -- 172.21.15.17:0/1767171284 >> 172.21.15.17:0/1767171284 conn(0x7f75900fd8c0 msgr2=0x7f75900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.198+0000 7f7594c20640 1 -- 172.21.15.17:0/1767171284 shutdown_connections 2024-09-10T11:47:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.198+0000 7f7594c20640 1 -- 172.21.15.17:0/1767171284 wait complete. 2024-09-10T11:47:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 Processor -- start 2024-09-10T11:47:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 -- start start 2024-09-10T11:47:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7590074eb0 0x7f759010d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590112b90 0x7f759010ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7590107b40 con 0x7f7590074eb0 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f75901079c0 con 0x7f7590112b90 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.199+0000 7f7594c20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7590107cc0 con 0x7f7590074590 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60212/0 (socket says 172.21.15.17:60212) 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 -- 172.21.15.17:0/1466996644 learned_addr learned my addr 172.21.15.17:0/1466996644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590112b90 0x7f759010ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 -- 172.21.15.17:0/1466996644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590112b90 msgr2=0x7f759010ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590112b90 0x7f759010ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 -- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7590074eb0 msgr2=0x7f759010d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7590074eb0 0x7f759010d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.200+0000 7f758e59c640 1 -- 172.21.15.17:0/1466996644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759011c8b0 con 0x7f7590074590 2024-09-10T11:47:30.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.201+0000 7f758e59c640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f757800d950 tx=0x7f757800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.202+0000 7f75877fe640 1 -- 172.21.15.17:0/1466996644 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578017070 con 0x7f7590074590 2024-09-10T11:47:30.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.202+0000 7f75877fe640 1 -- 172.21.15.17:0/1466996644 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7578009c30 con 0x7f7590074590 2024-09-10T11:47:30.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.202+0000 7f75877fe640 1 -- 172.21.15.17:0/1466996644 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800f690 con 0x7f7590074590 2024-09-10T11:47:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.202+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759011cba0 con 0x7f7590074590 2024-09-10T11:47:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.202+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759011d060 con 0x7f7590074590 2024-09-10T11:47:30.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.208+0000 7f75877fe640 1 -- 172.21.15.17:0/1466996644 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f757800f830 con 0x7f7590074590 2024-09-10T11:47:30.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.209+0000 7f75877fe640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 0x7f757c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.209+0000 7f7596ff9740 1 Processor -- start 2024-09-10T11:47:30.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.209+0000 7f7596ff9740 1 -- start start 2024-09-10T11:47:30.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4fb40 0x564f0ce4e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 0x564f0ce4ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 0x564f0ce6c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f0cdb42f0 con 0x564f0ce4e5d0 2024-09-10T11:47:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564f0cd5bcf0 con 0x564f0ce6a380 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.210+0000 7f7596ff9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f0cdb02b0 con 0x564f0ce4fb40 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.212+0000 7f758dd9b640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 0x7f757c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.212+0000 7f758dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 0x564f0ce4ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.212+0000 7f758dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 0x564f0ce4ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40914/0 (socket says 172.21.15.17:40914) 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.212+0000 7f758dd9b640 1 -- 172.21.15.17:0/1252758921 learned_addr learned my addr 172.21.15.17:0/1252758921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.212+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 0x564f0ce6c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.213+0000 7f758ed9d640 1 -- 172.21.15.17:0/1252758921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4fb40 msgr2=0x564f0ce4e090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:47:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.213+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4fb40 0x564f0ce4e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.213+0000 7f758ed9d640 1 -- 172.21.15.17:0/1252758921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 msgr2=0x564f0ce4ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.213+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 0x564f0ce4ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.213+0000 7f758ed9d640 1 -- 172.21.15.17:0/1252758921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0cd403a0 con 0x564f0ce6a380 2024-09-10T11:47:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.216+0000 7f75877fe640 1 -- 172.21.15.17:0/1466996644 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f757809a590 con 0x7f7590074590 2024-09-10T11:47:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.216+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 0x564f0ce6c770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7588009230 tx=0x7f7588004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae866d8e3cee1541 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.217+0000 7f7584ff9640 1 -- 172.21.15.17:0/1252758921 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588040070 con 0x564f0ce6a380 2024-09-10T11:47:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.218+0000 7f7584ff9640 1 -- 172.21.15.17:0/1252758921 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75880048c0 con 0x564f0ce6a380 2024-09-10T11:47:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 -- 172.21.15.17:0/1252758921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 msgr2=0x564f0ce6c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 0x564f0ce6c770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7588009230 tx=0x7f7588004cc0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 -- 172.21.15.17:0/1252758921 shutdown_connections 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce6a380 0x564f0ce6c770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4e5d0 0x564f0ce4ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1252758921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4fb40 0x564f0ce4e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.219+0000 7f7596ff9740 1 -- 172.21.15.17:0/1252758921 >> 172.21.15.17:0/1252758921 conn(0x564f0ce17310 msgr2=0x564f0ce4ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.220+0000 7f7596ff9740 1 -- 172.21.15.17:0/1252758921 shutdown_connections 2024-09-10T11:47:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.221+0000 7f7596ff9740 1 -- 172.21.15.17:0/1252758921 wait complete. 2024-09-10T11:47:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.222+0000 7f7596ff9740 1 -- start start 2024-09-10T11:47:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.222+0000 7f7596ff9740 1 Processor -- start 2024-09-10T11:47:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.222+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce6c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce69720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f0ce6d070 con 0x564f0ce4fb40 2024-09-10T11:47:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564f0cd6f060 con 0x564f0ce69c60 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f0ce6d1f0 con 0x564f0ce4e5d0 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f7596ff9740 10 client.0 _ll_register_callbacks cb 0x564f0cac28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f758ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f758ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:33670/0 (socket says 172.21.15.17:33670) 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.223+0000 7f758ed9d640 1 -- 172.21.15.17:0/3438712416 learned_addr learned my addr 172.21.15.17:0/3438712416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758e59c640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce6c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 -- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 msgr2=0x564f0ce6c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce6c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 -- 172.21.15.17:0/3438712416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 msgr2=0x564f0ce69720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce69720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 -- 172.21.15.17:0/3438712416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0cb253c0 con 0x564f0ce69c60 2024-09-10T11:47:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.224+0000 7f758ed9d640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7588006010 tx=0x7f75880048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f6aea0ccabe627 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.227+0000 7f7575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:30.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.227+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588053060 con 0x564f0ce69c60 2024-09-10T11:47:30.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.227+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f0cdc1860 con 0x564f0ce69c60 2024-09-10T11:47:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.227+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f75880052c0 con 0x564f0ce69c60 2024-09-10T11:47:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.228+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7588040050 con 0x564f0ce69c60 2024-09-10T11:47:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.230+0000 7f758dd9b640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 0x7f757c0a5190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x564f0ce4bac0 tx=0x7f7580009400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.235+0000 7f7596ff9740 10 client.25481 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:30.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.235+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f0ce52b80 con 0x564f0ce69c60 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564f0cdc1860 con 0x564f0ce69c60 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f7588045460 con 0x564f0ce69c60 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 10 client.25481 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 10 client.25481 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 20 client.25481 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0ce54040 0x564f0ce564e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 4 client.25481 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f0cdbbd70 con 0x564f0ce54040 2024-09-10T11:47:30.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.236+0000 7f758e59c640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0ce54040 0x564f0ce564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.237+0000 7f758e59c640 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0ce54040 0x564f0ce564e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c055ea7c8fd6d344 server_cookie=d308cdfc81f72972 in_seq=0 out_seq=0 2024-09-10T11:47:30.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.237+0000 7f7575ffb640 10 client.25481 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:47:30.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.238+0000 7f7575ffb640 1 -- 172.21.15.17:0/3438712416 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f0cdbbd70 con 0x564f0ce54040 2024-09-10T11:47:30.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.238+0000 7f7575ffb640 10 client.25481 handle_command_reply: tid=0 2024-09-10T11:47:30.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.238+0000 7f7596ff9740 1 client.25481 shutdown 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 msgr2=0x564f0ce6a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7588006010 tx=0x7f75880048f0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 shutdown_connections 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0ce54040 0x564f0ce564e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce69c60 0x564f0ce6a0e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce69720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 --2- 172.21.15.17:0/3438712416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce6c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 >> 172.21.15.17:0/3438712416 conn(0x564f0ce17310 msgr2=0x564f0ce509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7575ffb640 0 client.25481 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:47:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 shutdown_connections 2024-09-10T11:47:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 1 -- 172.21.15.17:0/3438712416 wait complete. 2024-09-10T11:47:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.242+0000 7f7596ff9740 20 client.25481 trim_cache size 0 max 16384 2024-09-10T11:47:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.272+0000 7f7596ff9740 1 Processor -- start 2024-09-10T11:47:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.273+0000 7f7596ff9740 1 -- start start 2024-09-10T11:47:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.274+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.275+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4fb40 0x564f0ce72520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60224/0 (socket says 172.21.15.17:60224) 2024-09-10T11:47:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f758e59c640 1 -- 172.21.15.17:0/1489626311 learned_addr learned my addr 172.21.15.17:0/1489626311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4af20 0x564f0ce72a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f757000e5a0 con 0x564f0ce4af20 2024-09-10T11:47:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7570010110 con 0x564f0ce4fb40 2024-09-10T11:47:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.278+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f757000ec70 con 0x564f0ce4e5d0 2024-09-10T11:47:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.279+0000 7f758ed9d640 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4af20 0x564f0ce72a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758dd9b640 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4fb40 0x564f0ce72520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758e59c640 1 -- 172.21.15.17:0/1489626311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4fb40 msgr2=0x564f0ce72520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758e59c640 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4fb40 0x564f0ce72520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758e59c640 1 -- 172.21.15.17:0/1489626311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4af20 msgr2=0x564f0ce72a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758e59c640 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4af20 0x564f0ce72a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.281+0000 7f758e59c640 1 -- 172.21.15.17:0/1489626311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0ce6aaa0 con 0x564f0ce4e5d0 2024-09-10T11:47:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.283+0000 7f758e59c640 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7578099770 tx=0x7f75780a3bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ff7943cae6cd58c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.283+0000 7f7577fff640 1 -- 172.21.15.17:0/1489626311 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578098f20 con 0x564f0ce4e5d0 2024-09-10T11:47:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.283+0000 7f7577fff640 1 -- 172.21.15.17:0/1489626311 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757801ee50 con 0x564f0ce4e5d0 2024-09-10T11:47:30.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.284+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 msgr2=0x564f0ce69df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.284+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7578099770 tx=0x7f75780a3bb0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.287+0000 7f7577fff640 1 -- 172.21.15.17:0/1489626311 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780990c0 con 0x564f0ce4e5d0 2024-09-10T11:47:30.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 shutdown_connections 2024-09-10T11:47:30.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4af20 0x564f0ce72a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4fb40 0x564f0ce72520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 --2- 172.21.15.17:0/1489626311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4e5d0 0x564f0ce69df0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 >> 172.21.15.17:0/1489626311 conn(0x564f0ce17310 msgr2=0x564f0ce696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.288+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 shutdown_connections 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.289+0000 7f7596ff9740 1 -- 172.21.15.17:0/1489626311 wait complete. 2024-09-10T11:47:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.289+0000 7f7596ff9740 1 -- start start 2024-09-10T11:47:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.290+0000 7f7596ff9740 1 Processor -- start 2024-09-10T11:47:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.291+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 0x564f0ce728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.291+0000 7f7596ff9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 0x564f0ce72e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.291+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 0x564f0ce728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.291+0000 7f758e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 0x564f0ce728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:60240/0 (socket says 172.21.15.17:60240) 2024-09-10T11:47:30.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.292+0000 7f758e59c640 1 -- 172.21.15.17:0/2876068891 learned_addr learned my addr 172.21.15.17:0/2876068891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:30.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce6ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f757000fa40 con 0x564f0ce4fb40 2024-09-10T11:47:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f757000f340 con 0x564f0ce4e5d0 2024-09-10T11:47:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f757000c580 con 0x564f0ce4af20 2024-09-10T11:47:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f7596ff9740 10 client.0 _ll_register_callbacks cb 0x7f7588004c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.293+0000 7f758dd9b640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 0x564f0ce72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.294+0000 7f758dd9b640 1 -- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 msgr2=0x564f0ce728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.294+0000 7f758dd9b640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 0x564f0ce728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.294+0000 7f758dd9b640 1 -- 172.21.15.17:0/2876068891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 msgr2=0x564f0ce6ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.294+0000 7f758dd9b640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce6ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.294+0000 7f758dd9b640 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0ce70730 con 0x564f0ce4e5d0 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.296+0000 7f758dd9b640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 0x564f0ce72e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x564f0ce6ad60 tx=0x7f7580004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbc9d4060fda3024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.296+0000 7f7575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.297+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7580024030 con 0x564f0ce4e5d0 2024-09-10T11:47:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.297+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f757801ee50 con 0x564f0ce4e5d0 2024-09-10T11:47:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.297+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7580004b20 con 0x564f0ce4e5d0 2024-09-10T11:47:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.300+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7580030050 con 0x564f0ce4e5d0 2024-09-10T11:47:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.300+0000 7f7596ff9740 10 client.25487 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.300+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f0cef53b0 con 0x564f0ce4e5d0 2024-09-10T11:47:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.302+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7580019040 con 0x564f0ce4e5d0 2024-09-10T11:47:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.302+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f7580020a40 con 0x564f0ce4e5d0 2024-09-10T11:47:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.302+0000 7f7596ff9740 10 client.25487 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.302+0000 7f7596ff9740 10 client.25487 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.302+0000 7f7596ff9740 20 client.25487 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.303+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0cef5bb0 0x564f0cef7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.303+0000 7f7596ff9740 4 client.25487 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.303+0000 7f758e59c640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0cef5bb0 0x564f0cef7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.303+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f757801ee50 con 0x564f0cef5bb0 2024-09-10T11:47:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.305+0000 7f758e59c640 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0cef5bb0 0x564f0cef7fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd1e31c75e36ed78 server_cookie=7f678f54524976db in_seq=0 out_seq=0 2024-09-10T11:47:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.305+0000 7f7575ffb640 10 client.25487 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:47:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.305+0000 7f7575ffb640 1 -- 172.21.15.17:0/2876068891 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f757801ee50 con 0x564f0cef5bb0 2024-09-10T11:47:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.305+0000 7f7575ffb640 10 client.25487 handle_command_reply: tid=0 2024-09-10T11:47:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 client.25487 shutdown 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 msgr2=0x564f0ce72e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 0x564f0ce72e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x564f0ce6ad60 tx=0x7f7580004a40 comp rx=0 tx=0).stop 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 shutdown_connections 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x564f0cef5bb0 0x564f0cef7fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f0ce4fb40 0x564f0ce6ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564f0ce4e5d0 0x564f0ce72e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 --2- 172.21.15.17:0/2876068891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f0ce4af20 0x564f0ce728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.306+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 >> 172.21.15.17:0/2876068891 conn(0x564f0ce17310 msgr2=0x564f0ce49d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.307+0000 7f7575ffb640 0 client.25487 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:47:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.307+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 shutdown_connections 2024-09-10T11:47:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.307+0000 7f7596ff9740 1 -- 172.21.15.17:0/2876068891 wait complete. 2024-09-10T11:47:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.308+0000 7f7596ff9740 20 client.25487 trim_cache size 0 max 16384 2024-09-10T11:47:30.310 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:47:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 msgr2=0x7f757c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 0x7f757c0a5190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x564f0ce4bac0 tx=0x7f7580009400 comp rx=0 tx=0).stop 2024-09-10T11:47:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 msgr2=0x7f7590112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f757800d950 tx=0x7f757800de10 comp rx=0 tx=0).stop 2024-09-10T11:47:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 shutdown_connections 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f757c0a2cd0 0x7f757c0a5190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7590112b90 0x7f759010ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7590074eb0 0x7f759010d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 --2- 172.21.15.17:0/1466996644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590074590 0x7f7590112610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.309+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 >> 172.21.15.17:0/1466996644 conn(0x7f75900fd8c0 msgr2=0x7f75900fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.310+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 shutdown_connections 2024-09-10T11:47:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:30.310+0000 7f7594c20640 1 -- 172.21.15.17:0/1466996644 wait complete. 2024-09-10T11:47:31.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:47:31.428 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:31 smithi017 ceph-mon[30817]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 6.12k op/s 2024-09-10T11:47:31.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:31 smithi081 ceph-mon[35059]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 6.12k op/s 2024-09-10T11:47:31.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:31 smithi026 ceph-mon[34817]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 6.12k op/s 2024-09-10T11:47:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.072+0000 7f9638e95640 1 -- 172.21.15.17:0/798018270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 msgr2=0x7f9634101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.072+0000 7f9638e95640 1 --2- 172.21.15.17:0/798018270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f9634101200 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9624009900 tx=0x7f962402a480 comp rx=0 tx=0).stop 2024-09-10T11:47:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 -- 172.21.15.17:0/798018270 shutdown_connections 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 --2- 172.21.15.17:0/798018270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f963410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 --2- 172.21.15.17:0/798018270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 --2- 172.21.15.17:0/798018270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f9634101200 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 -- 172.21.15.17:0/798018270 >> 172.21.15.17:0/798018270 conn(0x7f96340fc7d0 msgr2=0x7f96340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 -- 172.21.15.17:0/798018270 shutdown_connections 2024-09-10T11:47:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 -- 172.21.15.17:0/798018270 wait complete. 2024-09-10T11:47:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.073+0000 7f9638e95640 1 Processor -- start 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 -- start start 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f96340fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f96340fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9634110f80 con 0x7f9634100e20 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9634110e00 con 0x7f9634102570 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9638e95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9634111100 con 0x7f9634102ef0 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9631d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f963259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f96340fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f96340fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9631d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:37972/0 (socket says 172.21.15.17:37972) 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f963259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f96340fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59218/0 (socket says 172.21.15.17:59218) 2024-09-10T11:47:32.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.074+0000 7f9631d9b640 1 -- 172.21.15.17:0/1571175839 learned_addr learned my addr 172.21.15.17:0/1571175839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 -- 172.21.15.17:0/1571175839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 msgr2=0x7f96340fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 -- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 msgr2=0x7f96340fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f96340fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 -- 172.21.15.17:0/1571175839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96341a69c0 con 0x7f9634102ef0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9631d9b640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9632d9d640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f96340fd700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f962c009fd0 tx=0x7f962c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f96237fe640 1 -- 172.21.15.17:0/1571175839 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c00ce20 con 0x7f9634102ef0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f96237fe640 1 -- 172.21.15.17:0/1571175839 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f962c005020 con 0x7f9634102ef0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f96237fe640 1 -- 172.21.15.17:0/1571175839 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c010720 con 0x7f9634102ef0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341a6cb0 con 0x7f9634102ef0 2024-09-10T11:47:32.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.075+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341a71a0 con 0x7f9634102ef0 2024-09-10T11:47:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.078+0000 7f963b26e740 1 Processor -- start 2024-09-10T11:47:32.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.078+0000 7f96237fe640 1 -- 172.21.15.17:0/1571175839 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f962c005540 con 0x7f9634102ef0 2024-09-10T11:47:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 -- start start 2024-09-10T11:47:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8dad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564df8d132f0 con 0x564df8db8370 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564df8cbacf0 con 0x564df8dad5d0 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963b26e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564df8d0f2b0 con 0x564df8daeb40 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f963259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.079+0000 7f9631d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8dad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:37986/0 (socket says 172.21.15.17:37986) 2024-09-10T11:47:32.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 -- 172.21.15.17:0/1870912134 learned_addr learned my addr 172.21.15.17:0/1870912134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f9631d9b640 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 -- 172.21.15.17:0/1870912134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 msgr2=0x564df8dad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8dad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 -- 172.21.15.17:0/1870912134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 msgr2=0x564df8dba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dba760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 -- 172.21.15.17:0/1870912134 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df8c9f3a0 con 0x564df8dad5d0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f9631d9b640 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8dad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.080+0000 7f963259c640 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f962402a9a0 tx=0x7f9624005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450212d3023cb760 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f96237fe640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 0x7f961c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f9620ff9640 1 -- 172.21.15.17:0/1870912134 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624035030 con 0x564df8dad5d0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f9620ff9640 1 -- 172.21.15.17:0/1870912134 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9624051070 con 0x564df8dad5d0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f96237fe640 1 -- 172.21.15.17:0/1571175839 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f962c0cf530 con 0x7f9634102ef0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f9631d9b640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 0x7f961c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.081+0000 7f9620ff9640 1 -- 172.21.15.17:0/1870912134 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96240318c0 con 0x564df8dad5d0 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 -- 172.21.15.17:0/1870912134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 msgr2=0x564df8dada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f962402a9a0 tx=0x7f9624005dd0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 -- 172.21.15.17:0/1870912134 shutdown_connections 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8dada10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 --2- 172.21.15.17:0/1870912134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8dad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 -- 172.21.15.17:0/1870912134 >> 172.21.15.17:0/1870912134 conn(0x564df8d76310 msgr2=0x564df8da9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f9631d9b640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 0x7f961c0a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x564df8dae070 tx=0x7f9628005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 -- 172.21.15.17:0/1870912134 shutdown_connections 2024-09-10T11:47:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.082+0000 7f963b26e740 1 -- 172.21.15.17:0/1870912134 wait complete. 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 -- start start 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 Processor -- start 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 0x564df8db4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564df8dbb0b0 con 0x564df8daeb40 2024-09-10T11:47:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564df8cce060 con 0x564df8dad5d0 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564df8dbb230 con 0x564df8db8370 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.083+0000 7f963b26e740 10 client.0 _ll_register_callbacks cb 0x564df8a218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52854/0 (socket says 172.21.15.17:52854) 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 -- 172.21.15.17:0/454507495 learned_addr learned my addr 172.21.15.17:0/454507495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f963259c640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 -- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 msgr2=0x564df8db7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9631d9b640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 0x564df8db4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 -- 172.21.15.17:0/454507495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 msgr2=0x564df8db4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 0x564df8db4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 -- 172.21.15.17:0/454507495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df8a843c0 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9631d9b640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 0x564df8db4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9632d9d640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f962c09bd30 tx=0x7f962c09bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5389330ddaca4855 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.084+0000 7f9619ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0a4a10 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f962c0a4580 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9624051070 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f962c0a4780 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f963b26e740 10 client.25468 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564df8dc6b40 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9624051070 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f962c09ac60 con 0x564df8db8370 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.085+0000 7f963b26e740 10 client.25468 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963b26e740 10 client.25468 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963b26e740 20 client.25468 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8dca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963b26e740 4 client.25468 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564df8d20860 con 0x564df8dc7f50 2024-09-10T11:47:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.086+0000 7f963259c640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8dca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.087+0000 7f9619ffb640 10 client.25468 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:47:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.087+0000 7f963259c640 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8dca380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9c23e8d982b4922 server_cookie=ea155aba179d2a03 in_seq=0 out_seq=0 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f9619ffb640 1 -- 172.21.15.17:0/454507495 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564df8d20860 con 0x564df8dc7f50 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f9619ffb640 10 client.25468 handle_command_reply: tid=0 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 client.25468 shutdown 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 msgr2=0x564df8db5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f962c09bd30 tx=0x7f962c09bda0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 shutdown_connections 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8dca380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f9619ffb640 0 client.25468 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8db8370 0x564df8db5420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8daeb40 0x564df8db4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 --2- 172.21.15.17:0/454507495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 >> 172.21.15.17:0/454507495 conn(0x564df8d76310 msgr2=0x564df8daf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 shutdown_connections 2024-09-10T11:47:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 1 -- 172.21.15.17:0/454507495 wait complete. 2024-09-10T11:47:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.088+0000 7f963b26e740 20 client.25468 trim_cache size 0 max 16384 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.105+0000 7f963b26e740 1 Processor -- start 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.105+0000 7f963b26e740 1 -- start start 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8db0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9634073ef0 con 0x564df8db8370 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f96341a8ad0 con 0x564df8dad5d0 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963b26e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96341a7630 con 0x564df8daeb40 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8db0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52868/0 (socket says 172.21.15.17:52868) 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f963259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38004/0 (socket says 172.21.15.17:38004) 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 -- 172.21.15.17:0/3577494139 learned_addr learned my addr 172.21.15.17:0/3577494139 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 -- 172.21.15.17:0/3577494139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 msgr2=0x564df8db47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 -- 172.21.15.17:0/3577494139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 msgr2=0x564df8db0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8db0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.106+0000 7f9631d9b640 1 -- 172.21.15.17:0/3577494139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df8db3e90 con 0x564df8daeb40 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.107+0000 7f9631d9b640 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96340fe710 tx=0x7f96280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b88792d4b7d1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.107+0000 7f961bfff640 1 -- 172.21.15.17:0/3577494139 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628022430 con 0x564df8daeb40 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.107+0000 7f961bfff640 1 -- 172.21.15.17:0/3577494139 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9628022ab0 con 0x564df8daeb40 2024-09-10T11:47:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.107+0000 7f961bfff640 1 -- 172.21.15.17:0/3577494139 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628010be0 con 0x564df8daeb40 2024-09-10T11:47:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.107+0000 7f963b26e740 1 -- 172.21.15.17:0/3577494139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 msgr2=0x564df8db6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96340fe710 tx=0x7f96280046c0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- 172.21.15.17:0/3577494139 shutdown_connections 2024-09-10T11:47:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8daeb40 0x564df8db6e50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8db0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- 172.21.15.17:0/3577494139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8dad5d0 0x564df8db47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- 172.21.15.17:0/3577494139 >> 172.21.15.17:0/3577494139 conn(0x564df8d76310 msgr2=0x564df8db6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- 172.21.15.17:0/3577494139 shutdown_connections 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- 172.21.15.17:0/3577494139 wait complete. 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- start start 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 Processor -- start 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 0x564df8dbc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8daeb40 0x564df8dbc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96341a8400 con 0x564df8db8370 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f96341a7d00 con 0x564df8daeb40 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.108+0000 7f963b26e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9634071ed0 con 0x564df8dad5d0 2024-09-10T11:47:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f963b26e740 10 client.0 _ll_register_callbacks cb 0x7f962c005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f963259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 0x564df8dbc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f963259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 0x564df8dbc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52876/0 (socket says 172.21.15.17:52876) 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59254/0 (socket says 172.21.15.17:59254) 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f963259c640 1 -- 172.21.15.17:0/2086201935 learned_addr learned my addr 172.21.15.17:0/2086201935 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9631d9b640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8daeb40 0x564df8dbc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 -- 172.21.15.17:0/2086201935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 msgr2=0x564df8dbc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 0x564df8dbc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 -- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8daeb40 msgr2=0x564df8dbc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8daeb40 0x564df8dbc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 -- 172.21.15.17:0/2086201935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df8e31c20 con 0x564df8db8370 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9632d9d640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f962c098200 tx=0x7f962c09c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d968cd3b7c8eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9619ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c098040 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f962c0cf320 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.109+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9628022ab0 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.110+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f962c0a4a10 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.110+0000 7f963b26e740 10 client.15840 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.110+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564df8e32ed0 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.110+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f962c07e030 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f962c0863b0 con 0x564df8db8370 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 10 client.15840 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 10 client.15840 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 20 client.15840 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8e35410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 4 client.15840 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:47:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9628022ab0 con 0x564df8dc7f50 2024-09-10T11:47:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.111+0000 7f963259c640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8e35410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f9619ffb640 10 client.15840 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963259c640 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8e35410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61b9b12b4557e3ea server_cookie=e4d700feabac41ef in_seq=0 out_seq=0 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f9619ffb640 1 -- 172.21.15.17:0/2086201935 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9628022ab0 con 0x564df8dc7f50 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f9619ffb640 10 client.15840 handle_command_reply: tid=0 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 client.15840 shutdown 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 msgr2=0x564df8dbcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f962c098200 tx=0x7f962c09c4a0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 shutdown_connections 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x564df8dc7f50 0x564df8e35410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564df8db8370 0x564df8dbcd20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564df8daeb40 0x564df8dbc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 --2- 172.21.15.17:0/2086201935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564df8dad5d0 0x564df8dbc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 >> 172.21.15.17:0/2086201935 conn(0x564df8d76310 msgr2=0x564df8dc33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f9619ffb640 0 client.15840 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 shutdown_connections 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.112+0000 7f963b26e740 1 -- 172.21.15.17:0/2086201935 wait complete. 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f963b26e740 20 client.15840 trim_cache size 0 max 16384 2024-09-10T11:47:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 msgr2=0x7f961c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 0x7f961c0a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x564df8dae070 tx=0x7f9628005f90 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 msgr2=0x7f96340fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f96340fd700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f962c009fd0 tx=0x7f962c00ef10 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 shutdown_connections 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f961c0a2c00 0x7f961c0a50c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634102ef0 0x7f96340fd700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9634102570 0x7f96340fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 --2- 172.21.15.17:0/1571175839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9634100e20 0x7f96340fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.113+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 >> 172.21.15.17:0/1571175839 conn(0x7f96340fc7d0 msgr2=0x7f963406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.114+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 shutdown_connections 2024-09-10T11:47:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:32.114+0000 7f9638e95640 1 -- 172.21.15.17:0/1571175839 wait complete. 2024-09-10T11:47:32.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:47:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:33.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:33 smithi081 ceph-mon[35059]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 42 MiB/s wr, 7.10k op/s 2024-09-10T11:47:33.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:33 smithi026 ceph-mon[34817]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 42 MiB/s wr, 7.10k op/s 2024-09-10T11:47:33.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:33 smithi017 ceph-mon[30817]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 42 MiB/s wr, 7.10k op/s 2024-09-10T11:47:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 -- 172.21.15.17:0/3885951769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 msgr2=0x7fcd101089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 --2- 172.21.15.17:0/3885951769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd101089f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009900 tx=0x7fccfc02a410 comp rx=0 tx=0).stop 2024-09-10T11:47:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 -- 172.21.15.17:0/3885951769 shutdown_connections 2024-09-10T11:47:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 --2- 172.21.15.17:0/3885951769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd10110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 --2- 172.21.15.17:0/3885951769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd101089f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 --2- 172.21.15.17:0/3885951769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 -- 172.21.15.17:0/3885951769 >> 172.21.15.17:0/3885951769 conn(0x7fcd100ffa90 msgr2=0x7fcd10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 -- 172.21.15.17:0/3885951769 shutdown_connections 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.622+0000 7fcd17065640 1 -- 172.21.15.17:0/3885951769 wait complete. 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 Processor -- start 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 -- start start 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd1019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10114140 con 0x7fcd10109120 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10113fc0 con 0x7fcd101049a0 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd17065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101142c0 con 0x7fcd10103ff0 2024-09-10T11:47:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd15602640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd1019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd14e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd15602640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59282/0 (socket says 172.21.15.17:59282) 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd1019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38036/0 (socket says 172.21.15.17:38036) 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd15602640 1 -- 172.21.15.17:0/582604011 learned_addr learned my addr 172.21.15.17:0/582604011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.623+0000 7fcd14e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52888/0 (socket says 172.21.15.17:52888) 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 -- 172.21.15.17:0/582604011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 msgr2=0x7fcd1019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd1019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 -- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 msgr2=0x7fcd1019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 -- 172.21.15.17:0/582604011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1019f630 con 0x7fcd10103ff0 2024-09-10T11:47:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd15602640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd14e01640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400d720 tx=0x7fcd0400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd0dffb640 1 -- 172.21.15.17:0/582604011 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04017070 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd0dffb640 1 -- 172.21.15.17:0/582604011 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0400de30 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1019f920 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.624+0000 7fcd0dffb640 1 -- 172.21.15.17:0/582604011 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040047a0 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.625+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd101a7200 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.627+0000 7fcd0dffb640 1 -- 172.21.15.17:0/582604011 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd040099d0 con 0x7fcd10103ff0 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.627+0000 7fcd1943e740 1 Processor -- start 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.627+0000 7fcd1943e740 1 -- start start 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfe0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55defcf462f0 con 0x55defcfe05d0 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55defceedcf0 con 0x55defcfeb370 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd1943e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55defcf422b0 con 0x55defcfe1b40 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd14e01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfe0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52904/0 (socket says 172.21.15.17:52904) 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 -- 172.21.15.17:0/2495840644 learned_addr learned my addr 172.21.15.17:0/2495840644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 -- 172.21.15.17:0/2495840644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 msgr2=0x55defcfed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 -- 172.21.15.17:0/2495840644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 msgr2=0x55defcfe0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfe0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd15602640 1 -- 172.21.15.17:0/2495840644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55defced23a0 con 0x55defcfe1b40 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.628+0000 7fcd0dffb640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 0x7fcd000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fcd0dffb640 1 -- 172.21.15.17:0/582604011 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcd040cecf0 con 0x7fcd10103ff0 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fcd14e01640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 0x7fcd000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fcd15602640 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd08010810 tx=0x7fcd08010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24b73b52607d565 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fccfaffd640 1 -- 172.21.15.17:0/2495840644 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800eb30 con 0x55defcfe1b40 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fccfaffd640 1 -- 172.21.15.17:0/2495840644 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08015070 con 0x55defcfe1b40 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.629+0000 7fccfaffd640 1 -- 172.21.15.17:0/2495840644 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080116a0 con 0x55defcfe1b40 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- 172.21.15.17:0/2495840644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 msgr2=0x55defcfe0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd14e01640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 0x7fcd000a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd0409b260 tx=0x7fcd040d27c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd08010810 tx=0x7fcd08010cd0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- 172.21.15.17:0/2495840644 shutdown_connections 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfe0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 --2- 172.21.15.17:0/2495840644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe0090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- 172.21.15.17:0/2495840644 >> 172.21.15.17:0/2495840644 conn(0x55defcfa9310 msgr2=0x55defcfdcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- 172.21.15.17:0/2495840644 shutdown_connections 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- 172.21.15.17:0/2495840644 wait complete. 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 -- start start 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.630+0000 7fcd1943e740 1 Processor -- start 2024-09-10T11:47:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfeadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfe87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55defcfee070 con 0x55defcfe05d0 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55defcf01060 con 0x55defcfeb370 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55defcfee1f0 con 0x55defcfe1b40 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd1943e740 10 client.0 _ll_register_callbacks cb 0x55defcc548c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd15602640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfeadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52908/0 (socket says 172.21.15.17:52908) 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 -- 172.21.15.17:0/3485364657 learned_addr learned my addr 172.21.15.17:0/3485364657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd15602640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfe87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 -- 172.21.15.17:0/3485364657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 msgr2=0x55defcfe87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfe87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 -- 172.21.15.17:0/3485364657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 msgr2=0x55defcfeadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfeadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd0ffff640 1 -- 172.21.15.17:0/3485364657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55defccb73c0 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.631+0000 7fcd15602640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfeadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fccfc005940 tx=0x7fccfc031860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d643119e44b401 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcceffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc035070 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fccfc004240 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd08015070 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fccfc004440 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.632+0000 7fcd1943e740 10 client.25486 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55defcff9b60 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08015070 con 0x55defcfe1b40 2024-09-10T11:47:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fccfc004a90 con 0x55defcfe1b40 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 10 client.25486 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 10 client.25486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 20 client.25486 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defcffaf70 0x55defcffd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 4 client.25486 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55defcf53860 con 0x55defcffaf70 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.633+0000 7fcd15602640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defcffaf70 0x55defcffd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.634+0000 7fcd15602640 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defcffaf70 0x55defcffd360 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb6af373e7be0e0 server_cookie=a7fdb3c7625a169 in_seq=0 out_seq=0 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.634+0000 7fcceffff640 10 client.25486 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.634+0000 7fcceffff640 1 -- 172.21.15.17:0/3485364657 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55defcf53860 con 0x55defcffaf70 2024-09-10T11:47:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.634+0000 7fcceffff640 10 client.25486 handle_command_reply: tid=0 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.634+0000 7fcd1943e740 1 client.25486 shutdown 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 msgr2=0x55defcfe8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fccfc005940 tx=0x7fccfc031860 comp rx=0 tx=0).stop 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 shutdown_connections 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defcffaf70 0x55defcffd360 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe1b40 0x55defcfe8060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defcfe87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 --2- 172.21.15.17:0/3485364657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe05d0 0x55defcfeadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 >> 172.21.15.17:0/3485364657 conn(0x55defcfa9310 msgr2=0x55defcfe2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcceffff640 0 client.25486 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 shutdown_connections 2024-09-10T11:47:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 1 -- 172.21.15.17:0/3485364657 wait complete. 2024-09-10T11:47:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.635+0000 7fcd1943e740 20 client.25486 trim_cache size 0 max 16384 2024-09-10T11:47:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 Processor -- start 2024-09-10T11:47:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 -- start start 2024-09-10T11:47:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcfe7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defd003170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101af730 con 0x55defcfe1b40 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b12a0 con 0x55defcfeb370 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd1943e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101afe00 con 0x55defcfe05d0 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd15602640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defd003170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59298/0 (socket says 172.21.15.17:59298) 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd0ffff640 1 -- 172.21.15.17:0/709591348 learned_addr learned my addr 172.21.15.17:0/709591348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.651+0000 7fcd15602640 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcfe7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 -- 172.21.15.17:0/709591348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 msgr2=0x55defcfe7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcfe7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 -- 172.21.15.17:0/709591348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 msgr2=0x55defd003170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defd003170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 -- 172.21.15.17:0/709591348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55defcfdc4f0 con 0x55defcfe1b40 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fccfc000c00 tx=0x7fccfc0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80961723f93c2a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fcd15602640 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defd003170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fccfa7fc640 1 -- 172.21.15.17:0/709591348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc035070 con 0x55defcfe1b40 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fccfa7fc640 1 -- 172.21.15.17:0/709591348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccfc004ba0 con 0x55defcfe1b40 2024-09-10T11:47:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.652+0000 7fccfa7fc640 1 -- 172.21.15.17:0/709591348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc0054a0 con 0x55defcfe1b40 2024-09-10T11:47:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 -- 172.21.15.17:0/709591348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 msgr2=0x55defd002c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fccfc000c00 tx=0x7fccfc0317c0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 -- 172.21.15.17:0/709591348 shutdown_connections 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfeb370 0x55defd003170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfe1b40 0x55defd002c30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 --2- 172.21.15.17:0/709591348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcfe7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 -- 172.21.15.17:0/709591348 >> 172.21.15.17:0/709591348 conn(0x55defcfa9310 msgr2=0x55defcfe6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 -- 172.21.15.17:0/709591348 shutdown_connections 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.653+0000 7fcd1943e740 1 -- 172.21.15.17:0/709591348 wait complete. 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 -- start start 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 Processor -- start 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcff39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 0x55defcfeed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfeb370 0x55defcfef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b0bd0 con 0x55defcfeb370 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b04d0 con 0x55defcfe1b40 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101ad710 con 0x55defcfe05d0 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd1943e740 10 client.0 _ll_register_callbacks cb 0x7fccfc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.654+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 0x55defcfeed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcff39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 0x55defcfeed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38070/0 (socket says 172.21.15.17:38070) 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd0ffff640 1 -- 172.21.15.17:0/655192064 learned_addr learned my addr 172.21.15.17:0/655192064 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfeb370 0x55defcfef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 -- 172.21.15.17:0/655192064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 msgr2=0x55defcfeed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 0x55defcfeed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 -- 172.21.15.17:0/655192064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfeb370 msgr2=0x55defcfef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfeb370 0x55defcfef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 -- 172.21.15.17:0/655192064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55defcfef8f0 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd15602640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcff39f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd0801ae50 tx=0x7fcd08010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304fd3bed06ea72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcceffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08025040 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccfc004ba0 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.655+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcd08003b70 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcd08003d70 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 10 client.25492 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55defd065a10 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccfc004ba0 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fcd080042e0 con 0x55defcfe05d0 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 10 client.25492 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:33.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 20 client.25492 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defd065f90 0x55defd068380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 4 client.25492 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.656+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55defcf4dd70 con 0x55defd065f90 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defd065f90 0x55defd068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcd0ffff640 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defd065f90 0x55defd068380 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d1e99e8f3d602a server_cookie=ee37c814678619ea in_seq=0 out_seq=0 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcceffff640 10 client.25492 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcceffff640 1 -- 172.21.15.17:0/655192064 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55defcf4dd70 con 0x55defd065f90 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcceffff640 10 client.25492 handle_command_reply: tid=0 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.657+0000 7fcd1943e740 1 client.25492 shutdown 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 msgr2=0x55defcff39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcff39f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd0801ae50 tx=0x7fcd08010cd0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 shutdown_connections 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55defd065f90 0x55defd068380 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55defcfeb370 0x55defcfef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcceffff640 0 client.25492 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55defcfe1b40 0x55defcfeed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 --2- 172.21.15.17:0/655192064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55defcfe05d0 0x55defcff39f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 >> 172.21.15.17:0/655192064 conn(0x55defcfa9310 msgr2=0x55defcfe98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 shutdown_connections 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 1 -- 172.21.15.17:0/655192064 wait complete. 2024-09-10T11:47:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.658+0000 7fcd1943e740 20 client.25492 trim_cache size 0 max 16384 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 msgr2=0x7fcd000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 0x7fcd000a5040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd0409b260 tx=0x7fcd040d27c0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 msgr2=0x7fcd1019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400d720 tx=0x7fcd0400dbe0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 shutdown_connections 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd000a2b80 0x7fcd000a5040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10109120 0x7fcd1019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd101049a0 0x7fcd1019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 --2- 172.21.15.17:0/582604011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10103ff0 0x7fcd1019a680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 >> 172.21.15.17:0/582604011 conn(0x7fcd100ffa90 msgr2=0x7fcd10100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 shutdown_connections 2024-09-10T11:47:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:33.659+0000 7fcd17065640 1 -- 172.21.15.17:0/582604011 wait complete. 2024-09-10T11:47:35.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:35 smithi081 ceph-mon[35059]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.38k op/s 2024-09-10T11:47:35.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:35 smithi026 ceph-mon[34817]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.38k op/s 2024-09-10T11:47:35.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:35 smithi017 ceph-mon[30817]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 38 MiB/s wr, 6.38k op/s 2024-09-10T11:47:35.559 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:47:35.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:47:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:36.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 -- 172.21.15.17:0/2650127799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c102780 msgr2=0x7f662c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 --2- 172.21.15.17:0/2650127799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c102780 0x7f662c1067d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6620009ca0 tx=0x7f662002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 -- 172.21.15.17:0/2650127799 shutdown_connections 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 --2- 172.21.15.17:0/2650127799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c106f00 0x7f662c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 --2- 172.21.15.17:0/2650127799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c102780 0x7f662c1067d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 --2- 172.21.15.17:0/2650127799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c101dd0 0x7f662c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 -- 172.21.15.17:0/2650127799 >> 172.21.15.17:0/2650127799 conn(0x7f662c0fd8b0 msgr2=0x7f662c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 -- 172.21.15.17:0/2650127799 shutdown_connections 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.360+0000 7f663224b640 1 -- 172.21.15.17:0/2650127799 wait complete. 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.361+0000 7f663224b640 1 Processor -- start 2024-09-10T11:47:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.361+0000 7f663224b640 1 -- start start 2024-09-10T11:47:36.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 0x7f662c196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 0x7f662c196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f662c10fd50 con 0x7f662c101dd0 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f662c10fbd0 con 0x7f662c106f00 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f663224b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f662c10fed0 con 0x7f662c102780 2024-09-10T11:47:36.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 0x7f662c196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38100/0 (socket says 172.21.15.17:38100) 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 0x7f662c196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 -- 172.21.15.17:0/4102120294 learned_addr learned my addr 172.21.15.17:0/4102120294 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 0x7f662c196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59322/0 (socket says 172.21.15.17:59322) 2024-09-10T11:47:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 -- 172.21.15.17:0/4102120294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 msgr2=0x7f662c196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 0x7f662c196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 -- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 msgr2=0x7f662c196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.362+0000 7f662bfff640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 0x7f662c196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f662bfff640 1 -- 172.21.15.17:0/4102120294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c19b1f0 con 0x7f662c106f00 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f662affd640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 0x7f662c196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f662bfff640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f662400e970 tx=0x7f662400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f6628ff9640 1 -- 172.21.15.17:0/4102120294 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662400ccc0 con 0x7f662c106f00 2024-09-10T11:47:36.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c19b4e0 con 0x7f662c106f00 2024-09-10T11:47:36.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f6628ff9640 1 -- 172.21.15.17:0/4102120294 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f662400ce60 con 0x7f662c106f00 2024-09-10T11:47:36.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f6628ff9640 1 -- 172.21.15.17:0/4102120294 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624010490 con 0x7f662c106f00 2024-09-10T11:47:36.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.363+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c1a2dc0 con 0x7f662c106f00 2024-09-10T11:47:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.366+0000 7f6628ff9640 1 -- 172.21.15.17:0/4102120294 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6624005020 con 0x7f662c106f00 2024-09-10T11:47:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.366+0000 7f6634624740 1 Processor -- start 2024-09-10T11:47:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.366+0000 7f6634624740 1 -- start start 2024-09-10T11:47:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa608800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa60b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555efa563280 con 0x555efa608d40 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555efa50ab10 con 0x555efa5fdb60 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6634624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555efa55f240 con 0x555efa5fe480 2024-09-10T11:47:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38116/0 (socket says 172.21.15.17:38116) 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 -- 172.21.15.17:0/3126379192 learned_addr learned my addr 172.21.15.17:0/3126379192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa60b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662b7fe640 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa608800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f6628ff9640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 0x7f66140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 -- 172.21.15.17:0/3126379192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 msgr2=0x555efa608800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa608800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 -- 172.21.15.17:0/3126379192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 msgr2=0x555efa60b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa60b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.367+0000 7f662affd640 1 -- 172.21.15.17:0/3126379192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efa5171f0 con 0x555efa5fdb60 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f6628ff9640 1 -- 172.21.15.17:0/4102120294 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66240cf3d0 con 0x7f662c106f00 2024-09-10T11:47:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f662bfff640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 0x7f66140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f662affd640 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6620009430 tx=0x7f6620009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d9da29819daa21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f6611ffb640 1 -- 172.21.15.17:0/3126379192 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66200316a0 con 0x555efa5fdb60 2024-09-10T11:47:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f6611ffb640 1 -- 172.21.15.17:0/3126379192 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620036050 con 0x555efa5fdb60 2024-09-10T11:47:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f662bfff640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 0x7f66140a50c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66240980a0 tx=0x7f6624010670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.368+0000 7f6611ffb640 1 -- 172.21.15.17:0/3126379192 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662002fed0 con 0x555efa5fdb60 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- 172.21.15.17:0/3126379192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 msgr2=0x555efa5fdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6620009430 tx=0x7f6620009360 comp rx=0 tx=0).stop 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- 172.21.15.17:0/3126379192 shutdown_connections 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa608800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa60b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 --2- 172.21.15.17:0/3126379192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fdb60 0x555efa5fdf40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- 172.21.15.17:0/3126379192 >> 172.21.15.17:0/3126379192 conn(0x555efa5fa0f0 msgr2=0x555efa5fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- 172.21.15.17:0/3126379192 shutdown_connections 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- 172.21.15.17:0/3126379192 wait complete. 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.369+0000 7f6634624740 1 -- start start 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 Processor -- start 2024-09-10T11:47:36.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 0x555efa605c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa606180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa6066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555efa60b790 con 0x555efa5fdb60 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555efa51df10 con 0x555efa608d40 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555efa60b910 con 0x555efa5fe480 2024-09-10T11:47:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f6634624740 10 client.0 _ll_register_callbacks cb 0x555efa4e6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f662affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 0x555efa605c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f662affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 0x555efa605c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59344/0 (socket says 172.21.15.17:59344) 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f662b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa606180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f662affd640 1 -- 172.21.15.17:0/1353269193 learned_addr learned my addr 172.21.15.17:0/1353269193 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.370+0000 7f662affd640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa6066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 -- 172.21.15.17:0/1353269193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 msgr2=0x555efa6066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa6066c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 -- 172.21.15.17:0/1353269193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 msgr2=0x555efa605c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 0x555efa605c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 -- 172.21.15.17:0/1353269193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efa2d46a0 con 0x555efa5fe480 2024-09-10T11:47:36.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f662b7fe640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa606180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f661c00ffd0 tx=0x7f661c00ea30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c2d0f19b3c10a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f660affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c020070 con 0x555efa5fe480 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f661c004220 con 0x555efa5fe480 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6620036050 con 0x555efa5fe480 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f661c02b050 con 0x555efa5fe480 2024-09-10T11:47:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f6634624740 10 client.25504 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.371+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555efa617420 con 0x555efa5fe480 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620036050 con 0x555efa5fe480 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f661c0038d0 con 0x555efa5fe480 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 10 client.25504 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 10 client.25504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 20 client.25504 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa618880 0x555efa61ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 4 client.25504 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555efa5707f0 con 0x555efa618880 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f662affd640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa618880 0x555efa61ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.372+0000 7f660affd640 10 client.25504 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f662affd640 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa618880 0x555efa61ace0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6200295de9387a4b server_cookie=e64fc186e31982c1 in_seq=0 out_seq=0 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f660affd640 1 -- 172.21.15.17:0/1353269193 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555efa5707f0 con 0x555efa618880 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f660affd640 10 client.25504 handle_command_reply: tid=0 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 client.25504 shutdown 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 msgr2=0x555efa606180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa606180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f661c00ffd0 tx=0x7f661c00ea30 comp rx=0 tx=0).stop 2024-09-10T11:47:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 shutdown_connections 2024-09-10T11:47:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa618880 0x555efa61ace0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fe480 0x555efa606180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa6066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 --2- 172.21.15.17:0/1353269193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fdb60 0x555efa605c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f660affd640 0 client.25504 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.373+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 >> 172.21.15.17:0/1353269193 conn(0x555efa5fa0f0 msgr2=0x555efa5ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.374+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 shutdown_connections 2024-09-10T11:47:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.374+0000 7f6634624740 1 -- 172.21.15.17:0/1353269193 wait complete. 2024-09-10T11:47:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.374+0000 7f6634624740 20 client.25504 trim_cache size 0 max 16384 2024-09-10T11:47:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 Processor -- start 2024-09-10T11:47:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 -- start start 2024-09-10T11:47:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa6005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fe480 0x555efa6205b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa620af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1ab330 con 0x555efa608d40 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1acea0 con 0x555efa5fe480 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.395+0000 7f6634624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1aba00 con 0x555efa5fdb60 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa620af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa620af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59348/0 (socket says 172.21.15.17:59348) 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 -- 172.21.15.17:0/2752470735 learned_addr learned my addr 172.21.15.17:0/2752470735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662b7fe640 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fe480 0x555efa6205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa6005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 -- 172.21.15.17:0/2752470735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fe480 msgr2=0x555efa6205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fe480 0x555efa6205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 -- 172.21.15.17:0/2752470735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 msgr2=0x555efa620af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa620af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 -- 172.21.15.17:0/2752470735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efa5f9f20 con 0x555efa5fdb60 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f662affd640 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa6005c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66200098f0 tx=0x7f6620009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3655c06996405607 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.396+0000 7f66117fa640 1 -- 172.21.15.17:0/2752470735 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662005d070 con 0x555efa5fdb60 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.397+0000 7f66117fa640 1 -- 172.21.15.17:0/2752470735 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620036040 con 0x555efa5fdb60 2024-09-10T11:47:36.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.397+0000 7f66117fa640 1 -- 172.21.15.17:0/2752470735 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662002f960 con 0x555efa5fdb60 2024-09-10T11:47:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- 172.21.15.17:0/2752470735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 msgr2=0x555efa6005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa6005c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66200098f0 tx=0x7f6620009800 comp rx=0 tx=0).stop 2024-09-10T11:47:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- 172.21.15.17:0/2752470735 shutdown_connections 2024-09-10T11:47:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa608d40 0x555efa620af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa5fe480 0x555efa6205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 --2- 172.21.15.17:0/2752470735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa6005c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- 172.21.15.17:0/2752470735 >> 172.21.15.17:0/2752470735 conn(0x555efa5fa0f0 msgr2=0x555efa607bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- 172.21.15.17:0/2752470735 shutdown_connections 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- 172.21.15.17:0/2752470735 wait complete. 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.398+0000 7f6634624740 1 -- start start 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.399+0000 7f6634624740 1 Processor -- start 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.399+0000 7f6634624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.399+0000 7f6634624740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fe480 0x555efa60d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52976/0 (socket says 172.21.15.17:52976) 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f6634624740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa682580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f6634624740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1ac7d0 con 0x555efa5fe480 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f6634624740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1ac0d0 con 0x555efa608d40 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f6634624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1a9310 con 0x555efa5fdb60 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 -- 172.21.15.17:0/2090790968 learned_addr learned my addr 172.21.15.17:0/2090790968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f6634624740 10 client.0 _ll_register_callbacks cb 0x7f661c00fc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662b7fe640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fe480 0x555efa60d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa682580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 -- 172.21.15.17:0/2090790968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 msgr2=0x555efa682580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa682580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 -- 172.21.15.17:0/2090790968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fe480 msgr2=0x555efa60d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fe480 0x555efa60d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.400+0000 7f662affd640 1 -- 172.21.15.17:0/2090790968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555efa682af0 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f662affd640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6620031f80 tx=0x7f662002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3daf2a2479df08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f660affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662005d070 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6620036040 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6620003b70 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.401+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6620053040 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 10 client.25510 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555efa683e10 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6620036040 con 0x555efa5fdb60 2024-09-10T11:47:36.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f6620004290 con 0x555efa5fdb60 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 10 client.25510 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 10 client.25510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 20 client.25510 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa6841a0 0x555efa686590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 4 client.25510 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.402+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555efa56ad00 con 0x555efa6841a0 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.403+0000 7f662b7fe640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa6841a0 0x555efa686590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.403+0000 7f662b7fe640 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa6841a0 0x555efa686590 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35dc1f85b5c36948 server_cookie=18bf6dde1c8eb735 in_seq=0 out_seq=0 2024-09-10T11:47:36.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.403+0000 7f660affd640 10 client.25510 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.404+0000 7f660affd640 1 -- 172.21.15.17:0/2090790968 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555efa56ad00 con 0x555efa6841a0 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.404+0000 7f660affd640 10 client.25510 handle_command_reply: tid=0 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.404+0000 7f6634624740 1 client.25510 shutdown 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.404+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 msgr2=0x555efa60d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.404+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6620031f80 tx=0x7f662002a8c0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 shutdown_connections 2024-09-10T11:47:36.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x555efa6841a0 0x555efa686590 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555efa608d40 0x555efa682580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f660affd640 0 client.25510 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555efa5fe480 0x555efa60d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 --2- 172.21.15.17:0/2090790968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555efa5fdb60 0x555efa60d060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 >> 172.21.15.17:0/2090790968 conn(0x555efa5fa0f0 msgr2=0x555efa5f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 shutdown_connections 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 1 -- 172.21.15.17:0/2090790968 wait complete. 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.405+0000 7f6634624740 20 client.25510 trim_cache size 0 max 16384 2024-09-10T11:47:36.412 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:47:36.413 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:47:36.413 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "850f5b40-4385-4953-81c8-6543717b7c39", 2024-09-10T11:47:36.413 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:47:36.413 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 msgr2=0x7f66140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 0x7f66140a50c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66240980a0 tx=0x7f6624010670 comp rx=0 tx=0).stop 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 msgr2=0x7f662c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f662400e970 tx=0x7f662400ed70 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 shutdown_connections 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f66140a2c00 0x7f66140a50c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c102780 0x7f662c196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f662c106f00 0x7f662c19ab10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 --2- 172.21.15.17:0/4102120294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f662c101dd0 0x7f662c196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 >> 172.21.15.17:0/4102120294 conn(0x7f662c0fd8b0 msgr2=0x7f662c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 shutdown_connections 2024-09-10T11:47:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:36.406+0000 7f663224b640 1 -- 172.21.15.17:0/4102120294 wait complete. 2024-09-10T11:47:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 54 MiB/s wr, 9.10k op/s 2024-09-10T11:47:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:47:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:47:37.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:37 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 54 MiB/s wr, 9.10k op/s 2024-09-10T11:47:37.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:37 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 54 MiB/s wr, 9.10k op/s 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:37 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:47:37.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:47:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:47:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.666+0000 7f768a315640 1 -- 172.21.15.17:0/936332530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684100e20 msgr2=0x7f7684101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.666+0000 7f768a315640 1 --2- 172.21.15.17:0/936332530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684100e20 0x7f7684101200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7674009890 tx=0x7f767402a410 comp rx=0 tx=0).stop 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 -- 172.21.15.17:0/936332530 shutdown_connections 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 --2- 172.21.15.17:0/936332530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684102570 0x7f76841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 --2- 172.21.15.17:0/936332530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7684102ef0 0x7f768410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 --2- 172.21.15.17:0/936332530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684100e20 0x7f7684101200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 -- 172.21.15.17:0/936332530 >> 172.21.15.17:0/936332530 conn(0x7f76840fc7d0 msgr2=0x7f76840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 -- 172.21.15.17:0/936332530 shutdown_connections 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 -- 172.21.15.17:0/936332530 wait complete. 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.667+0000 7f768a315640 1 Processor -- start 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 -- start start 2024-09-10T11:47:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7684102570 0x7f7684197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 0x7f7684197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7684110fd0 con 0x7f7684102570 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7684110e50 con 0x7f7684102ef0 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f768a315640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7684111150 con 0x7f7684100e20 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f7683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f7683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52990/0 (socket says 172.21.15.17:52990) 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f7683fff640 1 -- 172.21.15.17:0/931720373 learned_addr learned my addr 172.21.15.17:0/931720373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.668+0000 7f76888b2640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 0x7f7684197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 -- 172.21.15.17:0/931720373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 msgr2=0x7f7684197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 0x7f7684197c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 -- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7684102570 msgr2=0x7f7684197710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:47:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7684102570 0x7f7684197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 -- 172.21.15.17:0/931720373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76841a6a40 con 0x7f7684100e20 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f76888b2640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 0x7f7684197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7683fff640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7674000c00 tx=0x7f76740309a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f7681ffb640 1 -- 172.21.15.17:0/931720373 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674040070 con 0x7f7684100e20 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76841a6cd0 con 0x7f7684100e20 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.669+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76841a71b0 con 0x7f7684100e20 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.670+0000 7f7681ffb640 1 -- 172.21.15.17:0/931720373 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76740055a0 con 0x7f7684100e20 2024-09-10T11:47:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.671+0000 7f7681ffb640 1 -- 172.21.15.17:0/931720373 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674040070 con 0x7f7684100e20 2024-09-10T11:47:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.674+0000 7f768c6ee740 1 Processor -- start 2024-09-10T11:47:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.674+0000 7f7681ffb640 1 -- 172.21.15.17:0/931720373 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7674043070 con 0x7f7684100e20 2024-09-10T11:47:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.674+0000 7f768c6ee740 1 -- start start 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.675+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.675+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af2dc0 0x563d42afd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.675+0000 7f76888b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.675+0000 7f76888b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53006/0 (socket says 172.21.15.17:53006) 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.675+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42affa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f767bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42affa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f76888b2640 1 -- 172.21.15.17:0/3604465954 learned_addr learned my addr 172.21.15.17:0/3604465954 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d42a582e0 con 0x563d42af2dc0 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563d429ffce0 con 0x563d42afd680 2024-09-10T11:47:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d42a542a0 con 0x563d42af24a0 2024-09-10T11:47:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.676+0000 7f7681ffb640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 0x7f76700a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 0x7f76700a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 -- 172.21.15.17:0/3604465954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 msgr2=0x563d42affa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42affa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 -- 172.21.15.17:0/3604465954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af2dc0 msgr2=0x563d42afd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af2dc0 0x563d42afd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 -- 172.21.15.17:0/3604465954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d429e4440 con 0x563d42af24a0 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f7681ffb640 1 -- 172.21.15.17:0/931720373 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7674004300 con 0x7f7684100e20 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.677+0000 7f76888b2640 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f767c009fd0 tx=0x7f767c013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6e0e613d2d848e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.678+0000 7f767a7fc640 1 -- 172.21.15.17:0/3604465954 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c00f8b0 con 0x563d42af24a0 2024-09-10T11:47:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.678+0000 7f76888b2640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 0x7f76700a5450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f767c01d000 tx=0x7f767c01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.678+0000 7f767a7fc640 1 -- 172.21.15.17:0/3604465954 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f767c022020 con 0x563d42af24a0 2024-09-10T11:47:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.678+0000 7f767a7fc640 1 -- 172.21.15.17:0/3604465954 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c010a00 con 0x563d42af24a0 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.679+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 msgr2=0x563d42af2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.679+0000 7f768c6ee740 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f767c009fd0 tx=0x7f767c013830 comp rx=0 tx=0).stop 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.679+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 shutdown_connections 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.679+0000 7f768c6ee740 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42affa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.679+0000 7f768c6ee740 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af2dc0 0x563d42afd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.680+0000 7f768c6ee740 1 --2- 172.21.15.17:0/3604465954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42af24a0 0x563d42af2880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.680+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 >> 172.21.15.17:0/3604465954 conn(0x563d42aeea30 msgr2=0x563d42aeee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.680+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 shutdown_connections 2024-09-10T11:47:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.680+0000 7f768c6ee740 1 -- 172.21.15.17:0/3604465954 wait complete. 2024-09-10T11:47:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.681+0000 7f768c6ee740 1 -- start start 2024-09-10T11:47:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.681+0000 7f768c6ee740 1 Processor -- start 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.682+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42afd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.682+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.682+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42afa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.682+0000 7f768c6ee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d42b00250 con 0x563d42af24a0 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f767bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f767bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38180/0 (socket says 172.21.15.17:38180) 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f767bfff640 1 -- 172.21.15.17:0/4267422 learned_addr learned my addr 172.21.15.17:0/4267422 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f76888b2640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42afa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f768c6ee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x563d42a13050 con 0x563d42af2dc0 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563d42b003d0 con 0x563d42afd680 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f768c6ee740 10 client.0 _ll_register_callbacks cb 0x563d42a53160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.683+0000 7f7683fff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42afd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 -- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 msgr2=0x563d42afa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42afa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 -- 172.21.15.17:0/4267422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 msgr2=0x563d42afd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42afd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 -- 172.21.15.17:0/4267422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d427c93c0 con 0x563d42af2dc0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f767bfff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f766c0116f0 tx=0x7f766c011bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd5f1f1b0a7d9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f76637fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c01e060 con 0x563d42af2dc0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.684+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f766c00fd70 con 0x563d42af2dc0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767c022020 con 0x563d42af2dc0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f766c019430 con 0x563d42af2dc0 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f768c6ee740 10 client.25553 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d42b0bd90 con 0x563d42af2dc0 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f766c019ab0 con 0x563d42af2dc0 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.685+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f766c011ce0 con 0x563d42af2dc0 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 10 client.25553 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 20 client.25553 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b0d240 0x563d42b0f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 4 client.25553 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f767c022020 con 0x563d42b0d240 2024-09-10T11:47:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.686+0000 7f7683fff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b0d240 0x563d42b0f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.687+0000 7f76637fe640 10 client.25553 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.687+0000 7f7683fff640 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b0d240 0x563d42b0f630 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20babdf585302e56 server_cookie=e4d63514c318924a in_seq=0 out_seq=0 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f76637fe640 1 -- 172.21.15.17:0/4267422 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f767c022020 con 0x563d42b0d240 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f76637fe640 10 client.25553 handle_command_reply: tid=0 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 client.25553 shutdown 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 msgr2=0x563d42afa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f766c0116f0 tx=0x7f766c011bb0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 shutdown_connections 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b0d240 0x563d42b0f630 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f76637fe640 0 client.25553 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.688+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42afa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af2dc0 0x563d42afa2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4267422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42afd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 >> 172.21.15.17:0/4267422 conn(0x563d42aeea30 msgr2=0x563d42af4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 shutdown_connections 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 1 -- 172.21.15.17:0/4267422 wait complete. 2024-09-10T11:47:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.689+0000 7f768c6ee740 20 client.25553 trim_cache size 0 max 16384 2024-09-10T11:47:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 Processor -- start 2024-09-10T11:47:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 -- start start 2024-09-10T11:47:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42b15400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f766400e400 con 0x563d42b0d240 2024-09-10T11:47:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f766400ff70 con 0x563d42af24a0 2024-09-10T11:47:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f768c6ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f766400ead0 con 0x563d42afd680 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f76888b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f7683fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.715+0000 7f76888b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59410/0 (socket says 172.21.15.17:59410) 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f76888b2640 1 -- 172.21.15.17:0/4289009250 learned_addr learned my addr 172.21.15.17:0/4289009250 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38182/0 (socket says 172.21.15.17:38182) 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f767bfff640 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42b15400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 -- 172.21.15.17:0/4289009250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 msgr2=0x563d42b15400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42b15400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 -- 172.21.15.17:0/4289009250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 msgr2=0x563d42af7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 -- 172.21.15.17:0/4289009250 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d42afb1b0 con 0x563d42af24a0 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f76888b2640 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7683fff640 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x563d42aef890 tx=0x7f76740ee040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899ebd3c02bb01c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7679ffb640 1 -- 172.21.15.17:0/4289009250 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674040040 con 0x563d42af24a0 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7679ffb640 1 -- 172.21.15.17:0/4289009250 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76740055a0 con 0x563d42af24a0 2024-09-10T11:47:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.716+0000 7f7679ffb640 1 -- 172.21.15.17:0/4289009250 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740b7d90 con 0x563d42af24a0 2024-09-10T11:47:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 -- 172.21.15.17:0/4289009250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 msgr2=0x563d42b14ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x563d42aef890 tx=0x7f76740ee040 comp rx=0 tx=0).stop 2024-09-10T11:47:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 -- 172.21.15.17:0/4289009250 shutdown_connections 2024-09-10T11:47:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42afd680 0x563d42b15400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42b0d240 0x563d42af7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 --2- 172.21.15.17:0/4289009250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42af24a0 0x563d42b14ec0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.717+0000 7f768c6ee740 1 -- 172.21.15.17:0/4289009250 >> 172.21.15.17:0/4289009250 conn(0x563d42aeea30 msgr2=0x563d42afc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.718+0000 7f768c6ee740 1 -- 172.21.15.17:0/4289009250 shutdown_connections 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.718+0000 7f768c6ee740 1 -- 172.21.15.17:0/4289009250 wait complete. 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.718+0000 7f768c6ee740 1 -- start start 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.718+0000 7f768c6ee740 1 Processor -- start 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42b03690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 0x563d42b04110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f766400f8a0 con 0x563d42af24a0 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f766400f1a0 con 0x563d42afd680 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f766400c3e0 con 0x563d42b0d240 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f768c6ee740 10 client.0 _ll_register_callbacks cb 0x7f766c009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f76888b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 0x563d42b04110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:38198/0 (socket says 172.21.15.17:38198) 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 -- 172.21.15.17:0/330804107 learned_addr learned my addr 172.21.15.17:0/330804107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f76888b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 0x563d42b04110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53048/0 (socket says 172.21.15.17:53048) 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f7683fff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42b03690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 -- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 msgr2=0x563d42b04110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 0x563d42b04110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 -- 172.21.15.17:0/330804107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 msgr2=0x563d42b03690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42b03690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 -- 172.21.15.17:0/330804107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d42b770f0 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f767bfff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f766c006010 tx=0x7f766c0094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebe404c1de8de86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.719+0000 7f76637fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c028080 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f766c00fd80 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76740055a0 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f766c00e3b0 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f768c6ee740 10 client.25559 fetch_fsmap learned FSMap version 36 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d42b783c0 con 0x563d42afd680 2024-09-10T11:47:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.720+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f766c00e550 con 0x563d42afd680 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f766c011ce0 con 0x563d42afd680 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 10 client.25559 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 20 client.25559 populate_metadata read hostname 'smithi017' 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b78b40 0x563d42b7af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 4 client.25559 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:47:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f76740055a0 con 0x563d42b78b40 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.721+0000 7f7683fff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b78b40 0x563d42b7af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f76637fe640 10 client.25559 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f7683fff640 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b78b40 0x563d42b7af60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ece71cdcc0b69a server_cookie=47bf82203cf34d71 in_seq=0 out_seq=0 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f76637fe640 1 -- 172.21.15.17:0/330804107 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f76740055a0 con 0x563d42b78b40 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f76637fe640 10 client.25559 handle_command_reply: tid=0 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 client.25559 shutdown 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 msgr2=0x563d42b03bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f766c006010 tx=0x7f766c0094c0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 shutdown_connections 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x563d42b78b40 0x563d42b7af60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563d42b0d240 0x563d42b04110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563d42afd680 0x563d42b03bd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 --2- 172.21.15.17:0/330804107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d42af24a0 0x563d42b03690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 >> 172.21.15.17:0/330804107 conn(0x563d42aeea30 msgr2=0x563d42aed370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.722+0000 7f76637fe640 0 client.25559 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "850f5b40-4385-4953-81c8-6543717b7c39": { 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "850f5b40-4385-4953-81c8-6543717b7c39", 2024-09-10T11:47:38.728 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:47:38.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:47:38.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:47:38.729 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:47:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.723+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 shutdown_connections 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.723+0000 7f768c6ee740 1 -- 172.21.15.17:0/330804107 wait complete. 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.723+0000 7f768c6ee740 20 client.25559 trim_cache size 0 max 16384 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 msgr2=0x7f76700a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 0x7f76700a5450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f767c01d000 tx=0x7f767c01f000 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 msgr2=0x7f76841971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7674000c00 tx=0x7f76740309a0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 shutdown_connections 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f76700a2f90 0x7f76700a5450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7684102ef0 0x7f7684197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7684102570 0x7f7684197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 --2- 172.21.15.17:0/931720373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7684100e20 0x7f76841971d0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7674000c00 tx=0x7f76740309a0 comp rx=0 tx=0).stop 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 >> 172.21.15.17:0/931720373 conn(0x7f76840fc7d0 msgr2=0x7f76840fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 shutdown_connections 2024-09-10T11:47:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:47:38.724+0000 7f768a315640 1 -- 172.21.15.17:0/931720373 wait complete. 2024-09-10T11:47:39.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:39 smithi081 ceph-mon[35059]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 38 MiB/s wr, 6.44k op/s 2024-09-10T11:47:39.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:39 smithi026 ceph-mon[34817]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 38 MiB/s wr, 6.44k op/s 2024-09-10T11:47:39.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:39 smithi017 ceph-mon[30817]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 9.9 KiB/s rd, 38 MiB/s wr, 6.44k op/s 2024-09-10T11:47:39.647 INFO:tasks.cephfs.filesystem:scrub status for tag:850f5b40-4385-4953-81c8-6543717b7c39 - {'path': '/', 'tag': '850f5b40-4385-4953-81c8-6543717b7c39', 'options': 'recursive,force'} 2024-09-10T11:47:41.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:41 smithi081 ceph-mon[35059]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 12 KiB/s rd, 39 MiB/s wr, 6.57k op/s 2024-09-10T11:47:41.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:41 smithi026 ceph-mon[34817]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 12 KiB/s rd, 39 MiB/s wr, 6.57k op/s 2024-09-10T11:47:41.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:41 smithi017 ceph-mon[30817]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 12 KiB/s rd, 39 MiB/s wr, 6.57k op/s 2024-09-10T11:47:43.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:43 smithi026 ceph-mon[34817]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 16 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-10T11:47:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:43 smithi017 ceph-mon[30817]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 16 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-10T11:47:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:43 smithi081 ceph-mon[35059]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 16 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-10T11:47:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:45 smithi026 ceph-mon[34817]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 6.17k op/s 2024-09-10T11:47:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:45 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:47:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:45 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:47:45.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:45 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:47:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:45 smithi017 ceph-mon[30817]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 6.17k op/s 2024-09-10T11:47:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:45 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:47:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:45 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:47:45.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:45 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:47:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:45 smithi081 ceph-mon[35059]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 6.17k op/s 2024-09-10T11:47:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:45 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:47:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:45 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:47:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:45 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:47:46.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:46 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:47:46.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:46 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:47:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:46 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:47:46.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:46 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:47:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:46 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:47:46.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:46 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:47:47.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:47 smithi026 ceph-mon[34817]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 64 MiB/s wr, 10.50k op/s 2024-09-10T11:47:47.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:47 smithi017 ceph-mon[30817]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 64 MiB/s wr, 10.50k op/s 2024-09-10T11:47:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:47 smithi081 ceph-mon[35059]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 64 MiB/s wr, 10.50k op/s 2024-09-10T11:47:49.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:49 smithi026 ceph-mon[34817]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 33 KiB/s rd, 62 MiB/s wr, 10.03k op/s 2024-09-10T11:47:49.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:49 smithi017 ceph-mon[30817]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 33 KiB/s rd, 62 MiB/s wr, 10.03k op/s 2024-09-10T11:47:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:49 smithi081 ceph-mon[35059]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 33 KiB/s rd, 62 MiB/s wr, 10.03k op/s 2024-09-10T11:47:51.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:51 smithi026 ceph-mon[34817]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 65 MiB/s wr, 10.39k op/s 2024-09-10T11:47:51.505 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:51 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:47:51.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:51 smithi017 ceph-mon[30817]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 65 MiB/s wr, 10.39k op/s 2024-09-10T11:47:51.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:51 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:47:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:51 smithi081 ceph-mon[35059]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 38 KiB/s rd, 65 MiB/s wr, 10.39k op/s 2024-09-10T11:47:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:51 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:47:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:47:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:47:52.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:47:52.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:47:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:47:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:47:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:47:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:47:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:47:53.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:53 smithi017 ceph-mon[30817]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 54 KiB/s rd, 105 MiB/s wr, 16.28k op/s 2024-09-10T11:47:53.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:53 smithi026 ceph-mon[34817]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 54 KiB/s rd, 105 MiB/s wr, 16.28k op/s 2024-09-10T11:47:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:53 smithi081 ceph-mon[35059]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 54 KiB/s rd, 105 MiB/s wr, 16.28k op/s 2024-09-10T11:47:55.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:55 smithi026 ceph-mon[34817]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 46 KiB/s rd, 92 MiB/s wr, 14.01k op/s 2024-09-10T11:47:55.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:55 smithi017 ceph-mon[30817]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 46 KiB/s rd, 92 MiB/s wr, 14.01k op/s 2024-09-10T11:47:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:55 smithi081 ceph-mon[35059]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 46 KiB/s rd, 92 MiB/s wr, 14.01k op/s 2024-09-10T11:47:57.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:57 smithi026 ceph-mon[34817]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 101 MiB/s wr, 15.44k op/s 2024-09-10T11:47:57.523 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:57 smithi017 ceph-mon[30817]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 101 MiB/s wr, 15.44k op/s 2024-09-10T11:47:57.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:57 smithi081 ceph-mon[35059]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 56 KiB/s rd, 101 MiB/s wr, 15.44k op/s 2024-09-10T11:47:59.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:47:59 smithi017 ceph-mon[30817]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 33 KiB/s rd, 81 MiB/s wr, 12.09k op/s 2024-09-10T11:47:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:47:59 smithi081 ceph-mon[35059]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 33 KiB/s rd, 81 MiB/s wr, 12.09k op/s 2024-09-10T11:47:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:47:59 smithi026 ceph-mon[34817]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 33 KiB/s rd, 81 MiB/s wr, 12.09k op/s 2024-09-10T11:48:01.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:01 smithi017 ceph-mon[30817]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 69 MiB/s wr, 10.20k op/s 2024-09-10T11:48:01.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:01 smithi081 ceph-mon[35059]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 69 MiB/s wr, 10.20k op/s 2024-09-10T11:48:01.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:01 smithi026 ceph-mon[34817]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 69 MiB/s wr, 10.20k op/s 2024-09-10T11:48:03.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:03 smithi017 ceph-mon[30817]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 77 MiB/s wr, 11.50k op/s 2024-09-10T11:48:03.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:03 smithi081 ceph-mon[35059]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 77 MiB/s wr, 11.50k op/s 2024-09-10T11:48:03.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:03 smithi026 ceph-mon[34817]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 36 KiB/s rd, 77 MiB/s wr, 11.50k op/s 2024-09-10T11:48:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:05 smithi017 ceph-mon[30817]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 5.38k op/s 2024-09-10T11:48:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:05 smithi081 ceph-mon[35059]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 5.38k op/s 2024-09-10T11:48:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:05 smithi026 ceph-mon[34817]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 5.38k op/s 2024-09-10T11:48:07.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:07 smithi017 ceph-mon[30817]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 44 MiB/s wr, 6.76k op/s 2024-09-10T11:48:07.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:07 smithi081 ceph-mon[35059]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 44 MiB/s wr, 6.76k op/s 2024-09-10T11:48:07.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:07 smithi026 ceph-mon[34817]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 23 KiB/s rd, 44 MiB/s wr, 6.76k op/s 2024-09-10T11:48:09.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:09 smithi017 ceph-mon[30817]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 6.39k op/s 2024-09-10T11:48:09.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:48:09.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:09 smithi081 ceph-mon[35059]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 6.39k op/s 2024-09-10T11:48:09.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:09 smithi026 ceph-mon[34817]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 6.39k op/s 2024-09-10T11:48:10.182 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 -- 172.21.15.17:0/4114320662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 msgr2=0x7f6d8010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 --2- 172.21.15.17:0/4114320662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8010da40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009ca0 tx=0x7f6d7802a970 comp rx=0 tx=0).stop 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 -- 172.21.15.17:0/4114320662 shutdown_connections 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 --2- 172.21.15.17:0/4114320662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80102570 0x7f6d801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 --2- 172.21.15.17:0/4114320662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8010da40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 --2- 172.21.15.17:0/4114320662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80100e20 0x7f6d80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.798+0000 7f6d885d6640 1 -- 172.21.15.17:0/4114320662 >> 172.21.15.17:0/4114320662 conn(0x7f6d800fc7d0 msgr2=0x7f6d800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.799+0000 7f6d885d6640 1 -- 172.21.15.17:0/4114320662 shutdown_connections 2024-09-10T11:48:10.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.799+0000 7f6d885d6640 1 -- 172.21.15.17:0/4114320662 wait complete. 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 Processor -- start 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 -- start start 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.800+0000 7f6d885d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801120e0 con 0x7f6d80102ef0 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d85b71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d885d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d80111f60 con 0x7f6d80102570 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d86372640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d885d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d80112260 con 0x7f6d80100e20 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d85b71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34262/0 (socket says 172.21.15.17:34262) 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d86372640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:37164/0 (socket says 172.21.15.17:37164) 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d85b71640 1 -- 172.21.15.17:0/2485446967 learned_addr learned my addr 172.21.15.17:0/2485446967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:10.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.801+0000 7f6d86b73640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 -- 172.21.15.17:0/2485446967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 msgr2=0x7f6d801982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 -- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 msgr2=0x7f6d8019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 -- 172.21.15.17:0/2485446967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8019d270 con 0x7f6d80102570 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d86372640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d85b71640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009f20 tx=0x7f6d7000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d777fe640 1 -- 172.21.15.17:0/2485446967 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70020070 con 0x7f6d80102570 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.802+0000 7f6d777fe640 1 -- 172.21.15.17:0/2485446967 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7000cd80 con 0x7f6d80102570 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.803+0000 7f6d777fe640 1 -- 172.21.15.17:0/2485446967 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7001bbb0 con 0x7f6d80102570 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.803+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8019d560 con 0x7f6d80102570 2024-09-10T11:48:10.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.803+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8010e100 con 0x7f6d80102570 2024-09-10T11:48:10.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.805+0000 7f6d777fe640 1 -- 172.21.15.17:0/2485446967 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6d70023070 con 0x7f6d80102570 2024-09-10T11:48:10.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 Processor -- start 2024-09-10T11:48:10.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 -- start start 2024-09-10T11:48:10.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d777fe640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 0x7f6d6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 0x560f772ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560f772062e0 con 0x560f772a0dc0 2024-09-10T11:48:10.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560f771adce0 con 0x560f772a04a0 2024-09-10T11:48:10.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560f772022a0 con 0x560f772ab680 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d86b73640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 0x7f6d6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.806+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d85b71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86b73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 0x560f772ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34278/0 (socket says 172.21.15.17:34278) 2024-09-10T11:48:10.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 -- 172.21.15.17:0/971620228 learned_addr learned my addr 172.21.15.17:0/971620228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d777fe640 1 -- 172.21.15.17:0/2485446967 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6d700d3230 con 0x7f6d80102570 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 -- 172.21.15.17:0/971620228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 msgr2=0x560f772ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 0x560f772ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 -- 172.21.15.17:0/971620228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 msgr2=0x560f772ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 -- 172.21.15.17:0/971620228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f77192440 con 0x560f772a04a0 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86b73640 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 0x560f772ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d85b71640 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86372640 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0115f0 tx=0x7f6d7c011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dae1b5e8c56598 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d86b73640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 0x7f6d6c0a50c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d780098d0 tx=0x7f6d7802fcb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.807+0000 7f6d74ff9640 1 -- 172.21.15.17:0/971620228 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01e070 con 0x560f772a04a0 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.808+0000 7f6d74ff9640 1 -- 172.21.15.17:0/971620228 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c00fb20 con 0x560f772a04a0 2024-09-10T11:48:10.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.808+0000 7f6d74ff9640 1 -- 172.21.15.17:0/971620228 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c019ca0 con 0x560f772a04a0 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 -- 172.21.15.17:0/971620228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 msgr2=0x560f772a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0115f0 tx=0x7f6d7c011ab0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 -- 172.21.15.17:0/971620228 shutdown_connections 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772ab680 0x560f772ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/971620228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772a0880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 -- 172.21.15.17:0/971620228 >> 172.21.15.17:0/971620228 conn(0x560f7729ca30 msgr2=0x560f7729ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 -- 172.21.15.17:0/971620228 shutdown_connections 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.809+0000 7f6d8a9af740 1 -- 172.21.15.17:0/971620228 wait complete. 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.810+0000 7f6d8a9af740 1 -- start start 2024-09-10T11:48:10.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.810+0000 7f6d8a9af740 1 Processor -- start 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.810+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a0dc0 0x560f772a8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560f772ae250 con 0x560f772ab680 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560f771c1050 con 0x560f772a04a0 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560f772ae3d0 con 0x560f772a0dc0 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d8a9af740 10 client.0 _ll_register_callbacks cb 0x560f77201160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34290/0 (socket says 172.21.15.17:34290) 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 -- 172.21.15.17:0/1301981674 learned_addr learned my addr 172.21.15.17:0/1301981674 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d85b71640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a0dc0 0x560f772a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 -- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a0dc0 msgr2=0x560f772a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a0dc0 0x560f772a8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 -- 172.21.15.17:0/1301981674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 msgr2=0x560f772a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.811+0000 7f6d86372640 1 -- 172.21.15.17:0/1301981674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f76f773c0 con 0x560f772a04a0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d86372640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00f8a0 tx=0x7f6d7c00f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d235182c6ebb2a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01e040 con 0x560f772a04a0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6d7c0199e0 con 0x560f772a04a0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d7c00fb20 con 0x560f772a04a0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6d7c019450 con 0x560f772a04a0 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d8a9af740 10 client.25571 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:10.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.812+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560f772b9b40 con 0x560f772a04a0 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c019be0 con 0x560f772a04a0 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f6d7c02a030 con 0x560f772a04a0 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 10 client.25571 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 10 client.25571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 20 client.25571 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f772bb000 0x560f772bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 4 client.25571 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6d7c00fb20 con 0x560f772bb000 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.813+0000 7f6d85b71640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f772bb000 0x560f772bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.815+0000 7f6d85b71640 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f772bb000 0x560f772bd3f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad1dbeefc3507e7e server_cookie=b948bd1547cb73f6 in_seq=0 out_seq=0 2024-09-10T11:48:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.815+0000 7f6d69ffb640 10 client.25571 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1301981674 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6d7c00fb20 con 0x560f772bb000 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d69ffb640 10 client.25571 handle_command_reply: tid=0 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 client.25571 shutdown 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 msgr2=0x560f772aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00f8a0 tx=0x7f6d7c00f8d0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 shutdown_connections 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f772bb000 0x560f772bd3f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d69ffb640 0 client.25571 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a0dc0 0x560f772a8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1301981674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a04a0 0x560f772aaf50 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00f8a0 tx=0x7f6d7c00f8d0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.816+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 >> 172.21.15.17:0/1301981674 conn(0x560f7729ca30 msgr2=0x560f7729bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.817+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 shutdown_connections 2024-09-10T11:48:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.817+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1301981674 wait complete. 2024-09-10T11:48:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.817+0000 7f6d8a9af740 20 client.25571 trim_cache size 0 max 16384 2024-09-10T11:48:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 Processor -- start 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 -- start start 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801ab3a0 con 0x560f772ab680 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.841+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801acf10 con 0x560f772a0dc0 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801aba70 con 0x560f772a71e0 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34292/0 (socket says 172.21.15.17:34292) 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 -- 172.21.15.17:0/3642828502 learned_addr learned my addr 172.21.15.17:0/3642828502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d85b71640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86b73640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 -- 172.21.15.17:0/3642828502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 msgr2=0x560f772c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 -- 172.21.15.17:0/3642828502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 msgr2=0x560f772a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 -- 172.21.15.17:0/3642828502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f772bd980 con 0x560f772a0dc0 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86b73640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d86372640 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0198d0 tx=0x7f6d7c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d944ecb89312462f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d6bfff640 1 -- 172.21.15.17:0/3642828502 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01e040 con 0x560f772a0dc0 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d6bfff640 1 -- 172.21.15.17:0/3642828502 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c015070 con 0x560f772a0dc0 2024-09-10T11:48:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.842+0000 7f6d6bfff640 1 -- 172.21.15.17:0/3642828502 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0050b0 con 0x560f772a0dc0 2024-09-10T11:48:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 -- 172.21.15.17:0/3642828502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 msgr2=0x560f772b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0198d0 tx=0x7f6d7c011440 comp rx=0 tx=0).stop 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 -- 172.21.15.17:0/3642828502 shutdown_connections 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772ab680 0x560f772a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/3642828502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772a0dc0 0x560f772b74e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 -- 172.21.15.17:0/3642828502 >> 172.21.15.17:0/3642828502 conn(0x560f7729ca30 msgr2=0x560f772a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.843+0000 7f6d8a9af740 1 -- 172.21.15.17:0/3642828502 shutdown_connections 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.844+0000 7f6d8a9af740 1 -- 172.21.15.17:0/3642828502 wait complete. 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.844+0000 7f6d8a9af740 1 -- start start 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.844+0000 7f6d8a9af740 1 Processor -- start 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.844+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.844+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d8a9af740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801ac840 con 0x560f772a0dc0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801ac140 con 0x560f772ab680 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d8a9af740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801a9380 con 0x560f772a71e0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d8a9af740 10 client.0 _ll_register_callbacks cb 0x7f6d7c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34306/0 (socket says 172.21.15.17:34306) 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 -- 172.21.15.17:0/1906313461 learned_addr learned my addr 172.21.15.17:0/1906313461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86372640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d85b71640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 -- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 msgr2=0x560f772af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 -- 172.21.15.17:0/1906313461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 msgr2=0x560f772b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 -- 172.21.15.17:0/1906313461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f772aff40 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86372640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d86b73640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009ca0 tx=0x7f6d78005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=342a8741d78297e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.845+0000 7f6d69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78034050 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6d78030bc0 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d7c015070 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6d7802fec0 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 10 client.25577 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560f77325c20 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c015070 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f6d78051020 con 0x560f772ab680 2024-09-10T11:48:10.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 10 client.25577 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 20 client.25577 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f773263a0 0x560f773287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 4 client.25577 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.846+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560f772a8ad0 con 0x560f773263a0 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.847+0000 7f6d86372640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f773263a0 0x560f773287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.847+0000 7f6d69ffb640 10 client.25577 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.847+0000 7f6d86372640 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f773263a0 0x560f773287c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1df61f019bb076 server_cookie=f6f05a9c5fdc162c in_seq=0 out_seq=0 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d69ffb640 1 -- 172.21.15.17:0/1906313461 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560f772a8ad0 con 0x560f773263a0 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d69ffb640 10 client.25577 handle_command_reply: tid=0 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 client.25577 shutdown 2024-09-10T11:48:10.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 msgr2=0x560f772af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009ca0 tx=0x7f6d78005fd0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 shutdown_connections 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x560f773263a0 0x560f773287c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560f772a71e0 0x560f772af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560f772ab680 0x560f772af710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d69ffb640 0 client.25577 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 --2- 172.21.15.17:0/1906313461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f772a0dc0 0x560f772b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 >> 172.21.15.17:0/1906313461 conn(0x560f7729ca30 msgr2=0x560f7729b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 shutdown_connections 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 1 -- 172.21.15.17:0/1906313461 wait complete. 2024-09-10T11:48:10.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.848+0000 7f6d8a9af740 20 client.25577 trim_cache size 0 max 16384 2024-09-10T11:48:10.855 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:48:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:48:10.855 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:48:10.855 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:48:10.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 msgr2=0x7f6d6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 0x7f6d6c0a50c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d780098d0 tx=0x7f6d7802fcb0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 msgr2=0x7f6d80198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:10.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009f20 tx=0x7f6d7000ee80 comp rx=0 tx=0).stop 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 shutdown_connections 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6d6c0a2c00 0x7f6d6c0a50c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d80102ef0 0x7f6d8019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d80102570 0x7f6d80198800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 --2- 172.21.15.17:0/2485446967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d80100e20 0x7f6d801982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.849+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 >> 172.21.15.17:0/2485446967 conn(0x7f6d800fc7d0 msgr2=0x7f6d800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.850+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 shutdown_connections 2024-09-10T11:48:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:10.850+0000 7f6d885d6640 1 -- 172.21.15.17:0/2485446967 wait complete. 2024-09-10T11:48:11.485 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:11 smithi017 ceph-mon[30817]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 5.66k op/s 2024-09-10T11:48:11.556 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:11 smithi026 ceph-mon[34817]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 5.66k op/s 2024-09-10T11:48:11.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:11 smithi081 ceph-mon[35059]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 5.66k op/s 2024-09-10T11:48:11.719 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:48:11.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:48:12.058 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:12.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 -- 172.21.15.17:0/353610960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 msgr2=0x7f300c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:12.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 --2- 172.21.15.17:0/353610960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c10df90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3000009860 tx=0x7f300002a340 comp rx=0 tx=0).stop 2024-09-10T11:48:12.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 -- 172.21.15.17:0/353610960 shutdown_connections 2024-09-10T11:48:12.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 --2- 172.21.15.17:0/353610960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c10df90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 --2- 172.21.15.17:0/353610960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c10e4d0 0x7f300c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.963+0000 7f3010ea3640 1 --2- 172.21.15.17:0/353610960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c1009b0 0x7f300c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.964+0000 7f3010ea3640 1 -- 172.21.15.17:0/353610960 >> 172.21.15.17:0/353610960 conn(0x7f300c0fc7d0 msgr2=0x7f300c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.964+0000 7f3010ea3640 1 -- 172.21.15.17:0/353610960 shutdown_connections 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.964+0000 7f3010ea3640 1 -- 172.21.15.17:0/353610960 wait complete. 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.964+0000 7f3010ea3640 1 Processor -- start 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.964+0000 7f3010ea3640 1 -- start start 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 0x7f300c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 0x7f300c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f300c114220 con 0x7f300c1009b0 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1140a0 con 0x7f300c10e4d0 2024-09-10T11:48:12.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3010ea3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f300c1143a0 con 0x7f300c101360 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 0x7f300c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3009d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3009d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c1a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49620/0 (socket says 172.21.15.17:49620) 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 0x7f300c1a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46506/0 (socket says 172.21.15.17:46506) 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f3009d9b640 1 -- 172.21.15.17:0/4188006934 learned_addr learned my addr 172.21.15.17:0/4188006934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 0x7f300c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 -- 172.21.15.17:0/4188006934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 msgr2=0x7f300c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 -- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 msgr2=0x7f300c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 0x7f300c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.965+0000 7f300ad9d640 1 -- 172.21.15.17:0/4188006934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c19ad00 con 0x7f300c10e4d0 2024-09-10T11:48:12.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f300ad9d640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 0x7f300c19a5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f300400efc0 tx=0x7f300400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:12.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004003970 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c19aff0 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3004004020 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c1a72e0 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.966+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300400b9f0 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.967+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c06a7f0 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.969+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f300401d020 con 0x7f300c10e4d0 2024-09-10T11:48:12.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.969+0000 7f2ffb7fe640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 0x7f2ff40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:12.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.970+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f30040cf470 con 0x7f300c10e4d0 2024-09-10T11:48:12.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.970+0000 7f300a59c640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 0x7f2ff40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:12.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.970+0000 7f300a59c640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 0x7f2ff40a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009bd0 tx=0x7f2ffc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:12.974+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f300409c3e0 con 0x7f300c10e4d0 2024-09-10T11:48:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.254+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f300c109660 con 0x7f300c10e4d0 2024-09-10T11:48:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.255+0000 7f2ffb7fe640 1 -- 172.21.15.17:0/4188006934 <== mon.2 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11957 (secure 0 0 0) 0x7f300409bce0 con 0x7f300c10e4d0 2024-09-10T11:48:13.257 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:48:13.257 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":36,"btime":"2024-09-10T11:46:50:979702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:46:50.016695+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:48:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 36 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 msgr2=0x7f2ff40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 0x7f2ff40a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009bd0 tx=0x7f2ffc005f90 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 msgr2=0x7f300c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 0x7f300c19a5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f300400efc0 tx=0x7f300400c800 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 shutdown_connections 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2ff40a2b80 0x7f2ff40a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f300c101360 0x7f300c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f300c10e4d0 0x7f300c19a5d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 --2- 172.21.15.17:0/4188006934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f300c1009b0 0x7f300c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:13.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.258+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 >> 172.21.15.17:0/4188006934 conn(0x7f300c0fc7d0 msgr2=0x7f300c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.259+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 shutdown_connections 2024-09-10T11:48:13.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:13.259+0000 7f3010ea3640 1 -- 172.21.15.17:0/4188006934 wait complete. 2024-09-10T11:48:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:13 smithi017 ceph-mon[30817]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 7.41k op/s 2024-09-10T11:48:13.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:13 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4188006934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:48:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:13 smithi081 ceph-mon[35059]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 7.41k op/s 2024-09-10T11:48:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:13 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4188006934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:48:13.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:13 smithi026 ceph-mon[34817]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 47 MiB/s wr, 7.41k op/s 2024-09-10T11:48:13.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:13 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4188006934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:48:14.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:48:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 -- 172.21.15.17:0/2432318425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 msgr2=0x7f676411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 --2- 172.21.15.17:0/2432318425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f676411d530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f675c009ca0 tx=0x7f675c02a8f0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 -- 172.21.15.17:0/2432318425 shutdown_connections 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 --2- 172.21.15.17:0/2432318425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6764109830 0x7f6764109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 --2- 172.21.15.17:0/2432318425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f676411d530 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 --2- 172.21.15.17:0/2432318425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6764109450 0x7f6764110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 -- 172.21.15.17:0/2432318425 >> 172.21.15.17:0/2432318425 conn(0x7f676406e140 msgr2=0x7f676406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 -- 172.21.15.17:0/2432318425 shutdown_connections 2024-09-10T11:48:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.960+0000 7f676a69e640 1 -- 172.21.15.17:0/2432318425 wait complete. 2024-09-10T11:48:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.961+0000 7f676a69e640 1 Processor -- start 2024-09-10T11:48:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.961+0000 7f676a69e640 1 -- start start 2024-09-10T11:48:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.961+0000 7f676a69e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6764109450 0x7f67641a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.961+0000 7f676a69e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6764109830 0x7f67641a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f676a69e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f676a69e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6764120e10 con 0x7f6764109450 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f676a69e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6764120c90 con 0x7f676411b140 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f676a69e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6764120f90 con 0x7f6764109830 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f6768c3b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f6768c3b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60752/0 (socket says 172.21.15.17:60752) 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.962+0000 7f6768c3b640 1 -- 172.21.15.17:0/3488729465 learned_addr learned my addr 172.21.15.17:0/3488729465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 -- 172.21.15.17:0/3488729465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6764109830 msgr2=0x7f67641a77d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6764109830 0x7f67641a77d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 -- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6764109450 msgr2=0x7f67641a7290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6764109450 0x7f67641a7290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 -- 172.21.15.17:0/3488729465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67641ac240 con 0x7f676411b140 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.963+0000 7f6768c3b640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f675c006010 tx=0x7f675c0316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.964+0000 7f67617fa640 1 -- 172.21.15.17:0/3488729465 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c031b50 con 0x7f676411b140 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.964+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67641ac4d0 con 0x7f676411b140 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.964+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676407a450 con 0x7f676411b140 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.964+0000 7f67617fa640 1 -- 172.21.15.17:0/3488729465 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f675c02d070 con 0x7f676411b140 2024-09-10T11:48:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.964+0000 7f67617fa640 1 -- 172.21.15.17:0/3488729465 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c030be0 con 0x7f676411b140 2024-09-10T11:48:14.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.968+0000 7f67617fa640 1 -- 172.21.15.17:0/3488729465 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f675c030d80 con 0x7f676411b140 2024-09-10T11:48:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.969+0000 7f67617fa640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 0x7f67500a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.970+0000 7f67617fa640 1 -- 172.21.15.17:0/3488729465 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f675c0f0500 con 0x7f676411b140 2024-09-10T11:48:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.973+0000 7f676ca77740 1 Processor -- start 2024-09-10T11:48:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.973+0000 7f676ca77740 1 -- start start 2024-09-10T11:48:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.973+0000 7f676ca77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 0x55b1d323f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f676ca77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d323fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f6763fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 0x55b1d323f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f6763fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 0x55b1d323f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49648/0 (socket says 172.21.15.17:49648) 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f6763fff640 1 -- 172.21.15.17:0/2888429533 learned_addr learned my addr 172.21.15.17:0/2888429533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f676ca77740 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 0x55b1d324c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1d31a52f0 con 0x55b1d323f5d0 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b1d314ccf0 con 0x55b1d324a370 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f6768c3b640 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 0x55b1d324c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1d31a12b0 con 0x55b1d3240b40 2024-09-10T11:48:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.974+0000 7f67637fe640 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d323fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.975+0000 7f6768c3b640 1 -- 172.21.15.17:0/2888429533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 msgr2=0x55b1d323f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.975+0000 7f6768c3b640 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 0x55b1d323f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.975+0000 7f6768c3b640 1 -- 172.21.15.17:0/2888429533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 msgr2=0x55b1d323fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:14.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.975+0000 7f6768c3b640 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d323fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.975+0000 7f6768c3b640 1 -- 172.21.15.17:0/2888429533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d31313a0 con 0x55b1d324a370 2024-09-10T11:48:14.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.976+0000 7f6763fff640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 0x7f67500a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.976+0000 7f6768c3b640 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 0x55b1d324c760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f675c0edfb0 tx=0x7f675c02a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efeaca8fff8a05db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:14.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.978+0000 7f6763fff640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 0x7f67500a5260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f674c008fd0 tx=0x7f674c0068f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.980+0000 7f675a7fc640 1 -- 172.21.15.17:0/2888429533 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0da070 con 0x55b1d324a370 2024-09-10T11:48:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.980+0000 7f675a7fc640 1 -- 172.21.15.17:0/2888429533 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f675c036030 con 0x55b1d324a370 2024-09-10T11:48:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.980+0000 7f675a7fc640 1 -- 172.21.15.17:0/2888429533 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0b9380 con 0x55b1d324a370 2024-09-10T11:48:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 msgr2=0x55b1d324c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 0x55b1d324c760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f675c0edfb0 tx=0x7f675c02a8f0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 shutdown_connections 2024-09-10T11:48:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d324a370 0x55b1d324c760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d323fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 --2- 172.21.15.17:0/2888429533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d3240b40 0x55b1d323f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 >> 172.21.15.17:0/2888429533 conn(0x55b1d3208310 msgr2=0x55b1d323bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 shutdown_connections 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.981+0000 7f676ca77740 1 -- 172.21.15.17:0/2888429533 wait complete. 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.982+0000 7f676ca77740 1 -- start start 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.983+0000 7f676ca77740 1 Processor -- start 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.983+0000 7f676ca77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.984+0000 7f6763fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.984+0000 7f6763fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60770/0 (socket says 172.21.15.17:60770) 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.984+0000 7f6763fff640 1 -- 172.21.15.17:0/1402947621 learned_addr learned my addr 172.21.15.17:0/1402947621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.984+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d3240b40 0x55b1d3246fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.985+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.985+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1d324ce30 con 0x55b1d3240b40 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.985+0000 7f6768c3b640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.985+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b1d3160060 con 0x55b1d323f5d0 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.985+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1d324cfb0 con 0x55b1d324a370 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f676ca77740 10 client.0 _ll_register_callbacks cb 0x55b1d2eb38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6763fff640 1 -- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 msgr2=0x55b1d32475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6763fff640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6763fff640 1 -- 172.21.15.17:0/1402947621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d3240b40 msgr2=0x55b1d3246fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6763fff640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d3240b40 0x55b1d3246fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6763fff640 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d2f163c0 con 0x55b1d323f5d0 2024-09-10T11:48:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.986+0000 7f6768c3b640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.987+0000 7f6763fff640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f674c00b0f0 tx=0x7f674c006880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30d87738e3cfcec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.988+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f675c036030 con 0x55b1d323f5d0 2024-09-10T11:48:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.988+0000 7f67437fe640 10 client.25595 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.988+0000 7f67437fe640 1 -- 172.21.15.17:0/1402947621 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c025060 con 0x55b1d323f5d0 2024-09-10T11:48:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.992+0000 7f67437fe640 1 -- 172.21.15.17:0/1402947621 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f674c016850 con 0x55b1d323f5d0 2024-09-10T11:48:14.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.992+0000 7f67437fe640 1 -- 172.21.15.17:0/1402947621 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f674c016a90 con 0x55b1d323f5d0 2024-09-10T11:48:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.994+0000 7f676ca77740 10 client.25595 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.994+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55b1d32588d0 con 0x55b1d323f5d0 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f67437fe640 1 -- 172.21.15.17:0/1402947621 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f674c01f030 con 0x55b1d323f5d0 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 10 client.25595 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 10 client.25595 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 20 client.25595 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d3259c70 0x55b1d325c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 4 client.25595 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:14.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.995+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f675c036030 con 0x55b1d3259c70 2024-09-10T11:48:15.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:14.997+0000 7f67637fe640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d3259c70 0x55b1d325c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.008+0000 7f67437fe640 10 client.25595 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:48:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.008+0000 7f67637fe640 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d3259c70 0x55b1d325c100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=131bcfddc169056d server_cookie=8bced008be3ed6e8 in_seq=0 out_seq=0 2024-09-10T11:48:15.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.010+0000 7f67437fe640 1 -- 172.21.15.17:0/1402947621 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f675c036030 con 0x55b1d3259c70 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.010+0000 7f67437fe640 10 client.25595 handle_command_reply: tid=0 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.010+0000 7f676ca77740 1 client.25595 shutdown 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 msgr2=0x55b1d3249d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f674c00b0f0 tx=0x7f674c006880 comp rx=0 tx=0).stop 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 shutdown_connections 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d3259c70 0x55b1d325c100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f67437fe640 0 client.25595 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d3240b40 0x55b1d3246fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 --2- 172.21.15.17:0/1402947621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d323f5d0 0x55b1d3249d30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.011+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 >> 172.21.15.17:0/1402947621 conn(0x55b1d3208310 msgr2=0x55b1d32419c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.012+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 shutdown_connections 2024-09-10T11:48:15.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.012+0000 7f676ca77740 1 -- 172.21.15.17:0/1402947621 wait complete. 2024-09-10T11:48:15.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.012+0000 7f676ca77740 20 client.25595 trim_cache size 0 max 16384 2024-09-10T11:48:15.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.053+0000 7f676ca77740 1 Processor -- start 2024-09-10T11:48:15.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.053+0000 7f676ca77740 1 -- start start 2024-09-10T11:48:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d3256130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d32468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f674400e3f0 con 0x55b1d323f5d0 2024-09-10T11:48:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f674400ff60 con 0x55b1d3240b40 2024-09-10T11:48:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.058+0000 7f676ca77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f674400eac0 con 0x55b1d324a370 2024-09-10T11:48:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.059+0000 7f6768c3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.059+0000 7f6763fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d3256130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.059+0000 7f6768c3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49662/0 (socket says 172.21.15.17:49662) 2024-09-10T11:48:15.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.059+0000 7f6768c3b640 1 -- 172.21.15.17:0/3553717001 learned_addr learned my addr 172.21.15.17:0/3553717001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f67637fe640 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d32468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f6763fff640 1 -- 172.21.15.17:0/3553717001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 msgr2=0x55b1d32418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f6763fff640 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f6763fff640 1 -- 172.21.15.17:0/3553717001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 msgr2=0x55b1d32468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f6763fff640 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d32468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.061+0000 7f6763fff640 1 -- 172.21.15.17:0/3553717001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d3245f90 con 0x55b1d323f5d0 2024-09-10T11:48:15.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.064+0000 7f6763fff640 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d3256130 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f674c005fd0 tx=0x7f674c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ded284f022e742f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:15.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.067+0000 7f6759ffb640 1 -- 172.21.15.17:0/3553717001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c01e2f0 con 0x55b1d323f5d0 2024-09-10T11:48:15.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.067+0000 7f6759ffb640 1 -- 172.21.15.17:0/3553717001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f674c01e970 con 0x55b1d323f5d0 2024-09-10T11:48:15.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.067+0000 7f6759ffb640 1 -- 172.21.15.17:0/3553717001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c02a7a0 con 0x55b1d323f5d0 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 -- 172.21.15.17:0/3553717001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 msgr2=0x55b1d3256130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d3256130 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f674c005fd0 tx=0x7f674c01a040 comp rx=0 tx=0).stop 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 -- 172.21.15.17:0/3553717001 shutdown_connections 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d324a370 0x55b1d32418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d32468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.068+0000 7f676ca77740 1 --2- 172.21.15.17:0/3553717001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d323f5d0 0x55b1d3256130 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.069+0000 7f676ca77740 1 -- 172.21.15.17:0/3553717001 >> 172.21.15.17:0/3553717001 conn(0x55b1d3208310 msgr2=0x55b1d32411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.072+0000 7f676ca77740 1 -- 172.21.15.17:0/3553717001 shutdown_connections 2024-09-10T11:48:15.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.072+0000 7f676ca77740 1 -- 172.21.15.17:0/3553717001 wait complete. 2024-09-10T11:48:15.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.072+0000 7f676ca77740 1 -- start start 2024-09-10T11:48:15.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.073+0000 7f676ca77740 1 Processor -- start 2024-09-10T11:48:15.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.073+0000 7f676ca77740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d323f5d0 0x55b1d324e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d324a370 0x55b1d32d49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f674400f890 con 0x55b1d324a370 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f674400f190 con 0x55b1d3240b40 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f674400c3d0 con 0x55b1d323f5d0 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.074+0000 7f676ca77740 10 client.0 _ll_register_callbacks cb 0x7f674c00ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.075+0000 7f67637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.075+0000 7f67637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60792/0 (socket says 172.21.15.17:60792) 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.075+0000 7f67637fe640 1 -- 172.21.15.17:0/2665746538 learned_addr learned my addr 172.21.15.17:0/2665746538 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.075+0000 7f6768c3b640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d324a370 0x55b1d32d49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.075+0000 7f6763fff640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d323f5d0 0x55b1d324e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 -- 172.21.15.17:0/2665746538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d323f5d0 msgr2=0x55b1d324e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d323f5d0 0x55b1d324e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 -- 172.21.15.17:0/2665746538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d324a370 msgr2=0x55b1d32d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d324a370 0x55b1d32d49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 -- 172.21.15.17:0/2665746538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d3247940 con 0x55b1d3240b40 2024-09-10T11:48:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67637fe640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f676411d8f0 tx=0x7f6754011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de87229379db3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.076+0000 7f67437fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754005070 con 0x55b1d3240b40 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f674c01e970 con 0x55b1d3240b40 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f6754005210 con 0x55b1d3240b40 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6754005410 con 0x55b1d3240b40 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f676ca77740 10 client.25601 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.077+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b1d32d6140 con 0x55b1d3240b40 2024-09-10T11:48:15.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.078+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f674c01e970 con 0x55b1d3240b40 2024-09-10T11:48:15.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.078+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f67540106c0 con 0x55b1d3240b40 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 10 client.25601 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 10 client.25601 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 20 client.25601 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d32d6870 0x55b1d32d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 4 client.25601 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1d31b2860 con 0x55b1d32d6870 2024-09-10T11:48:15.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.081+0000 7f6763fff640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d32d6870 0x55b1d32d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f6763fff640 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d32d6870 0x55b1d32d8c90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c8de514fd3faeaa server_cookie=e286663341295e3c in_seq=0 out_seq=0 2024-09-10T11:48:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f67437fe640 10 client.25601 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:48:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f67437fe640 1 -- 172.21.15.17:0/2665746538 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1d31b2860 con 0x55b1d32d6870 2024-09-10T11:48:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f67437fe640 10 client.25601 handle_command_reply: tid=0 2024-09-10T11:48:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f676ca77740 1 client.25601 shutdown 2024-09-10T11:48:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 msgr2=0x55b1d324ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.089+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f676411d8f0 tx=0x7f6754011810 comp rx=0 tx=0).stop 2024-09-10T11:48:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 shutdown_connections 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55b1d32d6870 0x55b1d32d8c90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d324a370 0x55b1d32d49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1d3240b40 0x55b1d324ecb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 --2- 172.21.15.17:0/2665746538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1d323f5d0 0x55b1d324e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 >> 172.21.15.17:0/2665746538 conn(0x55b1d3208310 msgr2=0x55b1d3248840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.090+0000 7f67437fe640 0 client.25601 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:48:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.091+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 shutdown_connections 2024-09-10T11:48:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.094+0000 7f676ca77740 1 -- 172.21.15.17:0/2665746538 wait complete. 2024-09-10T11:48:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.095+0000 7f676ca77740 20 client.25601 trim_cache size 0 max 16384 2024-09-10T11:48:15.099 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:48:15.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.098+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 msgr2=0x7f67500a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.098+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 0x7f67500a5260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f674c008fd0 tx=0x7f674c0068f0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.098+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 msgr2=0x7f67641abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:15.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.098+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f675c006010 tx=0x7f675c0316b0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 shutdown_connections 2024-09-10T11:48:15.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f67500a2da0 0x7f67500a5260 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6764109830 0x7f67641a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f676411b140 0x7f67641abb60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 --2- 172.21.15.17:0/3488729465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6764109450 0x7f67641a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 >> 172.21.15.17:0/3488729465 conn(0x7f676406e140 msgr2=0x7f676411be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.101+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 shutdown_connections 2024-09-10T11:48:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:15.104+0000 7f676a69e640 1 -- 172.21.15.17:0/3488729465 wait complete. 2024-09-10T11:48:15.378 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:15 smithi017 ceph-mon[30817]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 36 MiB/s wr, 5.65k op/s 2024-09-10T11:48:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:15 smithi081 ceph-mon[35059]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 36 MiB/s wr, 5.65k op/s 2024-09-10T11:48:15.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:15 smithi026 ceph-mon[34817]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1008 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 36 MiB/s wr, 5.65k op/s 2024-09-10T11:48:16.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:48:16.384 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:16.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/1013647424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 msgr2=0x7fa7ac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/1013647424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac10d950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009cd0 tx=0x7fa7a402a8e0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/1013647424 shutdown_connections 2024-09-10T11:48:16.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/1013647424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac100a80 0x7fa7ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/1013647424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac10d950 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/1013647424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac106a80 0x7fa7ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/1013647424 >> 172.21.15.17:0/1013647424 conn(0x7fa7ac0fc7a0 msgr2=0x7fa7ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/1013647424 shutdown_connections 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.905+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/1013647424 wait complete. 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 Processor -- start 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 -- start start 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 0x7fa7ac0fce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac106a80 0x7fa7ac0fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac110e80 con 0x7fa7ac101420 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac110d00 con 0x7fa7ac100a80 2024-09-10T11:48:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b2b3c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac111000 con 0x7fa7ac106a80 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7b08d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 0x7fa7ac0fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46556/0 (socket says 172.21.15.17:46556) 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.906+0000 7fa7abfff640 1 -- 172.21.15.17:0/3394777090 learned_addr learned my addr 172.21.15.17:0/3394777090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac106a80 0x7fa7ac0fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 -- 172.21.15.17:0/3394777090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac106a80 msgr2=0x7fa7ac0fd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac106a80 0x7fa7ac0fd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 -- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 msgr2=0x7fa7ac0fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 -- 172.21.15.17:0/3394777090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac1a68d0 con 0x7fa7ac100a80 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7abfff640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 0x7fa7ac0fce40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e9f0 tx=0x7fa7a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7a9ffb640 1 -- 172.21.15.17:0/3394777090 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000ccc0 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7a9ffb640 1 -- 172.21.15.17:0/3394777090 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7a0010910 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac1a6bc0 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.907+0000 7fa7a9ffb640 1 -- 172.21.15.17:0/3394777090 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0018960 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.908+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac1a7100 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.910+0000 7fa7a9ffb640 1 -- 172.21.15.17:0/3394777090 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa7a0010ac0 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 Processor -- start 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7a9ffb640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 0x7fa79c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 -- start start 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 0x7fa79c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7a9ffb640 1 -- 172.21.15.17:0/3394777090 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa7a00cf3a0 con 0x7fa7ac100a80 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803235b80 0x55d803237f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8031882f0 con 0x55d803223b40 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d80312fcf0 con 0x55d8032225d0 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.911+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8031842b0 con 0x55d803235b80 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7b08d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60814/0 (socket says 172.21.15.17:60814) 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7b08d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46562/0 (socket says 172.21.15.17:46562) 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 -- 172.21.15.17:0/1172459045 learned_addr learned my addr 172.21.15.17:0/1172459045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803235b80 0x55d803237f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 0x7fa79c0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4004ab0 tx=0x7fa7a4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 -- 172.21.15.17:0/1172459045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803235b80 msgr2=0x55d803237f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803235b80 0x55d803237f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 -- 172.21.15.17:0/1172459045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 msgr2=0x55d803222090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 -- 172.21.15.17:0/1172459045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8031143a0 con 0x55d8032225d0 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7980115f0 tx=0x7fa798011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf18faf1a5cd42c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.912+0000 7fa796ffd640 1 -- 172.21.15.17:0/1172459045 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79801e070 con 0x55d8032225d0 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.913+0000 7fa796ffd640 1 -- 172.21.15.17:0/1172459045 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa79800fba0 con 0x55d8032225d0 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.913+0000 7fa796ffd640 1 -- 172.21.15.17:0/1172459045 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798019d20 con 0x55d8032225d0 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1172459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 msgr2=0x55d803222a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7980115f0 tx=0x7fa798011ab0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1172459045 shutdown_connections 2024-09-10T11:48:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803235b80 0x55d803237f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803222a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1172459045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803222090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1172459045 >> 172.21.15.17:0/1172459045 conn(0x55d8031eb310 msgr2=0x55d80321ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1172459045 shutdown_connections 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1172459045 wait complete. 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 -- start start 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.914+0000 7fa7b4f15740 1 Processor -- start 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 0x55d803232820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d803232e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d803238880 con 0x55d803235b80 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d803143060 con 0x55d8032225d0 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d803238a00 con 0x55d803223b40 2024-09-10T11:48:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b4f15740 10 client.0 _ll_register_callbacks cb 0x55d802e968c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b08d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.915+0000 7fa7b08d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60824/0 (socket says 172.21.15.17:60824) 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 -- 172.21.15.17:0/1363301594 learned_addr learned my addr 172.21.15.17:0/1363301594 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 0x55d803232820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d803232e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 -- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 msgr2=0x55d803232820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 0x55d803232820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 -- 172.21.15.17:0/1363301594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 msgr2=0x55d803232e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d803232e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 -- 172.21.15.17:0/1363301594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d802ef93c0 con 0x55d8032225d0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d803232e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 0x55d803232820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00cce50 tx=0x7fa7a00a0020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d915167a8ab891c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa78bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00b2030 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.916+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa7a009b2c0 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa79800fba0 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa7a0010430 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa7b4f15740 10 client.25613 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d803244340 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7a00105d0 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.917+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fa7a0097a40 con 0x55d8032225d0 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 10 client.25613 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 10 client.25613 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 20 client.25613 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d803247b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 4 client.25613 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:16.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa79800fba0 con 0x55d803245750 2024-09-10T11:48:16.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.918+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d803247b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.919+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d803247b60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e926cc2cbfb58ba7 server_cookie=d121f272d2e45540 in_seq=0 out_seq=0 2024-09-10T11:48:16.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.919+0000 7fa78bfff640 10 client.25613 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.919+0000 7fa78bfff640 1 -- 172.21.15.17:0/1363301594 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa79800fba0 con 0x55d803245750 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.919+0000 7fa78bfff640 10 client.25613 handle_command_reply: tid=0 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 client.25613 shutdown 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 msgr2=0x55d803235520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00cce50 tx=0x7fa7a00a0020 comp rx=0 tx=0).stop 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 shutdown_connections 2024-09-10T11:48:16.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d803247b60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa78bfff640 0 client.25613 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d803223b40 0x55d803232820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d803232e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1363301594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d8032225d0 0x55d803235520 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 >> 172.21.15.17:0/1363301594 conn(0x55d8031eb310 msgr2=0x55d803224930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 shutdown_connections 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.920+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1363301594 wait complete. 2024-09-10T11:48:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.921+0000 7fa7b4f15740 20 client.25613 trim_cache size 0 max 16384 2024-09-10T11:48:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 Processor -- start 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 -- start start 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d803221f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803235b80 0x55d803236f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1ab370 con 0x55d803223b40 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1acee0 con 0x55d803235b80 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.938+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1aba40 con 0x55d8032225d0 2024-09-10T11:48:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46582/0 (socket says 172.21.15.17:46582) 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 -- 172.21.15.17:0/1395306989 learned_addr learned my addr 172.21.15.17:0/1395306989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7b10d9640 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803235b80 0x55d803236f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d803221f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 -- 172.21.15.17:0/1395306989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 msgr2=0x55d803221f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d803221f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 -- 172.21.15.17:0/1395306989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803235b80 msgr2=0x55d803236f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803235b80 0x55d803236f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 -- 172.21.15.17:0/1395306989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d803230d70 con 0x55d803223b40 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7abfff640 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55d80321fac0 tx=0x7fa798000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ad9e653240d26d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7967fc640 1 -- 172.21.15.17:0/1395306989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79801e040 con 0x55d803223b40 2024-09-10T11:48:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7967fc640 1 -- 172.21.15.17:0/1395306989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa798019930 con 0x55d803223b40 2024-09-10T11:48:16.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.939+0000 7fa7967fc640 1 -- 172.21.15.17:0/1395306989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7980053a0 con 0x55d803223b40 2024-09-10T11:48:16.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1395306989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 msgr2=0x55d803241b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55d80321fac0 tx=0x7fa798000bc0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1395306989 shutdown_connections 2024-09-10T11:48:16.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803235b80 0x55d803236f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803223b40 0x55d803241b50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/1395306989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d803221f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1395306989 >> 172.21.15.17:0/1395306989 conn(0x55d8031eb310 msgr2=0x55d8032310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1395306989 shutdown_connections 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- 172.21.15.17:0/1395306989 wait complete. 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.940+0000 7fa7b4f15740 1 -- start start 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 Processor -- start 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d80323e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d80324cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1ac810 con 0x55d803235b80 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1ac110 con 0x55d803223b40 2024-09-10T11:48:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1a9350 con 0x55d8032225d0 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b4f15740 10 client.0 _ll_register_callbacks cb 0x7fa7a0097f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b10d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d80324cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60838/0 (socket says 172.21.15.17:60838) 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 -- 172.21.15.17:0/919710265 learned_addr learned my addr 172.21.15.17:0/919710265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d80323e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 -- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 msgr2=0x55d80323e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d80323e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 -- 172.21.15.17:0/919710265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 msgr2=0x55d80324cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d80324cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.941+0000 7fa7abfff640 1 -- 172.21.15.17:0/919710265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80324d490 con 0x55d803223b40 2024-09-10T11:48:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa7abfff640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa798030040 tx=0x7fa798009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1689c053041f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa78bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79803d060 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa798016040 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa798019930 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa79801e040 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa7b4f15740 10 client.25619 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d80323d970 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.942+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa798019930 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fa798037070 con 0x55d803223b40 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 10 client.25619 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 10 client.25619 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 20 client.25619 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:16.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d8032b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 4 client.25619 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d803195860 con 0x55d803245750 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d8032b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa7b08d8640 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d8032b25f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d9cf72c81dd32c server_cookie=867cb67fb17254d9 in_seq=0 out_seq=0 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa78bfff640 10 client.25619 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.943+0000 7fa78bfff640 1 -- 172.21.15.17:0/919710265 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d803195860 con 0x55d803245750 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa78bfff640 10 client.25619 handle_command_reply: tid=0 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 client.25619 shutdown 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 msgr2=0x55d80323e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa798030040 tx=0x7fa798009ea0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 shutdown_connections 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55d803245750 0x55d8032b25f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d803235b80 0x55d80324cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d803223b40 0x55d80323e580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa78bfff640 0 client.25619 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 --2- 172.21.15.17:0/919710265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8032225d0 0x55d80323e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 >> 172.21.15.17:0/919710265 conn(0x55d8031eb310 msgr2=0x55d803230f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 shutdown_connections 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 1 -- 172.21.15.17:0/919710265 wait complete. 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.944+0000 7fa7b4f15740 20 client.25619 trim_cache size 0 max 16384 2024-09-10T11:48:16.951 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 msgr2=0x7fa79c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 0x7fa79c0a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4004ab0 tx=0x7fa7a4004a40 comp rx=0 tx=0).stop 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 msgr2=0x7fa7ac0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 0x7fa7ac0fce40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e9f0 tx=0x7fa7a000eeb0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 shutdown_connections 2024-09-10T11:48:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fa79c0a2b80 0x7fa79c0a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7ac106a80 0x7fa7ac0fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ac101420 0x7fa7ac0fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 --2- 172.21.15.17:0/3394777090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7ac100a80 0x7fa7ac0fce40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 >> 172.21.15.17:0/3394777090 conn(0x7fa7ac0fc7a0 msgr2=0x7fa7ac06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 shutdown_connections 2024-09-10T11:48:16.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:16.945+0000 7fa7b2b3c640 1 -- 172.21.15.17:0/3394777090 wait complete. 2024-09-10T11:48:17.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:17 smithi017 ceph-mon[30817]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 6.66k op/s 2024-09-10T11:48:17.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:17 smithi081 ceph-mon[35059]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 6.66k op/s 2024-09-10T11:48:17.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:17 smithi026 ceph-mon[34817]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 6.66k op/s 2024-09-10T11:48:18.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:48:18.993 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:19.295 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:19 smithi017 ceph-mon[30817]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 7.5 KiB/s rd, 38 MiB/s wr, 6.04k op/s 2024-09-10T11:48:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 -- 172.21.15.17:0/1061193055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 msgr2=0x7f34a011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 --2- 172.21.15.17:0/1061193055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a011d530 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3498009ca0 tx=0x7f349802a8f0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 -- 172.21.15.17:0/1061193055 shutdown_connections 2024-09-10T11:48:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 --2- 172.21.15.17:0/1061193055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a011d530 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 --2- 172.21.15.17:0/1061193055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a006ea30 0x7f34a006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 --2- 172.21.15.17:0/1061193055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a0110190 0x7f34a006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.572+0000 7f34a633b640 1 -- 172.21.15.17:0/1061193055 >> 172.21.15.17:0/1061193055 conn(0x7f34a0073180 msgr2=0x7f34a0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.573+0000 7f34a633b640 1 -- 172.21.15.17:0/1061193055 shutdown_connections 2024-09-10T11:48:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.573+0000 7f34a633b640 1 -- 172.21.15.17:0/1061193055 wait complete. 2024-09-10T11:48:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.575+0000 7f34a633b640 1 Processor -- start 2024-09-10T11:48:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.575+0000 7f34a633b640 1 -- start start 2024-09-10T11:48:19.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a006ea30 0x7f34a01a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a01ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0120b90 con 0x7f34a011b140 2024-09-10T11:48:19.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0120a10 con 0x7f34a0110190 2024-09-10T11:48:19.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.580+0000 7f34a633b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0120d10 con 0x7f34a006ea30 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60854/0 (socket says 172.21.15.17:60854) 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 -- 172.21.15.17:0/1504902178 learned_addr learned my addr 172.21.15.17:0/1504902178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a01ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 -- 172.21.15.17:0/1504902178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a006ea30 msgr2=0x7f34a01a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a006ea30 0x7f34a01a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 -- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 msgr2=0x7f34a01ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a01ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.581+0000 7f34a4b38640 1 -- 172.21.15.17:0/1504902178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a01ac040 con 0x7f34a0110190 2024-09-10T11:48:19.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.582+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d950 tx=0x7f349c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.582+0000 7f34967fc640 1 -- 172.21.15.17:0/1504902178 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c017070 con 0x7f34a0110190 2024-09-10T11:48:19.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.582+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a01ac330 con 0x7f34a0110190 2024-09-10T11:48:19.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.583+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a01b3c10 con 0x7f34a0110190 2024-09-10T11:48:19.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.583+0000 7f34967fc640 1 -- 172.21.15.17:0/1504902178 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c009c30 con 0x7f34a0110190 2024-09-10T11:48:19.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.583+0000 7f34967fc640 1 -- 172.21.15.17:0/1504902178 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c00f690 con 0x7f34a0110190 2024-09-10T11:48:19.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.596+0000 7f34967fc640 1 -- 172.21.15.17:0/1504902178 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f349c00f830 con 0x7f34a0110190 2024-09-10T11:48:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.597+0000 7f34967fc640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 0x7f348c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.597+0000 7f34967fc640 1 -- 172.21.15.17:0/1504902178 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f349c0cec30 con 0x7f34a0110190 2024-09-10T11:48:19.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.601+0000 7f34a9976740 1 Processor -- start 2024-09-10T11:48:19.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.603+0000 7f34a9976740 1 -- start start 2024-09-10T11:48:19.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.604+0000 7f34a9976740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.604+0000 7f34a9976740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bb0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.604+0000 7f34a9976740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.604+0000 7f34a9976740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3b162f0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.605+0000 7f34a5b3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.605+0000 7f34a5b3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49762/0 (socket says 172.21.15.17:49762) 2024-09-10T11:48:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.605+0000 7f34a5b3a640 1 -- 172.21.15.17:0/2972723050 learned_addr learned my addr 172.21.15.17:0/2972723050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.605+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3abdcf0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.605+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3b122b0 con 0x55b3e3bbb550 2024-09-10T11:48:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a4b38640 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bb0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a5b3a640 1 -- 172.21.15.17:0/2972723050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 msgr2=0x55b3e3bb0270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:48:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a5b3a640 1 -- 172.21.15.17:0/2972723050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 msgr2=0x55b3e3bb0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bb0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.606+0000 7f34a5b3a640 1 -- 172.21.15.17:0/2972723050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3e3aa23a0 con 0x55b3e3bbb550 2024-09-10T11:48:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.607+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3498009ca0 tx=0x7f3498005f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aedd4e67cb3e897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.608+0000 7f348b7fe640 1 -- 172.21.15.17:0/2972723050 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498031aa0 con 0x55b3e3bbb550 2024-09-10T11:48:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.608+0000 7f348b7fe640 1 -- 172.21.15.17:0/2972723050 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3498036040 con 0x55b3e3bbb550 2024-09-10T11:48:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 msgr2=0x55b3e3bbd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3498009ca0 tx=0x7f3498005f50 comp rx=0 tx=0).stop 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 shutdown_connections 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbd940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bb0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 --2- 172.21.15.17:0/2972723050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.609+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 >> 172.21.15.17:0/2972723050 conn(0x55b3e3b79310 msgr2=0x55b3e3bace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.612+0000 7f34a5339640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 0x7f348c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.612+0000 7f34a5339640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 0x7f348c0a5180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3490009a70 tx=0x7f3490009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.615+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 shutdown_connections 2024-09-10T11:48:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.615+0000 7f34a9976740 1 -- 172.21.15.17:0/2972723050 wait complete. 2024-09-10T11:48:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.616+0000 7f34a9976740 1 -- start start 2024-09-10T11:48:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.616+0000 7f34a9976740 1 Processor -- start 2024-09-10T11:48:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.617+0000 7f34a9976740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.617+0000 7f34a9976740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.617+0000 7f34a9976740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bb8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a9976740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3bbe1e0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60862/0 (socket says 172.21.15.17:60862) 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a4b38640 1 -- 172.21.15.17:0/1539614692 learned_addr learned my addr 172.21.15.17:0/1539614692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bb8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.618+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3ad1060 con 0x55b3e3bb1d20 2024-09-10T11:48:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.619+0000 7f34a5339640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.619+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3e3bbe360 con 0x55b3e3bbb550 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a9976740 10 client.0 _ll_register_callbacks cb 0x55b3e38248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a4b38640 1 -- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 msgr2=0x55b3e3bb8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bb8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a4b38640 1 -- 172.21.15.17:0/1539614692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 msgr2=0x55b3e3bbadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.620+0000 7f34a4b38640 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3e38873c0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.621+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f349c0a3b80 tx=0x7f349c09b320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=978bb015c97e8f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.622+0000 7f3488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.624+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c020040 con 0x55b3e3bb1d20 2024-09-10T11:48:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.624+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f349c0b4180 con 0x55b3e3bb1d20 2024-09-10T11:48:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.627+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3498036040 con 0x55b3e3bb1d20 2024-09-10T11:48:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.629+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f349c09f7f0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.629+0000 7f34a9976740 10 client.25628 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.629+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b3e3bc9be0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.631+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c0a40b0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.631+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f349c09a890 con 0x55b3e3bb1d20 2024-09-10T11:48:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.632+0000 7f34a9976740 10 client.25628 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a9976740 10 client.25628 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a9976740 20 client.25628 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3bcb5e0 0x55b3e3bcda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a9976740 4 client.25628 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3498036040 con 0x55b3e3bcb5e0 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.633+0000 7f34a5339640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3bcb5e0 0x55b3e3bcda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.634+0000 7f34a5339640 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3bcb5e0 0x55b3e3bcda00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4849b6fa9df264a8 server_cookie=9957ba0c3792960 in_seq=0 out_seq=0 2024-09-10T11:48:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.634+0000 7f3488ff9640 10 client.25628 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:48:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.635+0000 7f3488ff9640 1 -- 172.21.15.17:0/1539614692 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3498036040 con 0x55b3e3bcb5e0 2024-09-10T11:48:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.635+0000 7f3488ff9640 10 client.25628 handle_command_reply: tid=0 2024-09-10T11:48:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.635+0000 7f34a9976740 1 client.25628 shutdown 2024-09-10T11:48:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.636+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 msgr2=0x55b3e3bb80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.636+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f349c0a3b80 tx=0x7f349c09b320 comp rx=0 tx=0).stop 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 shutdown_connections 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3bcb5e0 0x55b3e3bcda00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bb8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bb80c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 --2- 172.21.15.17:0/1539614692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 >> 172.21.15.17:0/1539614692 conn(0x55b3e3b79310 msgr2=0x55b3e3bb2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f3488ff9640 0 client.25628 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:48:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 shutdown_connections 2024-09-10T11:48:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 1 -- 172.21.15.17:0/1539614692 wait complete. 2024-09-10T11:48:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.645+0000 7f34a9976740 20 client.25628 trim_cache size 0 max 16384 2024-09-10T11:48:19.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 Processor -- start 2024-09-10T11:48:19.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 -- start start 2024-09-10T11:48:19.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bc7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bd3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f348400e520 con 0x55b3e3bb07b0 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3484010090 con 0x55b3e3bb1d20 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a9976740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f348400ebf0 con 0x55b3e3bbb550 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a4b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60868/0 (socket says 172.21.15.17:60868) 2024-09-10T11:48:19.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.674+0000 7f34a4b38640 1 -- 172.21.15.17:0/1774664040 learned_addr learned my addr 172.21.15.17:0/1774664040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:19.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bd3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a4b38640 1 -- 172.21.15.17:0/1774664040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 msgr2=0x55b3e3bd3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bd3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a4b38640 1 -- 172.21.15.17:0/1774664040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 msgr2=0x55b3e3bc7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bc7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.676+0000 7f34a4b38640 1 -- 172.21.15.17:0/1774664040 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3e3bbdcb0 con 0x55b3e3bb1d20 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.680+0000 7f34a4b38640 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f349c09ad30 tx=0x7f349c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4def6ffc0dadaa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.680+0000 7f348affd640 1 -- 172.21.15.17:0/1774664040 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c020070 con 0x55b3e3bb1d20 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.681+0000 7f348affd640 1 -- 172.21.15.17:0/1774664040 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c09a890 con 0x55b3e3bb1d20 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 -- 172.21.15.17:0/1774664040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 msgr2=0x55b3e3bd3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f349c09ad30 tx=0x7f349c005880 comp rx=0 tx=0).stop 2024-09-10T11:48:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 -- 172.21.15.17:0/1774664040 shutdown_connections 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bbb550 0x55b3e3bd3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bb1d20 0x55b3e3bd3310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 --2- 172.21.15.17:0/1774664040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bc7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.682+0000 7f34a9976740 1 -- 172.21.15.17:0/1774664040 >> 172.21.15.17:0/1774664040 conn(0x55b3e3b79310 msgr2=0x55b3e3bb34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.684+0000 7f34a9976740 1 -- 172.21.15.17:0/1774664040 shutdown_connections 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.684+0000 7f34a9976740 1 -- 172.21.15.17:0/1774664040 wait complete. 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.684+0000 7f34a9976740 1 -- start start 2024-09-10T11:48:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 Processor -- start 2024-09-10T11:48:19.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bbf0e0 0x55b3e3c342d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f348400f9c0 con 0x55b3e3bbf0e0 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f348400f2c0 con 0x55b3e3bbb550 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f348400c500 con 0x55b3e3bb07b0 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.685+0000 7f34a9976740 10 client.0 _ll_register_callbacks cb 0x7f349c0bb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49806/0 (socket says 172.21.15.17:49806) 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 -- 172.21.15.17:0/329992699 learned_addr learned my addr 172.21.15.17:0/329992699 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5b3a640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bbf0e0 0x55b3e3c342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 -- 172.21.15.17:0/329992699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bbb550 msgr2=0x55b3e3bbeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 -- 172.21.15.17:0/329992699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bbf0e0 msgr2=0x55b3e3c342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bbf0e0 0x55b3e3c342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.686+0000 7f34a5339640 1 -- 172.21.15.17:0/329992699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3e3c349c0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.687+0000 7f34a5339640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f349000e720 tx=0x7f34900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b728f948e96b332b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.687+0000 7f3488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.687+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490025530 con 0x55b3e3bb07b0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.688+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3e3b23860 con 0x55b3e3bb07b0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.688+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f34900256d0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.688+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f34900258d0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.688+0000 7f34a9976740 10 client.25594 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.688+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b3e3c35dc0 con 0x55b3e3bb07b0 2024-09-10T11:48:19.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.690+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b3e3b23860 con 0x55b3e3bb07b0 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f349002ec50 con 0x55b3e3bb07b0 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 10 client.25594 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 10 client.25594 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 20 client.25594 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3c36550 0x55b3e3c38970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 4 client.25594 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:48:19.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.691+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3e3b1dd70 con 0x55b3e3c36550 2024-09-10T11:48:19.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.694+0000 7f34a4b38640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3c36550 0x55b3e3c38970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.695+0000 7f34a4b38640 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3c36550 0x55b3e3c38970 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f0a0aa23c58ac60 server_cookie=561ad4d71eacea11 in_seq=0 out_seq=0 2024-09-10T11:48:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.695+0000 7f3488ff9640 10 client.25594 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:48:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.695+0000 7f3488ff9640 1 -- 172.21.15.17:0/329992699 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3e3b1dd70 con 0x55b3e3c36550 2024-09-10T11:48:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.695+0000 7f3488ff9640 10 client.25594 handle_command_reply: tid=0 2024-09-10T11:48:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 client.25594 shutdown 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 msgr2=0x55b3e3bbe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f349000e720 tx=0x7f34900046c0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 shutdown_connections 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55b3e3c36550 0x55b3e3c38970 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3e3bbf0e0 0x55b3e3c342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b3e3bbb550 0x55b3e3bbeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 --2- 172.21.15.17:0/329992699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3e3bb07b0 0x55b3e3bbe660 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.696+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 >> 172.21.15.17:0/329992699 conn(0x55b3e3b79310 msgr2=0x55b3e3bb7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.697+0000 7f3488ff9640 0 client.25594 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:48:19.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:19 smithi081 ceph-mon[35059]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 7.5 KiB/s rd, 38 MiB/s wr, 6.04k op/s 2024-09-10T11:48:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.702+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 shutdown_connections 2024-09-10T11:48:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.702+0000 7f34a9976740 1 -- 172.21.15.17:0/329992699 wait complete. 2024-09-10T11:48:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.702+0000 7f34a9976740 20 client.25594 trim_cache size 0 max 16384 2024-09-10T11:48:19.704 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:48:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 msgr2=0x7f348c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 0x7f348c0a5180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3490009a70 tx=0x7f3490009530 comp rx=0 tx=0).stop 2024-09-10T11:48:19.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 msgr2=0x7f34a01a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d950 tx=0x7f349c00de10 comp rx=0 tx=0).stop 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 shutdown_connections 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f348c0a2cc0 0x7f348c0a5180 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3490009a70 tx=0x7f3490009530 comp rx=0 tx=0).stop 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a011b140 0x7f34a01ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34a0110190 0x7f34a01a75d0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d950 tx=0x7f349c00de10 comp rx=0 tx=0).stop 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 --2- 172.21.15.17:0/1504902178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a006ea30 0x7f34a01a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:19.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.707+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 >> 172.21.15.17:0/1504902178 conn(0x7f34a0073180 msgr2=0x7f34a0119350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:19.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.708+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 shutdown_connections 2024-09-10T11:48:19.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:19.708+0000 7f34a633b640 1 -- 172.21.15.17:0/1504902178 wait complete. 2024-09-10T11:48:19.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:19 smithi026 ceph-mon[34817]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 7.5 KiB/s rd, 38 MiB/s wr, 6.04k op/s 2024-09-10T11:48:20.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:48:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:21.546 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:21 smithi017 ceph-mon[30817]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 MiB/s wr, 5.16k op/s 2024-09-10T11:48:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 -- 172.21.15.17:0/2236635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f823410c180 msgr2=0x7f823410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 --2- 172.21.15.17:0/2236635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f823410c180 0x7f823410e600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f822c009be0 tx=0x7f822c02a750 comp rx=0 tx=0).stop 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 -- 172.21.15.17:0/2236635871 shutdown_connections 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 --2- 172.21.15.17:0/2236635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f823410c180 0x7f823410e600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 --2- 172.21.15.17:0/2236635871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82341036c0 0x7f823410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 --2- 172.21.15.17:0/2236635871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234102da0 0x7f8234103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.647+0000 7f8239ba0640 1 -- 172.21.15.17:0/2236635871 >> 172.21.15.17:0/2236635871 conn(0x7f82340fc7a0 msgr2=0x7f82340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.648+0000 7f8239ba0640 1 -- 172.21.15.17:0/2236635871 shutdown_connections 2024-09-10T11:48:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.648+0000 7f8239ba0640 1 -- 172.21.15.17:0/2236635871 wait complete. 2024-09-10T11:48:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 Processor -- start 2024-09-10T11:48:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 -- start start 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82341036c0 0x7f823419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 0x7f823419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8234111f10 con 0x7f8234102da0 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8234111d90 con 0x7f82341036c0 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f8239ba0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8234112090 con 0x7f823410c180 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f82337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.649+0000 7f82337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48070/0 (socket says 172.21.15.17:48070) 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f8233fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 0x7f823419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f822bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82341036c0 0x7f823419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 -- 172.21.15.17:0/824355747 learned_addr learned my addr 172.21.15.17:0/824355747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 -- 172.21.15.17:0/824355747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 msgr2=0x7f823419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 0x7f823419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 -- 172.21.15.17:0/824355747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82341036c0 msgr2=0x7f823419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82341036c0 0x7f823419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 -- 172.21.15.17:0/824355747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823419f5a0 con 0x7f8234102da0 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f8233fff640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 0x7f823419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82337fe640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9f0 tx=0x7f822400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82317fa640 1 -- 172.21.15.17:0/824355747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822400cd80 con 0x7f8234102da0 2024-09-10T11:48:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823419f890 con 0x7f8234102da0 2024-09-10T11:48:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.650+0000 7f82317fa640 1 -- 172.21.15.17:0/824355747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8224005500 con 0x7f8234102da0 2024-09-10T11:48:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.651+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82341a7170 con 0x7f8234102da0 2024-09-10T11:48:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.651+0000 7f82317fa640 1 -- 172.21.15.17:0/824355747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224021640 con 0x7f8234102da0 2024-09-10T11:48:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.654+0000 7f823bf79740 1 Processor -- start 2024-09-10T11:48:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.654+0000 7f823bf79740 1 -- start start 2024-09-10T11:48:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.654+0000 7f823bf79740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb44d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f823bf79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb44e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f823bf79740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 0x55b7cb45af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f823bf79740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb3ab2f0 con 0x55b7cb44f350 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f823bf79740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb352cf0 con 0x55b7cb458b80 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f823bf79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb3a72b0 con 0x55b7cb44dde0 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f822bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 0x55b7cb45af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f822bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 0x55b7cb45af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43950/0 (socket says 172.21.15.17:43950) 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f822bfff640 1 -- 172.21.15.17:0/3943316356 learned_addr learned my addr 172.21.15.17:0/3943316356 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f8233fff640 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb44d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.655+0000 7f82317fa640 1 -- 172.21.15.17:0/824355747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8224005020 con 0x7f8234102da0 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 -- 172.21.15.17:0/3943316356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 msgr2=0x55b7cb44e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f82337fe640 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb44e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb44e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 -- 172.21.15.17:0/3943316356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 msgr2=0x55b7cb45af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 0x55b7cb45af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 -- 172.21.15.17:0/3943316356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cb3373a0 con 0x55b7cb44f350 2024-09-10T11:48:21.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8233fff640 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb44d8a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f822c02ac70 tx=0x7f822c005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d874ec4666b7ce66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.656+0000 7f8229ffb640 1 -- 172.21.15.17:0/3943316356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c042030 con 0x55b7cb44f350 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.657+0000 7f82317fa640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 0x7f82200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.657+0000 7f8229ffb640 1 -- 172.21.15.17:0/3943316356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f822c037040 con 0x55b7cb44f350 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.657+0000 7f8229ffb640 1 -- 172.21.15.17:0/3943316356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c036070 con 0x55b7cb44f350 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.657+0000 7f82317fa640 1 -- 172.21.15.17:0/824355747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f82240cf490 con 0x7f8234102da0 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.657+0000 7f82337fe640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 0x7f82200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- 172.21.15.17:0/3943316356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 msgr2=0x55b7cb44d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb44d8a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f822c02ac70 tx=0x7f822c005c70 comp rx=0 tx=0).stop 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f82337fe640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 0x7f82200a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8224098670 tx=0x7f8224004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- 172.21.15.17:0/3943316356 shutdown_connections 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb44e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb458b80 0x55b7cb45af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 --2- 172.21.15.17:0/3943316356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb44d8a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- 172.21.15.17:0/3943316356 >> 172.21.15.17:0/3943316356 conn(0x55b7cb40e310 msgr2=0x55b7cb44a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- 172.21.15.17:0/3943316356 shutdown_connections 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- 172.21.15.17:0/3943316356 wait complete. 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.658+0000 7f823bf79740 1 -- start start 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 Processor -- start 2024-09-10T11:48:21.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb455830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb458b80 0x55b7cb455e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb45b820 con 0x55b7cb458b80 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb366060 con 0x55b7cb44f350 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7cb45b9a0 con 0x55b7cb44dde0 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f823bf79740 10 client.0 _ll_register_callbacks cb 0x55b7cb0b98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f8233fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f8233fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:39322/0 (socket says 172.21.15.17:39322) 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f8233fff640 1 -- 172.21.15.17:0/769324244 learned_addr learned my addr 172.21.15.17:0/769324244 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f822bfff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb455830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.659+0000 7f8233fff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb458b80 0x55b7cb455e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 -- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 msgr2=0x55b7cb455830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb455830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 -- 172.21.15.17:0/769324244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb458b80 msgr2=0x55b7cb455e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb458b80 0x55b7cb455e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 -- 172.21.15.17:0/769324244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cb11c3c0 con 0x55b7cb44dde0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8233fff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f822c031040 tx=0x7f822c02a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b91967a984aabf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c036050 con 0x55b7cb44dde0 2024-09-10T11:48:21.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f822c030710 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f822c037040 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f822c042040 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f823bf79740 10 client.25603 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.660+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b7cb45b820 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f822c037040 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f822c03c040 con 0x55b7cb44dde0 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 10 client.25603 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 10 client.25603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 20 client.25603 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb46a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 4 client.25603 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:21.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7cb3b8860 con 0x55b7cb468470 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.661+0000 7f822bfff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb46a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.662+0000 7f822bfff640 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb46a860 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21f75507e20210ce server_cookie=95b42d8bf9663392 in_seq=0 out_seq=0 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.662+0000 7f8212ffd640 10 client.25603 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f8212ffd640 1 -- 172.21.15.17:0/769324244 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7cb3b8860 con 0x55b7cb468470 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f8212ffd640 10 client.25603 handle_command_reply: tid=0 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 client.25603 shutdown 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 msgr2=0x55b7cb458580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f822c031040 tx=0x7f822c02a750 comp rx=0 tx=0).stop 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 shutdown_connections 2024-09-10T11:48:21.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb46a860 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f8212ffd640 0 client.25603 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb458b80 0x55b7cb455e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb455830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 --2- 172.21.15.17:0/769324244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb44dde0 0x55b7cb458580 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.663+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 >> 172.21.15.17:0/769324244 conn(0x55b7cb40e310 msgr2=0x55b7cb450140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.664+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 shutdown_connections 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.664+0000 7f823bf79740 1 -- 172.21.15.17:0/769324244 wait complete. 2024-09-10T11:48:21.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.664+0000 7f823bf79740 20 client.25603 trim_cache size 0 max 16384 2024-09-10T11:48:21.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.682+0000 7f823bf79740 1 Processor -- start 2024-09-10T11:48:21.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.682+0000 7f823bf79740 1 -- start start 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 0x55b7cb464af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f8233fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 0x55b7cb464af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f8233fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 0x55b7cb464af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48096/0 (socket says 172.21.15.17:48096) 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f8233fff640 1 -- 172.21.15.17:0/987031727 learned_addr learned my addr 172.21.15.17:0/987031727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb450030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb470070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ab1f0 con 0x55b7cb44dde0 2024-09-10T11:48:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f82341acd60 con 0x55b7cb44f350 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ab8c0 con 0x55b7cb458b80 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f822bfff640 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb450030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f822bfff640 1 -- 172.21.15.17:0/987031727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 msgr2=0x55b7cb470070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.683+0000 7f822bfff640 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb470070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f822bfff640 1 -- 172.21.15.17:0/987031727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 msgr2=0x55b7cb464af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f822bfff640 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 0x55b7cb464af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f822bfff640 1 -- 172.21.15.17:0/987031727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cb453d80 con 0x55b7cb44f350 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f822bfff640 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb450030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55b7cb456e70 tx=0x7f821c014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4697dd8221aff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f82297fa640 1 -- 172.21.15.17:0/987031727 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c022070 con 0x55b7cb44f350 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f82297fa640 1 -- 172.21.15.17:0/987031727 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c005500 con 0x55b7cb44f350 2024-09-10T11:48:21.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.684+0000 7f82297fa640 1 -- 172.21.15.17:0/987031727 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c004d40 con 0x55b7cb44f350 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 msgr2=0x55b7cb450030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb450030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55b7cb456e70 tx=0x7f821c014040 comp rx=0 tx=0).stop 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 shutdown_connections 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb470070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44f350 0x55b7cb450030 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 --2- 172.21.15.17:0/987031727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44dde0 0x55b7cb464af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 >> 172.21.15.17:0/987031727 conn(0x55b7cb40e310 msgr2=0x55b7cb44f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 shutdown_connections 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.685+0000 7f823bf79740 1 -- 172.21.15.17:0/987031727 wait complete. 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.686+0000 7f823bf79740 1 -- start start 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.686+0000 7f823bf79740 1 Processor -- start 2024-09-10T11:48:21.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb45d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ac690 con 0x55b7cb44f350 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f82341abf90 con 0x55b7cb44dde0 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82341a9230 con 0x55b7cb458b80 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f823bf79740 10 client.0 _ll_register_callbacks cb 0x7f821c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f822bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f822bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48098/0 (socket says 172.21.15.17:48098) 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:43984/0 (socket says 172.21.15.17:43984) 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f822bfff640 1 -- 172.21.15.17:0/1112569554 learned_addr learned my addr 172.21.15.17:0/1112569554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb45d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 -- 172.21.15.17:0/1112569554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 msgr2=0x55b7cb45d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb45d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 -- 172.21.15.17:0/1112569554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 msgr2=0x55b7cb45cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 -- 172.21.15.17:0/1112569554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cb4d2040 con 0x55b7cb44dde0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f822bfff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8233fff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f822c0314a0 tx=0x7f822c02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a17fcbcd1462f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.687+0000 7f8212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c036040 con 0x55b7cb44dde0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c005500 con 0x55b7cb44dde0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f822c050040 con 0x55b7cb44dde0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f822c003bf0 con 0x55b7cb44dde0 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 10 client.25649 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:21.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b7cb4d3320 con 0x55b7cb44dde0 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c005500 con 0x55b7cb44dde0 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f822c03e6d0 con 0x55b7cb44dde0 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 10 client.25649 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 10 client.25649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 20 client.25649 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb4d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 4 client.25649 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7cb3b2d70 con 0x55b7cb468470 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.688+0000 7f822bfff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb4d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f8212ffd640 10 client.25649 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:48:21.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f822bfff640 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb4d58f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31cfb946b1db5845 server_cookie=87097c8ce37c3c2b in_seq=0 out_seq=0 2024-09-10T11:48:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f8212ffd640 1 -- 172.21.15.17:0/1112569554 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7cb3b2d70 con 0x55b7cb468470 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f8212ffd640 10 client.25649 handle_command_reply: tid=0 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 client.25649 shutdown 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 msgr2=0x55b7cb45ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f822c0314a0 tx=0x7f822c02a750 comp rx=0 tx=0).stop 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 shutdown_connections 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55b7cb468470 0x55b7cb4d58f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7cb458b80 0x55b7cb45d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7cb44f350 0x55b7cb45cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f8212ffd640 0 client.25649 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 --2- 172.21.15.17:0/1112569554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b7cb44dde0 0x55b7cb45ca10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 >> 172.21.15.17:0/1112569554 conn(0x55b7cb40e310 msgr2=0x55b7cb450140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 shutdown_connections 2024-09-10T11:48:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.689+0000 7f823bf79740 1 -- 172.21.15.17:0/1112569554 wait complete. 2024-09-10T11:48:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f823bf79740 20 client.25649 trim_cache size 0 max 16384 2024-09-10T11:48:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 msgr2=0x7f82200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 0x7f82200a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8224098670 tx=0x7f8224004b40 comp rx=0 tx=0).stop 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 msgr2=0x7f823419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f822400e9f0 tx=0x7f822400edf0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 shutdown_connections 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f82200a2b80 0x7f82200a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823410c180 0x7f823419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82341036c0 0x7f823419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 --2- 172.21.15.17:0/824355747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8234102da0 0x7f823419a5f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 >> 172.21.15.17:0/824355747 conn(0x7f82340fc7a0 msgr2=0x7f8234101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 shutdown_connections 2024-09-10T11:48:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:21.690+0000 7f8239ba0640 1 -- 172.21.15.17:0/824355747 wait complete. 2024-09-10T11:48:21.702 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:21 smithi081 ceph-mon[35059]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 MiB/s wr, 5.16k op/s 2024-09-10T11:48:21.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:21 smithi026 ceph-mon[34817]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 8.7 KiB/s rd, 33 MiB/s wr, 5.16k op/s 2024-09-10T11:48:22.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:48:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:23.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:23 smithi017 ceph-mon[30817]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 7.66k op/s 2024-09-10T11:48:23.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:23 smithi081 ceph-mon[35059]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 7.66k op/s 2024-09-10T11:48:23.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:23 smithi026 ceph-mon[34817]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 48 MiB/s wr, 7.66k op/s 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.629+0000 7fccc3173640 1 -- 172.21.15.17:0/1901445700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc10c180 msgr2=0x7fccbc10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.629+0000 7fccc3173640 1 --2- 172.21.15.17:0/1901445700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc10c180 0x7fccbc10e620 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009ca0 tx=0x7fccb402a970 comp rx=0 tx=0).stop 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 -- 172.21.15.17:0/1901445700 shutdown_connections 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 --2- 172.21.15.17:0/1901445700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc10c180 0x7fccbc10e620 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 --2- 172.21.15.17:0/1901445700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 0x7fccbc10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 --2- 172.21.15.17:0/1901445700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc102d50 0x7fccbc103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 -- 172.21.15.17:0/1901445700 >> 172.21.15.17:0/1901445700 conn(0x7fccbc0fc7d0 msgr2=0x7fccbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 -- 172.21.15.17:0/1901445700 shutdown_connections 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.630+0000 7fccc3173640 1 -- 172.21.15.17:0/1901445700 wait complete. 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 Processor -- start 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 -- start start 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 0x7fccbc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc10c180 0x7fccbc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111f80 con 0x7fccbc102d50 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111e00 con 0x7fccbc103670 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc3173640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc112100 con 0x7fccbc10c180 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48114/0 (socket says 172.21.15.17:48114) 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccc0f0f640 1 -- 172.21.15.17:0/587658578 learned_addr learned my addr 172.21.15.17:0/587658578 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.631+0000 7fccbbfff640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 0x7fccbc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc1710640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc10c180 0x7fccbc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 -- 172.21.15.17:0/587658578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc10c180 msgr2=0x7fccbc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc10c180 0x7fccbc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 -- 172.21.15.17:0/587658578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 msgr2=0x7fccbc198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 0x7fccbc198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 -- 172.21.15.17:0/587658578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc19d3f0 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccb000e9f0 tx=0x7fccb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccb9ffb640 1 -- 172.21.15.17:0/587658578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000cd00 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccb9ffb640 1 -- 172.21.15.17:0/587658578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb0010910 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc19d6e0 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.632+0000 7fccb9ffb640 1 -- 172.21.15.17:0/587658578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb00189c0 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.633+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc1a4fc0 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccb9ffb640 1 -- 172.21.15.17:0/587658578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fccb0010ac0 con 0x7fccbc102d50 2024-09-10T11:48:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 Processor -- start 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 -- start start 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aab370 0x55dd14aad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dd14a062f0 con 0x55dd14aa05d0 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55dd149adcf0 con 0x55dd14aa1b40 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc554c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd14a022b0 con 0x55dd14aab370 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc1710640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48124/0 (socket says 172.21.15.17:48124) 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.636+0000 7fccc0f0f640 1 -- 172.21.15.17:0/611839603 learned_addr learned my addr 172.21.15.17:0/611839603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccbbfff640 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aab370 0x55dd14aad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 -- 172.21.15.17:0/611839603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aab370 msgr2=0x55dd14aad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aab370 0x55dd14aad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 -- 172.21.15.17:0/611839603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 msgr2=0x55dd14aa0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 -- 172.21.15.17:0/611839603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd149923a0 con 0x55dd14aa05d0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccb9ffb640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 0x7fccac0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc1710640 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccbbfff640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 0x7fccac0a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccb9ffb640 1 -- 172.21.15.17:0/587658578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fccb00cf300 con 0x7fccbc102d50 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.637+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccb00d7500 tx=0x7fccb00d79c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698a1a0cad41a19d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.638+0000 7fcca6ffd640 1 -- 172.21.15.17:0/611839603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb009b9f0 con 0x55dd14aa05d0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.638+0000 7fcca6ffd640 1 -- 172.21.15.17:0/611839603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb009bc20 con 0x55dd14aa05d0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.638+0000 7fcca6ffd640 1 -- 172.21.15.17:0/611839603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb009b580 con 0x55dd14aa05d0 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 -- 172.21.15.17:0/611839603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 msgr2=0x55dd14aa0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccbbfff640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 0x7fccac0a5080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55dd14aa1070 tx=0x7fcca8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccb00d7500 tx=0x7fccb00d79c0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 -- 172.21.15.17:0/611839603 shutdown_connections 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aab370 0x55dd14aad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aa05d0 0x55dd14aa0a10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 --2- 172.21.15.17:0/611839603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 -- 172.21.15.17:0/611839603 >> 172.21.15.17:0/611839603 conn(0x55dd14a69310 msgr2=0x55dd14a9cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 -- 172.21.15.17:0/611839603 shutdown_connections 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.639+0000 7fccc554c740 1 -- 172.21.15.17:0/611839603 wait complete. 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.640+0000 7fccc554c740 1 -- start start 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.640+0000 7fccc554c740 1 Processor -- start 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aa8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dd14aae070 con 0x55dd14aab370 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55dd149c1060 con 0x55dd14aa1b40 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd14aae1f0 con 0x55dd14aa05d0 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc554c740 10 client.0 _ll_register_callbacks cb 0x55dd147148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:39382/0 (socket says 172.21.15.17:39382) 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccbbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 -- 172.21.15.17:0/3655008556 learned_addr learned my addr 172.21.15.17:0/3655008556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc1710640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aa8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 -- 172.21.15.17:0/3655008556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 msgr2=0x55dd14aa80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 -- 172.21.15.17:0/3655008556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 msgr2=0x55dd14aa8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aa8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.641+0000 7fccc0f0f640 1 -- 172.21.15.17:0/3655008556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd147773c0 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fccb00cce60 tx=0x7fccb00d2bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=258afe477a4cc0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb009b760 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fccb009c080 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccb009bc20 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fccb009b9f0 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fccc554c740 10 client.25618 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55dd14aae070 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb009ff20 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.642+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fccb0018b60 con 0x55dd14aa05d0 2024-09-10T11:48:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 10 client.25618 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 20 client.25618 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14abd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 4 client.25618 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fccb009bc20 con 0x55dd14abad40 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccbbfff640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14abd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fccbbfff640 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14abd130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2bfecf141f051d server_cookie=d306485d36dc2c7a in_seq=0 out_seq=0 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.643+0000 7fcc9bfff640 10 client.25618 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.644+0000 7fcc9bfff640 1 -- 172.21.15.17:0/3655008556 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fccb009bc20 con 0x55dd14abad40 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.644+0000 7fcc9bfff640 10 client.25618 handle_command_reply: tid=0 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.644+0000 7fccc554c740 1 client.25618 shutdown 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 msgr2=0x55dd14aaae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fccb00cce60 tx=0x7fccb00d2bb0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 shutdown_connections 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14abd130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fcc9bfff640 0 client.25618 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aa8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa1b40 0x55dd14aa80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 --2- 172.21.15.17:0/3655008556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa05d0 0x55dd14aaae00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 >> 172.21.15.17:0/3655008556 conn(0x55dd14a69310 msgr2=0x55dd14aa2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 shutdown_connections 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 1 -- 172.21.15.17:0/3655008556 wait complete. 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.645+0000 7fccc554c740 20 client.25618 trim_cache size 0 max 16384 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 Processor -- start 2024-09-10T11:48:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 -- start start 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14aa3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aa3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ab320 con 0x55dd14aab370 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ace90 con 0x55dd14aa05d0 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc554c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ab9f0 con 0x55dd14aa1b40 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc1710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc1710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48154/0 (socket says 172.21.15.17:48154) 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc1710640 1 -- 172.21.15.17:0/2299466444 learned_addr learned my addr 172.21.15.17:0/2299466444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14aa3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.662+0000 7fccbbfff640 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aa3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 -- 172.21.15.17:0/2299466444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 msgr2=0x55dd14aa3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aa3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 -- 172.21.15.17:0/2299466444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 msgr2=0x55dd14aa3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14aa3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 -- 172.21.15.17:0/2299466444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd14a9c510 con 0x55dd14aab370 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fccc1710640 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fccb4035000 tx=0x7fccb403c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc59bb03dca6f024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fcca67fc640 1 -- 172.21.15.17:0/2299466444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4034040 con 0x55dd14aab370 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fcca67fc640 1 -- 172.21.15.17:0/2299466444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb4003e50 con 0x55dd14aab370 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.663+0000 7fcca67fc640 1 -- 172.21.15.17:0/2299466444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4030ad0 con 0x55dd14aab370 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- 172.21.15.17:0/2299466444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 msgr2=0x55dd14ac28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fccb4035000 tx=0x7fccb403c040 comp rx=0 tx=0).stop 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- 172.21.15.17:0/2299466444 shutdown_connections 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aa3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14ac28f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 --2- 172.21.15.17:0/2299466444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14aa3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- 172.21.15.17:0/2299466444 >> 172.21.15.17:0/2299466444 conn(0x55dd14a69310 msgr2=0x55dd14aa71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- 172.21.15.17:0/2299466444 shutdown_connections 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- 172.21.15.17:0/2299466444 wait complete. 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 -- start start 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.664+0000 7fccc554c740 1 Processor -- start 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aaed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aaf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ac7c0 con 0x55dd14aab370 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ac0c0 con 0x55dd14aa05d0 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1a92e0 con 0x55dd14aa1b40 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc554c740 10 client.0 _ll_register_callbacks cb 0x7fccb0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc1710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aaf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44044/0 (socket says 172.21.15.17:44044) 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 -- 172.21.15.17:0/2160476084 learned_addr learned my addr 172.21.15.17:0/2160476084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccbbfff640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aaed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 -- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 msgr2=0x55dd14aaed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aaed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 -- 172.21.15.17:0/2160476084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 msgr2=0x55dd14aaf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aaf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc0f0f640 1 -- 172.21.15.17:0/2160476084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd14aaf970 con 0x55dd14aa05d0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.665+0000 7fccc1710640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aaf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc0f0f640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccb0098080 tx=0x7fccb000cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b62130aba1996ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb00b8050 con 0x55dd14aa05d0 2024-09-10T11:48:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fccb009c080 con 0x55dd14aa05d0 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccb4003e50 con 0x55dd14aa05d0 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fccb009b760 con 0x55dd14aa05d0 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 10 client.25667 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55dd14b25750 con 0x55dd14aa05d0 2024-09-10T11:48:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb4003e50 con 0x55dd14aa05d0 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fccb00ba2f0 con 0x55dd14aa05d0 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 10 client.25667 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 10 client.25667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 20 client.25667 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14b27c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 4 client.25667 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.666+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd14a13860 con 0x55dd14abad40 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fccbbfff640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14b27c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fcc9bfff640 10 client.25667 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fccbbfff640 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14b27c90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3849568b4c7d23dc server_cookie=a6d28fb5f86a64eb in_seq=0 out_seq=0 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fcc9bfff640 1 -- 172.21.15.17:0/2160476084 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd14a13860 con 0x55dd14abad40 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fcc9bfff640 10 client.25667 handle_command_reply: tid=0 2024-09-10T11:48:23.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fccc554c740 1 client.25667 shutdown 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 msgr2=0x55dd14ab3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.667+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccb0098080 tx=0x7fccb000cf10 comp rx=0 tx=0).stop 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 shutdown_connections 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55dd14abad40 0x55dd14b27c90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fcc9bfff640 0 client.25667 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd14aa1b40 0x55dd14aaed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd14aab370 0x55dd14aaf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 --2- 172.21.15.17:0/2160476084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55dd14aa05d0 0x55dd14ab3a60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 >> 172.21.15.17:0/2160476084 conn(0x55dd14a69310 msgr2=0x55dd14a9b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 shutdown_connections 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 1 -- 172.21.15.17:0/2160476084 wait complete. 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.668+0000 7fccc554c740 20 client.25667 trim_cache size 0 max 16384 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 msgr2=0x7fccac0a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 0x7fccac0a5080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55dd14aa1070 tx=0x7fcca8005f90 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 msgr2=0x7fccbc198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccb000e9f0 tx=0x7fccb000eeb0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 shutdown_connections 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fccac0a2bc0 0x7fccac0a5080 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccbc10c180 0x7fccbc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccbc103670 0x7fccbc198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 --2- 172.21.15.17:0/587658578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccbc102d50 0x7fccbc198440 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 >> 172.21.15.17:0/587658578 conn(0x7fccbc0fc7d0 msgr2=0x7fccbc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 shutdown_connections 2024-09-10T11:48:23.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:23.669+0000 7fccc3173640 1 -- 172.21.15.17:0/587658578 wait complete. 2024-09-10T11:48:25.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:25 smithi081 ceph-mon[35059]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 10 KiB/s rd, 36 MiB/s wr, 5.84k op/s 2024-09-10T11:48:25.714 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:48:25.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:48:25.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:25 smithi026 ceph-mon[34817]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 10 KiB/s rd, 36 MiB/s wr, 5.84k op/s 2024-09-10T11:48:25.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:25 smithi017 ceph-mon[30817]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 10 KiB/s rd, 36 MiB/s wr, 5.84k op/s 2024-09-10T11:48:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 -- 172.21.15.17:0/42143977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 msgr2=0x7f8350100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 --2- 172.21.15.17:0/42143977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f8350100ee0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8338009930 tx=0x7f833802a420 comp rx=0 tx=0).stop 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 -- 172.21.15.17:0/42143977 shutdown_connections 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 --2- 172.21.15.17:0/42143977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 0x7f835010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 --2- 172.21.15.17:0/42143977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f8350100ee0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 --2- 172.21.15.17:0/42143977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 0x7f8350106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 -- 172.21.15.17:0/42143977 >> 172.21.15.17:0/42143977 conn(0x7f83500fc7a0 msgr2=0x7f83500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.919+0000 7f8355c9e640 1 -- 172.21.15.17:0/42143977 shutdown_connections 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.920+0000 7f8355c9e640 1 -- 172.21.15.17:0/42143977 wait complete. 2024-09-10T11:48:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.920+0000 7f8355c9e640 1 Processor -- start 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.920+0000 7f8355c9e640 1 -- start start 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 0x7f835019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 0x7f835019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8350110e80 con 0x7f8350100a80 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8350110d00 con 0x7f8350101420 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8355c9e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8350111000 con 0x7f8350106a80 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48192/0 (socket says 172.21.15.17:48192) 2024-09-10T11:48:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 -- 172.21.15.17:0/1163159734 learned_addr learned my addr 172.21.15.17:0/1163159734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f8347fff640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 0x7f835019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834ffff640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 0x7f835019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 -- 172.21.15.17:0/1163159734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 msgr2=0x7f835019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 0x7f835019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 -- 172.21.15.17:0/1163159734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 msgr2=0x7f835019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 0x7f835019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 -- 172.21.15.17:0/1163159734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835019f6b0 con 0x7f8350100a80 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.921+0000 7f834f7fe640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9f0 tx=0x7f834000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.922+0000 7f834d7fa640 1 -- 172.21.15.17:0/1163159734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834000cd80 con 0x7f8350100a80 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.922+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835019f9a0 con 0x7f8350100a80 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.922+0000 7f834d7fa640 1 -- 172.21.15.17:0/1163159734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8340005500 con 0x7f8350100a80 2024-09-10T11:48:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.922+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83501a7280 con 0x7f8350100a80 2024-09-10T11:48:26.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.922+0000 7f834d7fa640 1 -- 172.21.15.17:0/1163159734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340021640 con 0x7f8350100a80 2024-09-10T11:48:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.924+0000 7f834d7fa640 1 -- 172.21.15.17:0/1163159734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f83400217e0 con 0x7f8350100a80 2024-09-10T11:48:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 Processor -- start 2024-09-10T11:48:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 -- start start 2024-09-10T11:48:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 0x55f89edb8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 0x55f89edc6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834d7fa640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 0x7f833c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 0x55f89edb8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f89ed1e280 con 0x55f89edc3d40 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f89ecc5b10 con 0x55f89edb9480 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8358077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f89ed1a240 con 0x55f89edb8b60 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 0x55f89edb8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:39414/0 (socket says 172.21.15.17:39414) 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44076/0 (socket says 172.21.15.17:44076) 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834ffff640 1 -- 172.21.15.17:0/655052476 learned_addr learned my addr 172.21.15.17:0/655052476 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f8347fff640 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 0x55f89edc6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834ffff640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 0x7f833c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.925+0000 7f834d7fa640 1 -- 172.21.15.17:0/1163159734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f83400cf3b0 con 0x7f8350100a80 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 -- 172.21.15.17:0/655052476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 msgr2=0x55f89edb8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 0x55f89edb8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 -- 172.21.15.17:0/655052476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 msgr2=0x55f89edc3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 -- 172.21.15.17:0/655052476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89ecd21f0 con 0x55f89edc3d40 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8347fff640 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 0x55f89edc6130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8338005940 tx=0x7f8338005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486af8aeac2e7ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f834ffff640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 0x7f833c0a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83480099a0 tx=0x7f8348004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8345ffb640 1 -- 172.21.15.17:0/655052476 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338040070 con 0x55f89edc3d40 2024-09-10T11:48:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.926+0000 7f8345ffb640 1 -- 172.21.15.17:0/655052476 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8338031870 con 0x55f89edc3d40 2024-09-10T11:48:26.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.927+0000 7f8345ffb640 1 -- 172.21.15.17:0/655052476 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338035040 con 0x55f89edc3d40 2024-09-10T11:48:26.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.927+0000 7f8358077740 1 -- 172.21.15.17:0/655052476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 msgr2=0x55f89edc6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.927+0000 7f8358077740 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 0x55f89edc6130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8338005940 tx=0x7f8338005bd0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.927+0000 7f8358077740 1 -- 172.21.15.17:0/655052476 shutdown_connections 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edc3d40 0x55f89edc6130 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 --2- 172.21.15.17:0/655052476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb8b60 0x55f89edb8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 -- 172.21.15.17:0/655052476 >> 172.21.15.17:0/655052476 conn(0x55f89edb50f0 msgr2=0x55f89edb54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 -- 172.21.15.17:0/655052476 shutdown_connections 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 -- 172.21.15.17:0/655052476 wait complete. 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 -- start start 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.928+0000 7f8358077740 1 Processor -- start 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89edc0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f89edc6910 con 0x55f89edb8b60 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f89ecd8f10 con 0x55f89edc3d40 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f89edc6a90 con 0x55f89edb9480 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8358077740 10 client.0 _ll_register_callbacks cb 0x55f89eca1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f834ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f8347fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89edc0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f834ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44078/0 (socket says 172.21.15.17:44078) 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f834ffff640 1 -- 172.21.15.17:0/2920073287 learned_addr learned my addr 172.21.15.17:0/2920073287 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.929+0000 7f834f7fe640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 -- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 msgr2=0x55f89edc0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89edc0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 -- 172.21.15.17:0/2920073287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 msgr2=0x55f89edc3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 -- 172.21.15.17:0/2920073287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89ea8f6a0 con 0x55f89edc3d40 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834f7fe640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f834ffff640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f83480124d0 tx=0x7f8348004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71d99509402aae46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f832effd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348025070 con 0x55f89edc3d40 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8338031870 con 0x55f89edc3d40 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.930+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8348003970 con 0x55f89edc3d40 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8348003b70 con 0x55f89edc3d40 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 10 client.25679 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:26.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f89edd2500 con 0x55f89edc3d40 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8348003d10 con 0x55f89edc3d40 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f834801e040 con 0x55f89edc3d40 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 10 client.25679 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 20 client.25679 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89edd39c0 0x55f89edd5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 4 client.25679 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8338031870 con 0x55f89edd39c0 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.931+0000 7f834f7fe640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89edd39c0 0x55f89edd5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.932+0000 7f832effd640 10 client.25679 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.932+0000 7f834f7fe640 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89edd39c0 0x55f89edd5e40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c500d840610cfa0 server_cookie=9d101ac0a45aeb71 in_seq=0 out_seq=0 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.932+0000 7f832effd640 1 -- 172.21.15.17:0/2920073287 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8338031870 con 0x55f89edd39c0 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.932+0000 7f832effd640 10 client.25679 handle_command_reply: tid=0 2024-09-10T11:48:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 client.25679 shutdown 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 msgr2=0x55f89edc12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f83480124d0 tx=0x7f8348004a40 comp rx=0 tx=0).stop 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 shutdown_connections 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89edd39c0 0x55f89edd5e40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89edc0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edc12e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f832effd640 0 client.25679 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 --2- 172.21.15.17:0/2920073287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 >> 172.21.15.17:0/2920073287 conn(0x55f89edb50f0 msgr2=0x55f89edbadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 shutdown_connections 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 1 -- 172.21.15.17:0/2920073287 wait complete. 2024-09-10T11:48:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.933+0000 7f8358077740 20 client.25679 trim_cache size 0 max 16384 2024-09-10T11:48:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.954+0000 7f8358077740 1 Processor -- start 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 -- start start 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89eddbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edbddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f833000e400 con 0x55f89edb8b60 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f833000ff70 con 0x55f89edc3d40 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8358077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f833000ead0 con 0x55f89edb9480 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48222/0 (socket says 172.21.15.17:48222) 2024-09-10T11:48:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 -- 172.21.15.17:0/645730109 learned_addr learned my addr 172.21.15.17:0/645730109 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8347fff640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89eddbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834ffff640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edbddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 -- 172.21.15.17:0/645730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 msgr2=0x55f89eddbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89eddbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 -- 172.21.15.17:0/645730109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 msgr2=0x55f89edbddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edbddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f834f7fe640 1 -- 172.21.15.17:0/645730109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89edc3b70 con 0x55f89edb8b60 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.955+0000 7f8347fff640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89eddbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.956+0000 7f834f7fe640 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f83400966c0 tx=0x7f8340017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf5fb6154bfe9cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.956+0000 7f83457fa640 1 -- 172.21.15.17:0/645730109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83400b9070 con 0x55f89edb8b60 2024-09-10T11:48:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.956+0000 7f83457fa640 1 -- 172.21.15.17:0/645730109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f834009bc20 con 0x55f89edb8b60 2024-09-10T11:48:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.956+0000 7f83457fa640 1 -- 172.21.15.17:0/645730109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340099fb0 con 0x55f89edb8b60 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- 172.21.15.17:0/645730109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 msgr2=0x55f89eddb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f83400966c0 tx=0x7f8340017000 comp rx=0 tx=0).stop 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- 172.21.15.17:0/645730109 shutdown_connections 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edb9480 0x55f89eddbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edc3d40 0x55f89edbddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 --2- 172.21.15.17:0/645730109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89eddb710 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- 172.21.15.17:0/645730109 >> 172.21.15.17:0/645730109 conn(0x55f89edb50f0 msgr2=0x55f89edc2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- 172.21.15.17:0/645730109 shutdown_connections 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- 172.21.15.17:0/645730109 wait complete. 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.957+0000 7f8358077740 1 -- start start 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 Processor -- start 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edc3d40 0x55f89edc77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f833000f8a0 con 0x55f89edb8b60 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f833000f1a0 con 0x55f89edb9480 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f833000c3e0 con 0x55f89edc3d40 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8358077740 10 client.0 _ll_register_callbacks cb 0x7f83480129b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8347fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8347fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44086/0 (socket says 172.21.15.17:44086) 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48236/0 (socket says 172.21.15.17:48236) 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f8347fff640 1 -- 172.21.15.17:0/3758784399 learned_addr learned my addr 172.21.15.17:0/3758784399 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:26.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834ffff640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edc3d40 0x55f89edc77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 -- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edc3d40 msgr2=0x55f89edc77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edc3d40 0x55f89edc77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 -- 172.21.15.17:0/3758784399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 msgr2=0x55f89edc7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.958+0000 7f834f7fe640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f834f7fe640 1 -- 172.21.15.17:0/3758784399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89ee3e980 con 0x55f89edb8b60 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f8347fff640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f834f7fe640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55f89edb4c60 tx=0x7f83400965c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df43b6a0b00aa30b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f832effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83400b9050 con 0x55f89edb8b60 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8340099f20 con 0x55f89edb8b60 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834009bc20 con 0x55f89edb8b60 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f834009ffd0 con 0x55f89edb8b60 2024-09-10T11:48:26.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f8358077740 10 client.16005 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.959+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f89ee3fc60 con 0x55f89edb8b60 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f834009bc20 con 0x55f89edb8b60 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f83400ae040 con 0x55f89edb8b60 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 10 client.16005 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 20 client.16005 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89ee402f0 0x55f89ee426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 4 client.16005 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f89ed2b7f0 con 0x55f89ee402f0 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8347fff640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89ee402f0 0x55f89ee426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f8347fff640 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89ee402f0 0x55f89ee426e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39e962972aeac4ff server_cookie=dca9a7ee19fd0947 in_seq=0 out_seq=0 2024-09-10T11:48:26.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.960+0000 7f832effd640 10 client.16005 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f832effd640 1 -- 172.21.15.17:0/3758784399 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f89ed2b7f0 con 0x55f89ee402f0 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f832effd640 10 client.16005 handle_command_reply: tid=0 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 client.16005 shutdown 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 msgr2=0x55f89edc6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55f89edb4c60 tx=0x7f83400965c0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 shutdown_connections 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55f89ee402f0 0x55f89ee426e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f89edc3d40 0x55f89edc77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f89edb9480 0x55f89edc7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 --2- 172.21.15.17:0/3758784399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f89edb8b60 0x55f89edc6d40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 >> 172.21.15.17:0/3758784399 conn(0x55f89edb50f0 msgr2=0x55f89edcebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f832effd640 0 client.16005 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:26.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.962+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 shutdown_connections 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8358077740 1 -- 172.21.15.17:0/3758784399 wait complete. 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8358077740 20 client.16005 trim_cache size 0 max 16384 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "540ae82a-1e90-4d5a-ace3-17c829118a9c", 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:48:26.970 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 msgr2=0x7f833c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 0x7f833c0a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f83480099a0 tx=0x7f8348004ab0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 msgr2=0x7f835019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9f0 tx=0x7f834000edf0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 shutdown_connections 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f833c0a2b80 0x7f833c0a5040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350106a80 0x7f835019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8350101420 0x7f835019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 --2- 172.21.15.17:0/1163159734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8350100a80 0x7f835019a700 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.963+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 >> 172.21.15.17:0/1163159734 conn(0x7f83500fc7a0 msgr2=0x7f835006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.964+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 shutdown_connections 2024-09-10T11:48:26.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:26.964+0000 7f8355c9e640 1 -- 172.21.15.17:0/1163159734 wait complete. 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 37 MiB/s wr, 6.14k op/s 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:48:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:48:27.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:27 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 37 MiB/s wr, 6.14k op/s 2024-09-10T11:48:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:48:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:27 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 11 KiB/s rd, 37 MiB/s wr, 6.14k op/s 2024-09-10T11:48:27.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:27 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:27.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:48:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:48:28.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:28 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:48:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:28 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:48:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:28 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:28 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:28 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:48:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:28 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:48:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:28 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:28 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:28 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:48:28.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:28 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:48:28.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:28 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:28 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:48:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 -- 172.21.15.17:0/134369086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c109120 msgr2=0x7fc19c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/134369086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c109120 0x7fc19c110ca0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc194009ca0 tx=0x7fc19402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 -- 172.21.15.17:0/134369086 shutdown_connections 2024-09-10T11:48:28.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/134369086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c109120 0x7fc19c110ca0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/134369086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c1049a0 0x7fc19c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/134369086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c103ff0 0x7fc19c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.902+0000 7fc1a32fd640 1 -- 172.21.15.17:0/134369086 >> 172.21.15.17:0/134369086 conn(0x7fc19c0ffab0 msgr2=0x7fc19c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.903+0000 7fc1a32fd640 1 -- 172.21.15.17:0/134369086 shutdown_connections 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.903+0000 7fc1a32fd640 1 -- 172.21.15.17:0/134369086 wait complete. 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.903+0000 7fc1a32fd640 1 Processor -- start 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.903+0000 7fc1a32fd640 1 -- start start 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 0x7fc19c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 0x7fc19c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c114150 con 0x7fc19c1049a0 2024-09-10T11:48:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c113fd0 con 0x7fc19c103ff0 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a32fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1142d0 con 0x7fc19c109120 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 0x7fc19c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48254/0 (socket says 172.21.15.17:48254) 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 0x7fc19c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44110/0 (socket says 172.21.15.17:44110) 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 -- 172.21.15.17:0/19051376 learned_addr learned my addr 172.21.15.17:0/19051376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a189a640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 0x7fc19c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 -- 172.21.15.17:0/19051376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 msgr2=0x7fc19c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 0x7fc19c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 -- 172.21.15.17:0/19051376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 msgr2=0x7fc19c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 0x7fc19c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a0898640 1 -- 172.21.15.17:0/19051376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c19f660 con 0x7fc19c1049a0 2024-09-10T11:48:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.904+0000 7fc1a189a640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 0x7fc19c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1a0898640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00e9f0 tx=0x7fc18c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1927fc640 1 -- 172.21.15.17:0/19051376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c00cd80 con 0x7fc19c1049a0 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c19f950 con 0x7fc19c1049a0 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1927fc640 1 -- 172.21.15.17:0/19051376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc18c010910 con 0x7fc19c1049a0 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1927fc640 1 -- 172.21.15.17:0/19051376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c018990 con 0x7fc19c1049a0 2024-09-10T11:48:28.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.905+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c1a7230 con 0x7fc19c1049a0 2024-09-10T11:48:28.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 Processor -- start 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 -- start start 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1927fc640 1 -- 172.21.15.17:0/19051376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc18c010ac0 con 0x7fc19c1049a0 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 0x5572fe8b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572fe8122e0 con 0x5572fe8ac4a0 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572fe7b9ce0 con 0x5572fe8b7680 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572fe80e2a0 con 0x5572fe8acdc0 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:39468/0 (socket says 172.21.15.17:39468) 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a1099640 1 -- 172.21.15.17:0/3981405869 learned_addr learned my addr 172.21.15.17:0/3981405869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:28.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.909+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 -- 172.21.15.17:0/3981405869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 msgr2=0x5572fe8b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a0898640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 0x5572fe8b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 0x5572fe8b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 -- 172.21.15.17:0/3981405869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 msgr2=0x5572fe8ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1927fc640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 0x7fc1880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 -- 172.21.15.17:0/3981405869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572fe79e440 con 0x5572fe8acdc0 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a0898640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 0x5572fe8b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc198009d20 tx=0x7fc198011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0f28409bff515 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.910+0000 7fc1927fc640 1 -- 172.21.15.17:0/19051376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc18c0cf370 con 0x7fc19c1049a0 2024-09-10T11:48:28.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.911+0000 7fc1a0898640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 0x7fc1880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.911+0000 7fc1877fe640 1 -- 172.21.15.17:0/3981405869 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19801e070 con 0x5572fe8acdc0 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.911+0000 7fc1877fe640 1 -- 172.21.15.17:0/3981405869 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc198019b10 con 0x5572fe8acdc0 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.911+0000 7fc1877fe640 1 -- 172.21.15.17:0/3981405869 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19800ebb0 con 0x5572fe8acdc0 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a0898640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 0x7fc1880a5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0cd1f0 tx=0x7fc18c018420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3981405869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 msgr2=0x5572fe8b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc198009d20 tx=0x7fc198011810 comp rx=0 tx=0).stop 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3981405869 shutdown_connections 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8b7140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8b7680 0x5572fe8b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3981405869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3981405869 >> 172.21.15.17:0/3981405869 conn(0x5572fe8a8a30 msgr2=0x5572fe8a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3981405869 shutdown_connections 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3981405869 wait complete. 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 -- start start 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.912+0000 7fc1a56d6740 1 Processor -- start 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8b7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8b7680 0x5572fe8b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572fe8ba250 con 0x5572fe8ac4a0 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572fe7cd050 con 0x5572fe8acdc0 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572fe8ba3d0 con 0x5572fe8b7680 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a56d6740 10 client.0 _ll_register_callbacks cb 0x5572fe80d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44120/0 (socket says 172.21.15.17:44120) 2024-09-10T11:48:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 -- 172.21.15.17:0/3033363533 learned_addr learned my addr 172.21.15.17:0/3033363533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 -- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8b7680 msgr2=0x5572fe8b4870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8b7680 0x5572fe8b4870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 -- 172.21.15.17:0/3033363533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 msgr2=0x5572fe8b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a1099640 1 -- 172.21.15.17:0/3033363533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572fe5833c0 con 0x5572fe8acdc0 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.913+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc1a1099640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc198011d10 tx=0x7fc198019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe6d2f60eb03ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19801e070 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc198019b10 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc19800eaf0 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc1980098f0 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc1a56d6740 10 client.25694 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5572fe8c5bd0 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.914+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc198019b10 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fc1980046c0 con 0x5572fe8acdc0 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 10 client.25694 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 20 client.25694 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe8c73f0 0x5572fe8c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 4 client.25694 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572fe81f850 con 0x5572fe8c73f0 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe8c73f0 0x5572fe8c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.915+0000 7fc1a189a640 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe8c73f0 0x5572fe8c9890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b704f18e6f20c9e server_cookie=8e7359e334598247 in_seq=0 out_seq=0 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc184ff9640 10 client.25694 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc184ff9640 1 -- 172.21.15.17:0/3033363533 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572fe81f850 con 0x5572fe8c73f0 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc184ff9640 10 client.25694 handle_command_reply: tid=0 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc1a56d6740 1 client.25694 shutdown 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 msgr2=0x5572fe8b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.916+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc198011d10 tx=0x7fc198019660 comp rx=0 tx=0).stop 2024-09-10T11:48:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 shutdown_connections 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe8c73f0 0x5572fe8c9890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8b7680 0x5572fe8b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b42d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/3033363533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8ac4a0 0x5572fe8b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 >> 172.21.15.17:0/3033363533 conn(0x5572fe8a8a30 msgr2=0x5572fe8ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc184ff9640 0 client.25694 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 shutdown_connections 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 1 -- 172.21.15.17:0/3033363533 wait complete. 2024-09-10T11:48:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.917+0000 7fc1a56d6740 20 client.25694 trim_cache size 0 max 16384 2024-09-10T11:48:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 Processor -- start 2024-09-10T11:48:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 -- start start 2024-09-10T11:48:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8ac4a0 0x5572fe8a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c06fad0 con 0x5572fe8b7680 2024-09-10T11:48:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c071640 con 0x5572fe8acdc0 2024-09-10T11:48:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0701a0 con 0x5572fe8ac4a0 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48288/0 (socket says 172.21.15.17:48288) 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 -- 172.21.15.17:0/1379300250 learned_addr learned my addr 172.21.15.17:0/1379300250 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8ac4a0 0x5572fe8a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a1099640 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 -- 172.21.15.17:0/1379300250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8ac4a0 msgr2=0x5572fe8a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.938+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8ac4a0 0x5572fe8a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc1a189a640 1 -- 172.21.15.17:0/1379300250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 msgr2=0x5572fe8b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc1a189a640 1 -- 172.21.15.17:0/1379300250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572fe8b3280 con 0x5572fe8b7680 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc19402b010 tx=0x7fc19402afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540a229d7aa5f6d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc186ffd640 1 -- 172.21.15.17:0/1379300250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19405e070 con 0x5572fe8b7680 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc186ffd640 1 -- 172.21.15.17:0/1379300250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc19405f040 con 0x5572fe8b7680 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.939+0000 7fc186ffd640 1 -- 172.21.15.17:0/1379300250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194004760 con 0x5572fe8b7680 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1379300250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 msgr2=0x5572fe8b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc19402b010 tx=0x7fc19402afa0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1379300250 shutdown_connections 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8b1550 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8acdc0 0x5572fe8b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1379300250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8ac4a0 0x5572fe8a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1379300250 >> 172.21.15.17:0/1379300250 conn(0x5572fe8a8a30 msgr2=0x5572fe8b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1379300250 shutdown_connections 2024-09-10T11:48:28.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1379300250 wait complete. 2024-09-10T11:48:28.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 -- start start 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.940+0000 7fc1a56d6740 1 Processor -- start 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c070f70 con 0x5572fe8b7680 2024-09-10T11:48:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c070870 con 0x5572fe8ac4a0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c06dab0 con 0x5572fe8acdc0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a56d6740 10 client.0 _ll_register_callbacks cb 0x7fc19801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a189a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a189a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a189a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44136/0 (socket says 172.21.15.17:44136) 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.941+0000 7fc1a189a640 1 -- 172.21.15.17:0/1197889871 learned_addr learned my addr 172.21.15.17:0/1197889871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 -- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 msgr2=0x5572fe8cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 -- 172.21.15.17:0/1197889871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 msgr2=0x5572fe8cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 -- 172.21.15.17:0/1197889871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572fe9300e0 con 0x5572fe8ac4a0 2024-09-10T11:48:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a189a640 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc194002230 tx=0x7fc19402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f51c707a6c0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19406d040 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc194004500 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc19405f040 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc19405e040 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a56d6740 10 client.25700 fetch_fsmap learned FSMap version 36 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.942+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5572fe9313d0 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc194036040 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fc194062020 con 0x5572fe8ac4a0 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 10 client.25700 fetch_fsmap finished waiting for FSMap version 36 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:48:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 20 client.25700 populate_metadata read hostname 'smithi017' 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe931980 0x5572fe933d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 4 client.25700 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc19405f040 con 0x5572fe931980 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.943+0000 7fc1a1099640 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe931980 0x5572fe933d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a1099640 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe931980 0x5572fe933d70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e8305279dbffc6 server_cookie=9f967f122489a217 in_seq=0 out_seq=0 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc184ff9640 10 client.25700 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc184ff9640 1 -- 172.21.15.17:0/1197889871 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fc19405f040 con 0x5572fe931980 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc184ff9640 10 client.25700 handle_command_reply: tid=0 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a56d6740 1 client.25700 shutdown 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 msgr2=0x5572fe8cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc194002230 tx=0x7fc19402a8c0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 shutdown_connections 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.944+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572fe931980 0x5572fe933d70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc184ff9640 0 client.25700 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572fe8acdc0 0x5572fe8cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572fe8b7680 0x5572fe8cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 --2- 172.21.15.17:0/1197889871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572fe8ac4a0 0x5572fe8cbe60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 >> 172.21.15.17:0/1197889871 conn(0x5572fe8a8a30 msgr2=0x5572fe8a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 shutdown_connections 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 1 -- 172.21.15.17:0/1197889871 wait complete. 2024-09-10T11:48:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.945+0000 7fc1a56d6740 20 client.25700 trim_cache size 0 max 16384 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "540ae82a-1e90-4d5a-ace3-17c829118a9c": { 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "540ae82a-1e90-4d5a-ace3-17c829118a9c", 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:48:28.951 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 msgr2=0x7fc1880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 0x7fc1880a5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0cd1f0 tx=0x7fc18c018420 comp rx=0 tx=0).stop 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 msgr2=0x7fc19c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00e9f0 tx=0x7fc18c00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 shutdown_connections 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc1880a2b80 0x7fc1880a5040 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19c109120 0x7fc19c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c1049a0 0x7fc19c19abf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 --2- 172.21.15.17:0/19051376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c103ff0 0x7fc19c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:48:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 >> 172.21.15.17:0/19051376 conn(0x7fc19c0ffab0 msgr2=0x7fc19c100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:48:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 shutdown_connections 2024-09-10T11:48:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:48:28.946+0000 7fc1a32fd640 1 -- 172.21.15.17:0/19051376 wait complete. 2024-09-10T11:48:29.571 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:29 smithi017 ceph-mon[30817]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.80k op/s 2024-09-10T11:48:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:29 smithi081 ceph-mon[35059]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.80k op/s 2024-09-10T11:48:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:29 smithi026 ceph-mon[34817]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.80k op/s 2024-09-10T11:48:29.986 INFO:tasks.cephfs.filesystem:scrub status for tag:540ae82a-1e90-4d5a-ace3-17c829118a9c - {'path': '/', 'tag': '540ae82a-1e90-4d5a-ace3-17c829118a9c', 'options': 'recursive,force'} 2024-09-10T11:48:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:31 smithi081 ceph-mon[35059]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 6.72k op/s 2024-09-10T11:48:31.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:31 smithi026 ceph-mon[34817]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 6.72k op/s 2024-09-10T11:48:31.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:31 smithi017 ceph-mon[30817]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1008 GiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 6.72k op/s 2024-09-10T11:48:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:33 smithi081 ceph-mon[35059]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 21 KiB/s rd, 50 MiB/s wr, 9.17k op/s 2024-09-10T11:48:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:33 smithi026 ceph-mon[34817]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 21 KiB/s rd, 50 MiB/s wr, 9.17k op/s 2024-09-10T11:48:33.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:33 smithi017 ceph-mon[30817]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 21 KiB/s rd, 50 MiB/s wr, 9.17k op/s 2024-09-10T11:48:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:35 smithi081 ceph-mon[35059]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 16 KiB/s rd, 36 MiB/s wr, 6.76k op/s 2024-09-10T11:48:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:35 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:48:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:35 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:48:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:35 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:48:35.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:35 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:48:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:35 smithi026 ceph-mon[34817]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 16 KiB/s rd, 36 MiB/s wr, 6.76k op/s 2024-09-10T11:48:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:35 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:48:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:35 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:48:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:35 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:48:35.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:35 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:48:35.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:35 smithi017 ceph-mon[30817]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 16 KiB/s rd, 36 MiB/s wr, 6.76k op/s 2024-09-10T11:48:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:35 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:48:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:35 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:48:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:35 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:48:35.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:35 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:48:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:36 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:48:36.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:36 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:48:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:36 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:48:36.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:36 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:48:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:36 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:48:36.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:36 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:48:37.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:37 smithi081 ceph-mon[35059]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 6.65k op/s 2024-09-10T11:48:37.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:37 smithi026 ceph-mon[34817]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 6.65k op/s 2024-09-10T11:48:37.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:37 smithi017 ceph-mon[30817]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 65 GiB used, 1007 GiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 6.65k op/s 2024-09-10T11:48:39.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:39 smithi081 ceph-mon[35059]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 25 KiB/s rd, 50 MiB/s wr, 9.29k op/s 2024-09-10T11:48:39.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:39 smithi026 ceph-mon[34817]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 25 KiB/s rd, 50 MiB/s wr, 9.29k op/s 2024-09-10T11:48:39.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:39 smithi017 ceph-mon[30817]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 25 KiB/s rd, 50 MiB/s wr, 9.29k op/s 2024-09-10T11:48:41.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:41 smithi081 ceph-mon[35059]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.63k op/s 2024-09-10T11:48:41.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:41 smithi026 ceph-mon[34817]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.63k op/s 2024-09-10T11:48:41.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:41 smithi017 ceph-mon[30817]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.63k op/s 2024-09-10T11:48:43.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:43 smithi081 ceph-mon[35059]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 32 KiB/s rd, 49 MiB/s wr, 8.80k op/s 2024-09-10T11:48:43.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:43 smithi026 ceph-mon[34817]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 32 KiB/s rd, 49 MiB/s wr, 8.80k op/s 2024-09-10T11:48:43.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:43 smithi017 ceph-mon[30817]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 32 KiB/s rd, 49 MiB/s wr, 8.80k op/s 2024-09-10T11:48:45.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:45 smithi081 ceph-mon[35059]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 6.72k op/s 2024-09-10T11:48:45.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:45 smithi026 ceph-mon[34817]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 6.72k op/s 2024-09-10T11:48:45.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:45 smithi017 ceph-mon[30817]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 24 KiB/s rd, 38 MiB/s wr, 6.72k op/s 2024-09-10T11:48:47.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:47 smithi081 ceph-mon[35059]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 26 KiB/s rd, 37 MiB/s wr, 6.67k op/s 2024-09-10T11:48:47.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:47 smithi026 ceph-mon[34817]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 26 KiB/s rd, 37 MiB/s wr, 6.67k op/s 2024-09-10T11:48:47.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:47 smithi017 ceph-mon[30817]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1007 GiB / 1.0 TiB avail; 26 KiB/s rd, 37 MiB/s wr, 6.67k op/s 2024-09-10T11:48:49.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:49 smithi081 ceph-mon[35059]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 37 KiB/s rd, 65 MiB/s wr, 11.13k op/s 2024-09-10T11:48:49.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:49 smithi026 ceph-mon[34817]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 37 KiB/s rd, 65 MiB/s wr, 11.13k op/s 2024-09-10T11:48:49.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:49 smithi017 ceph-mon[30817]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 37 KiB/s rd, 65 MiB/s wr, 11.13k op/s 2024-09-10T11:48:51.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:51 smithi081 ceph-mon[35059]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 51 MiB/s wr, 8.58k op/s 2024-09-10T11:48:51.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:51 smithi026 ceph-mon[34817]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 51 MiB/s wr, 8.58k op/s 2024-09-10T11:48:51.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:51 smithi017 ceph-mon[30817]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 66 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 51 MiB/s wr, 8.58k op/s 2024-09-10T11:48:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:48:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:48:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:48:52.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:48:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:48:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:48:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:48:52.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:48:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:48:52.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:48:52.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:48:52.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:48:53.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:53 smithi081 ceph-mon[35059]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 10.74k op/s 2024-09-10T11:48:53.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:53 smithi026 ceph-mon[34817]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 10.74k op/s 2024-09-10T11:48:53.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:53 smithi017 ceph-mon[30817]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 10.74k op/s 2024-09-10T11:48:55.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:55 smithi081 ceph-mon[35059]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 27 KiB/s rd, 58 MiB/s wr, 9.51k op/s 2024-09-10T11:48:55.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:55 smithi026 ceph-mon[34817]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 27 KiB/s rd, 58 MiB/s wr, 9.51k op/s 2024-09-10T11:48:55.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:55 smithi017 ceph-mon[30817]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 27 KiB/s rd, 58 MiB/s wr, 9.51k op/s 2024-09-10T11:48:57.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:57 smithi081 ceph-mon[35059]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 56 MiB/s wr, 9.14k op/s 2024-09-10T11:48:57.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:57 smithi026 ceph-mon[34817]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 56 MiB/s wr, 9.14k op/s 2024-09-10T11:48:57.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:57 smithi017 ceph-mon[30817]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 28 KiB/s rd, 56 MiB/s wr, 9.14k op/s 2024-09-10T11:48:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:48:59 smithi081 ceph-mon[35059]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 31 KiB/s rd, 70 MiB/s wr, 11.61k op/s 2024-09-10T11:48:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:48:59 smithi026 ceph-mon[34817]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 31 KiB/s rd, 70 MiB/s wr, 11.61k op/s 2024-09-10T11:48:59.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:48:59 smithi017 ceph-mon[30817]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 31 KiB/s rd, 70 MiB/s wr, 11.61k op/s 2024-09-10T11:48:59.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:49:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 -- 172.21.15.17:0/2378913108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac104990 msgr2=0x7f8cac1089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2378913108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac104990 0x7f8cac1089e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009860 tx=0x7f8c9402a340 comp rx=0 tx=0).stop 2024-09-10T11:49:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 -- 172.21.15.17:0/2378913108 shutdown_connections 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2378913108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac104990 0x7f8cac1089e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2378913108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2378913108 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac103fe0 0x7f8cac1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 -- 172.21.15.17:0/2378913108 >> 172.21.15.17:0/2378913108 conn(0x7f8cac0ffa60 msgr2=0x7f8cac101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 -- 172.21.15.17:0/2378913108 shutdown_connections 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.830+0000 7f8cb2715640 1 -- 172.21.15.17:0/2378913108 wait complete. 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 Processor -- start 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 -- start start 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 0x7f8cac19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac104990 0x7f8cac19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac114110 con 0x7f8cac109110 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac113f90 con 0x7f8cac104990 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb2715640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac114290 con 0x7f8cac103fe0 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb0cb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 0x7f8cac19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb0cb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac19eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59236/0 (socket says 172.21.15.17:59236) 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cb0cb2640 1 -- 172.21.15.17:0/2384239524 learned_addr learned my addr 172.21.15.17:0/2384239524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac104990 0x7f8cac19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 -- 172.21.15.17:0/2384239524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac104990 msgr2=0x7f8cac19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac104990 0x7f8cac19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 -- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 msgr2=0x7f8cac19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.831+0000 7f8cabfff640 1 -- 172.21.15.17:0/2384239524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac19f5a0 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8cabfff640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 0x7f8cac19a5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e9f0 tx=0x7f8c9c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8ca9ffb640 1 -- 172.21.15.17:0/2384239524 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00cd80 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac19f890 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8ca9ffb640 1 -- 172.21.15.17:0/2384239524 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c9c0035f0 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8ca9ffb640 1 -- 172.21.15.17:0/2384239524 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c010670 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.832+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1a7170 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8ca9ffb640 1 -- 172.21.15.17:0/2384239524 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8c9c010810 con 0x7f8cac103fe0 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 Processor -- start 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 -- start start 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a09124140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a0907f2e0 con 0x559a09119dc0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a09026ce0 con 0x559a091194a0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a0907b2a0 con 0x559a09124680 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.835+0000 7f8cb0cb2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53864/0 (socket says 172.21.15.17:53864) 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cb0cb2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36188/0 (socket says 172.21.15.17:36188) 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8ca3fff640 1 -- 172.21.15.17:0/48882463 learned_addr learned my addr 172.21.15.17:0/48882463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a09124140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8ca9ffb640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 -- 172.21.15.17:0/48882463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 msgr2=0x559a09126a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8ca9ffb640 1 -- 172.21.15.17:0/2384239524 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8c9c0cf330 con 0x7f8cac103fe0 2024-09-10T11:49:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 -- 172.21.15.17:0/48882463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 msgr2=0x559a09119880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cabfff640 1 -- 172.21.15.17:0/48882463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0900b440 con 0x559a09119dc0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.836+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8cabfff640 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a09124140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0cce10 tx=0x7f8c9c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6a09186350e9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 0x7f8c980a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009a60 tx=0x7f8ca4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8ca27fc640 1 -- 172.21.15.17:0/48882463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c09b500 con 0x559a09119dc0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8ca27fc640 1 -- 172.21.15.17:0/48882463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c9c09c2a0 con 0x559a09119dc0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.837+0000 7f8ca27fc640 1 -- 172.21.15.17:0/48882463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0177e0 con 0x559a09119dc0 2024-09-10T11:49:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 -- 172.21.15.17:0/48882463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 msgr2=0x559a09124140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a09124140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0cce10 tx=0x7f8c9c005bb0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 -- 172.21.15.17:0/48882463 shutdown_connections 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09124680 0x559a09126a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a09124140 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/48882463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a091194a0 0x559a09119880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.838+0000 7f8cb4aee740 1 -- 172.21.15.17:0/48882463 >> 172.21.15.17:0/48882463 conn(0x559a09115a30 msgr2=0x559a09115e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.839+0000 7f8cb4aee740 1 -- 172.21.15.17:0/48882463 shutdown_connections 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.839+0000 7f8cb4aee740 1 -- 172.21.15.17:0/48882463 wait complete. 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.839+0000 7f8cb4aee740 1 -- start start 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.839+0000 7f8cb4aee740 1 Processor -- start 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09121230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a09121770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a09127250 con 0x559a091194a0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a0903a050 con 0x559a09124680 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559a091273d0 con 0x559a09119dc0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb4aee740 10 client.0 _ll_register_callbacks cb 0x559a0907a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59262/0 (socket says 172.21.15.17:59262) 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 -- 172.21.15.17:0/3636959306 learned_addr learned my addr 172.21.15.17:0/3636959306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a09121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 -- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 msgr2=0x559a09121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 -- 172.21.15.17:0/3636959306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 msgr2=0x559a09121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a09121770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.840+0000 7f8cabfff640 1 -- 172.21.15.17:0/3636959306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a08df03c0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8cabfff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0a42e0 tx=0x7f8c9c099c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cdea2018583c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8c8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c09b500 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8c9c098210 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c09c2a0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c09bba0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8cb4aee740 10 client.16035 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.841+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559a09132bc0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c9c09c2a0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8c9c0173d0 con 0x559a091194a0 2024-09-10T11:49:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 10 client.16035 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 20 client.16035 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a09133f10 0x559a09136300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 4 client.16035 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a0908c850 con 0x559a09133f10 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.842+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a09133f10 0x559a09136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.843+0000 7f8c8b7fe640 10 client.16035 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.843+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a09133f10 0x559a09136300 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e0f362db91ff641 server_cookie=354461a063ba13d5 in_seq=0 out_seq=0 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.843+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/3636959306 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a0908c850 con 0x559a09133f10 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.843+0000 7f8c8b7fe640 10 client.16035 handle_command_reply: tid=0 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.843+0000 7f8cb4aee740 1 client.16035 shutdown 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 msgr2=0x559a09123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0a42e0 tx=0x7f8c9c099c40 comp rx=0 tx=0).stop 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 shutdown_connections 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a09133f10 0x559a09136300 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a09121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/3636959306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09123f80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 >> 172.21.15.17:0/3636959306 conn(0x559a09115a30 msgr2=0x559a09114b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8c8b7fe640 0 client.16035 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 shutdown_connections 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 1 -- 172.21.15.17:0/3636959306 wait complete. 2024-09-10T11:49:00.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.844+0000 7f8cb4aee740 20 client.16035 trim_cache size 0 max 16384 2024-09-10T11:49:00.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.866+0000 7f8cb4aee740 1 Processor -- start 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.866+0000 7f8cb4aee740 1 -- start start 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 0x559a0911e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a0911ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1af7c0 con 0x559a09119dc0 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b1300 con 0x559a09124680 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1afe90 con 0x559a091194a0 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59274/0 (socket says 172.21.15.17:59274) 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 -- 172.21.15.17:0/1903260234 learned_addr learned my addr 172.21.15.17:0/1903260234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cabfff640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 0x559a0911e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a0911ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 -- 172.21.15.17:0/1903260234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 msgr2=0x559a0911e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 0x559a0911e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 -- 172.21.15.17:0/1903260234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 msgr2=0x559a0911ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a0911ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 -- 172.21.15.17:0/1903260234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a09116bc0 con 0x559a09119dc0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8cabfff640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 0x559a0911e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.867+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009830 tx=0x7f8c940058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b70156d6985eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8ca1ffb640 1 -- 172.21.15.17:0/1903260234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9404b070 con 0x559a09119dc0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8ca1ffb640 1 -- 172.21.15.17:0/1903260234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c94030550 con 0x559a09119dc0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8ca1ffb640 1 -- 172.21.15.17:0/1903260234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94037040 con 0x559a09119dc0 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 -- 172.21.15.17:0/1903260234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 msgr2=0x559a0911e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009830 tx=0x7f8c940058d0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 -- 172.21.15.17:0/1903260234 shutdown_connections 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a0911ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a09119dc0 0x559a0911e9f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/1903260234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a091194a0 0x559a0911e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.868+0000 7f8cb4aee740 1 -- 172.21.15.17:0/1903260234 >> 172.21.15.17:0/1903260234 conn(0x559a09115a30 msgr2=0x559a0911c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- 172.21.15.17:0/1903260234 shutdown_connections 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- 172.21.15.17:0/1903260234 wait complete. 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- start start 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 Processor -- start 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a091364c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b0c30 con 0x559a091194a0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b0560 con 0x559a09124680 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.869+0000 7f8cb4aee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1ad7a0 con 0x559a09119dc0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cb4aee740 10 client.0 _ll_register_callbacks cb 0x7f8ca4009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59278/0 (socket says 172.21.15.17:59278) 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 -- 172.21.15.17:0/141193549 learned_addr learned my addr 172.21.15.17:0/141193549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cb0cb2640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a091364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 -- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 msgr2=0x559a09139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 -- 172.21.15.17:0/141193549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 msgr2=0x559a091364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a091364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 -- 172.21.15.17:0/141193549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a09136cf0 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cabfff640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c09b8a0 tx=0x7f8c9c09ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8baddbc45babce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8c8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c09b500 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8c9c0173d0 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.870+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c94030550 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c09b6e0 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 10 client.16041 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559a0919e340 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c94030550 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8c9c0d2aa0 con 0x559a091194a0 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 10 client.16041 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 20 client.16041 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a0919e820 0x559a091a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 4 client.16041 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a09086d60 con 0x559a0919e820 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.871+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a0919e820 0x559a091a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8c8b7fe640 10 client.16041 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8ca3fff640 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a0919e820 0x559a091a0c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c01583128afb27 server_cookie=9b417ccbe3cce1c4 in_seq=0 out_seq=0 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8c8b7fe640 1 -- 172.21.15.17:0/141193549 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559a09086d60 con 0x559a0919e820 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8c8b7fe640 10 client.16041 handle_command_reply: tid=0 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 client.16041 shutdown 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 msgr2=0x559a09139010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c09b8a0 tx=0x7f8c9c09ff50 comp rx=0 tx=0).stop 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 shutdown_connections 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x559a0919e820 0x559a091a0c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a09119dc0 0x559a09139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a09124680 0x559a091364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 --2- 172.21.15.17:0/141193549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a091194a0 0x559a09139010 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 >> 172.21.15.17:0/141193549 conn(0x559a09115a30 msgr2=0x559a09114350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.872+0000 7f8c8b7fe640 0 client.16041 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 shutdown_connections 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb4aee740 1 -- 172.21.15.17:0/141193549 wait complete. 2024-09-10T11:49:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb4aee740 20 client.16041 trim_cache size 0 max 16384 2024-09-10T11:49:00.882 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:49:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:49:00.882 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:49:00.882 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 msgr2=0x7f8c980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 0x7f8c980a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009a60 tx=0x7f8ca4004a40 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 msgr2=0x7f8cac19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.873+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 0x7f8cac19a5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00e9f0 tx=0x7f8c9c00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 shutdown_connections 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8c980a2b80 0x7f8c980a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac109110 0x7f8cac19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cac104990 0x7f8cac19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 --2- 172.21.15.17:0/2384239524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac103fe0 0x7f8cac19a5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 >> 172.21.15.17:0/2384239524 conn(0x7f8cac0ffa60 msgr2=0x7f8cac100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 shutdown_connections 2024-09-10T11:49:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:00.874+0000 7f8cb2715640 1 -- 172.21.15.17:0/2384239524 wait complete. 2024-09-10T11:49:01.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:01 smithi081 ceph-mon[35059]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 20 KiB/s rd, 43 MiB/s wr, 7.20k op/s 2024-09-10T11:49:01.705 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:01 smithi017 ceph-mon[30817]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 20 KiB/s rd, 43 MiB/s wr, 7.20k op/s 2024-09-10T11:49:01.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:01 smithi026 ceph-mon[34817]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 20 KiB/s rd, 43 MiB/s wr, 7.20k op/s 2024-09-10T11:49:02.190 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:49:02.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:49:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:03.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.154+0000 7fc56b7fe640 1 -- 172.21.15.17:0/248211494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560004ca0 con 0x7fc56c06e4f0 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 -- 172.21.15.17:0/248211494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c06e4f0 msgr2=0x7fc56c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 --2- 172.21.15.17:0/248211494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c06e4f0 0x7fc56c06e930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc560008570 tx=0x7fc56000ac00 comp rx=0 tx=0).stop 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 -- 172.21.15.17:0/248211494 shutdown_connections 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 --2- 172.21.15.17:0/248211494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc56c06ee70 0x7fc56c07a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 --2- 172.21.15.17:0/248211494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c06e4f0 0x7fc56c06e930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 --2- 172.21.15.17:0/248211494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc56c10e090 0x7fc56c10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 -- 172.21.15.17:0/248211494 >> 172.21.15.17:0/248211494 conn(0x7fc56c073180 msgr2=0x7fc56c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 -- 172.21.15.17:0/248211494 shutdown_connections 2024-09-10T11:49:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.155+0000 7fc571ed3640 1 -- 172.21.15.17:0/248211494 wait complete. 2024-09-10T11:49:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 Processor -- start 2024-09-10T11:49:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 -- start start 2024-09-10T11:49:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc56c06e4f0 0x7fc56c1b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc56c06ee70 0x7fc56c1b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c131bb0 con 0x7fc56c10e090 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c131a30 con 0x7fc56c06ee70 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.156+0000 7fc571ed3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c131d30 con 0x7fc56c06e4f0 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.157+0000 7fc5716d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.157+0000 7fc5716d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55732/0 (socket says 172.21.15.17:55732) 2024-09-10T11:49:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.157+0000 7fc5716d2640 1 -- 172.21.15.17:0/2401646820 learned_addr learned my addr 172.21.15.17:0/2401646820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 -- 172.21.15.17:0/2401646820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc56c06e4f0 msgr2=0x7fc56c1b8000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc56c06e4f0 0x7fc56c1b8000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 -- 172.21.15.17:0/2401646820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc56c06ee70 msgr2=0x7fc56c1b8540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc56c06ee70 0x7fc56c1b8540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 -- 172.21.15.17:0/2401646820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1bcfb0 con 0x7fc56c10e090 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc5716d2640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc56400abb0 tx=0x7fc564007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.158+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564007ca0 con 0x7fc56c10e090 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.159+0000 7fc571ed3640 1 -- 172.21.15.17:0/2401646820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c1bd2a0 con 0x7fc56c10e090 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.159+0000 7fc571ed3640 1 -- 172.21.15.17:0/2401646820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c1c4b80 con 0x7fc56c10e090 2024-09-10T11:49:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.159+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564007e40 con 0x7fc56c10e090 2024-09-10T11:49:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.160+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564014410 con 0x7fc56c10e090 2024-09-10T11:49:03.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.163+0000 7fc571ed3640 1 -- 172.21.15.17:0/2401646820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc558005290 con 0x7fc56c10e090 2024-09-10T11:49:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.164+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc564005020 con 0x7fc56c10e090 2024-09-10T11:49:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.165+0000 7fc569ffb640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 0x7fc5540a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.165+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fc5640ce760 con 0x7fc56c10e090 2024-09-10T11:49:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.168+0000 7fc570ed1640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 0x7fc5540a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.171+0000 7fc570ed1640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 0x7fc5540a5060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00a980 tx=0x7fc55c00a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.175+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc56409b670 con 0x7fc56c10e090 2024-09-10T11:49:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.629+0000 7fc571ed3640 1 -- 172.21.15.17:0/2401646820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc558005580 con 0x7fc56c10e090 2024-09-10T11:49:03.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.638+0000 7fc569ffb640 1 -- 172.21.15.17:0/2401646820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11956 (secure 0 0 0) 0x7fc56409af70 con 0x7fc56c10e090 2024-09-10T11:49:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:49:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"btime":"2024-09-10T11:48:34:322395+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:48:33.997180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:49:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 37 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 msgr2=0x7fc5540a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 0x7fc5540a5060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00a980 tx=0x7fc55c00a360 comp rx=0 tx=0).stop 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 msgr2=0x7fc56c1bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc56400abb0 tx=0x7fc564007590 comp rx=0 tx=0).stop 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 shutdown_connections 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fc5540a2ba0 0x7fc5540a5060 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c10e090 0x7fc56c1bc8d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.643+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc56c06ee70 0x7fc56c1b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.644+0000 7fc5537fe640 1 --2- 172.21.15.17:0/2401646820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc56c06e4f0 0x7fc56c1b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.644+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 >> 172.21.15.17:0/2401646820 conn(0x7fc56c073180 msgr2=0x7fc56c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.644+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 shutdown_connections 2024-09-10T11:49:03.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:03.645+0000 7fc5537fe640 1 -- 172.21.15.17:0/2401646820 wait complete. 2024-09-10T11:49:03.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:03 smithi081 ceph-mon[35059]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 21 KiB/s rd, 49 MiB/s wr, 8.29k op/s 2024-09-10T11:49:03.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:03 smithi026 ceph-mon[34817]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 21 KiB/s rd, 49 MiB/s wr, 8.29k op/s 2024-09-10T11:49:03.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:03 smithi017 ceph-mon[30817]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 21 KiB/s rd, 49 MiB/s wr, 8.29k op/s 2024-09-10T11:49:04.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:49:04.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:04 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2401646820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:04.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:04 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2401646820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:04.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:04 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2401646820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:04.794 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:05.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.322+0000 7fdffc80c640 1 -- 172.21.15.17:0/3308656472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8102790 msgr2=0x7fdff81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.322+0000 7fdffc80c640 1 --2- 172.21.15.17:0/3308656472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8102790 0x7fdff81067e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009900 tx=0x7fdfec03b420 comp rx=0 tx=0).stop 2024-09-10T11:49:05.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 -- 172.21.15.17:0/3308656472 shutdown_connections 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 --2- 172.21.15.17:0/3308656472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8106f10 0x7fdff810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 --2- 172.21.15.17:0/3308656472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8102790 0x7fdff81067e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 --2- 172.21.15.17:0/3308656472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8101de0 0x7fdff81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 -- 172.21.15.17:0/3308656472 >> 172.21.15.17:0/3308656472 conn(0x7fdff80fd8e0 msgr2=0x7fdff80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 -- 172.21.15.17:0/3308656472 shutdown_connections 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.323+0000 7fdffc80c640 1 -- 172.21.15.17:0/3308656472 wait complete. 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.324+0000 7fdffc80c640 1 Processor -- start 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.324+0000 7fdffc80c640 1 -- start start 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8102790 0x7fdff81967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 0x7fdff819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810fdf0 con 0x7fdff8101de0 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810fc70 con 0x7fdff8106f10 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdffc80c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdff810ff70 con 0x7fdff8102790 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55752/0 (socket says 172.21.15.17:55752) 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 -- 172.21.15.17:0/1102516735 learned_addr learned my addr 172.21.15.17:0/1102516735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8102790 0x7fdff81967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 0x7fdff819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 -- 172.21.15.17:0/1102516735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8102790 msgr2=0x7fdff81967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8102790 0x7fdff81967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 -- 172.21.15.17:0/1102516735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 msgr2=0x7fdff819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 0x7fdff819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 -- 172.21.15.17:0/1102516735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff819b220 con 0x7fdff8101de0 2024-09-10T11:49:05.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 0x7fdff819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdff659c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800bf70 tx=0x7fdfe8009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.325+0000 7fdfe77fe640 1 -- 172.21.15.17:0/1102516735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011320 con 0x7fdff8101de0 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.326+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff819b510 con 0x7fdff8101de0 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.326+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff81a2df0 con 0x7fdff8101de0 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.326+0000 7fdfe77fe640 1 -- 172.21.15.17:0/1102516735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe8005020 con 0x7fdff8101de0 2024-09-10T11:49:05.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.326+0000 7fdfe77fe640 1 -- 172.21.15.17:0/1102516735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8004da0 con 0x7fdff8101de0 2024-09-10T11:49:05.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.328+0000 7fdffebe5740 1 Processor -- start 2024-09-10T11:49:05.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 -- start start 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefa8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5651fef0e2f0 con 0x5651fefa85d0 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5651feeb5cf0 con 0x5651fefb3370 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdffebe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5651fef0a2b0 con 0x5651fefa9b40 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdff6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdff6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58946/0 (socket says 172.21.15.17:58946) 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdff6d9d640 1 -- 172.21.15.17:0/2651024955 learned_addr learned my addr 172.21.15.17:0/2651024955 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.329+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdfe77fe640 1 -- 172.21.15.17:0/1102516735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdfe8019020 con 0x7fdff8101de0 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2651024955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 msgr2=0x5651fefa8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2651024955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 msgr2=0x5651fefa8a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefa8a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2651024955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fee9a3a0 con 0x5651fefb3370 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.330+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb5760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdfec03ba10 tx=0x7fdfec004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f90273143bb0105 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.331+0000 7fdfe77fe640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 0x7fdfe00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.332+0000 7fdfe77fe640 1 -- 172.21.15.17:0/1102516735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fdfe80cefd0 con 0x7fdff8101de0 2024-09-10T11:49:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.332+0000 7fdfe4ff9640 1 -- 172.21.15.17:0/2651024955 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec046040 con 0x5651fefb3370 2024-09-10T11:49:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.332+0000 7fdfe4ff9640 1 -- 172.21.15.17:0/2651024955 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec005520 con 0x5651fefb3370 2024-09-10T11:49:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.332+0000 7fdfe4ff9640 1 -- 172.21.15.17:0/2651024955 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003850 con 0x5651fefb3370 2024-09-10T11:49:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.332+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 0x7fdfe00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 -- 172.21.15.17:0/2651024955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 msgr2=0x5651fefb5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 0x7fdfe00a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdff00092f0 tx=0x7fdff0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb5760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdfec03ba10 tx=0x7fdfec004040 comp rx=0 tx=0).stop 2024-09-10T11:49:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 -- 172.21.15.17:0/2651024955 shutdown_connections 2024-09-10T11:49:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb5760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefa8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2651024955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefa8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.333+0000 7fdffebe5740 1 -- 172.21.15.17:0/2651024955 >> 172.21.15.17:0/2651024955 conn(0x5651fef71310 msgr2=0x5651fefa4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.334+0000 7fdffebe5740 1 -- 172.21.15.17:0/2651024955 shutdown_connections 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.334+0000 7fdffebe5740 1 -- 172.21.15.17:0/2651024955 wait complete. 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.334+0000 7fdffebe5740 1 -- start start 2024-09-10T11:49:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.334+0000 7fdffebe5740 1 Processor -- start 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefb2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefb3370 0x5651fefb05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5651fefb6010 con 0x5651fefa85d0 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5651feec9060 con 0x5651fefa9b40 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5651fefb6190 con 0x5651fefb3370 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdffebe5740 10 client.0 _ll_register_callbacks cb 0x5651fec1c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57642/0 (socket says 172.21.15.17:57642) 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2057697190 learned_addr learned my addr 172.21.15.17:0/2057697190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff659c640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefb2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefb3370 0x5651fefb05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2057697190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefb3370 msgr2=0x5651fefb05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefb3370 0x5651fefb05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2057697190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 msgr2=0x5651fefb2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefb2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.335+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2057697190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fec7f3c0 con 0x5651fefa9b40 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfec004520 tx=0x7fdfec004550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a1468e85b99b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdfddffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec063060 con 0x5651fefa9b40 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fdfec0048d0 con 0x5651fefa9b40 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfec005520 con 0x5651fefa9b40 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdfec046050 con 0x5651fefa9b40 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdffebe5740 10 client.25733 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5651fefc1ae0 con 0x5651fefa9b40 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.336+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec005520 con 0x5651fefa9b40 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fdfec0429f0 con 0x5651fefa9b40 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 10 client.25733 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 10 client.25733 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 20 client.25733 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651fefc5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 4 client.25733 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651fef1b860 con 0x5651fefc2e30 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdff659c640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651fefc5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdfddffb640 10 client.25733 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.337+0000 7fdff659c640 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651fefc5220 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8d3957652a4e4e99 server_cookie=3e27f6996abe97ed in_seq=0 out_seq=0 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdfddffb640 1 -- 172.21.15.17:0/2057697190 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651fef1b860 con 0x5651fefc2e30 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdfddffb640 10 client.25733 handle_command_reply: tid=0 2024-09-10T11:49:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 client.25733 shutdown 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 msgr2=0x5651fefafff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfec004520 tx=0x7fdfec004550 comp rx=0 tx=0).stop 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 shutdown_connections 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651fefc5220 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdfddffb640 0 client.25733 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefb3370 0x5651fefb05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefa9b40 0x5651fefafff0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2057697190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefb2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 >> 172.21.15.17:0/2057697190 conn(0x5651fef71310 msgr2=0x5651fefaa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 shutdown_connections 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.338+0000 7fdffebe5740 1 -- 172.21.15.17:0/2057697190 wait complete. 2024-09-10T11:49:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.339+0000 7fdffebe5740 20 client.25733 trim_cache size 0 max 16384 2024-09-10T11:49:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 Processor -- start 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 -- start start 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefbf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800e400 con 0x5651fefa85d0 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800ff40 con 0x5651fefb3370 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdffebe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800ead0 con 0x5651fefa9b40 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdff659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdff5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefbf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdff659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefaffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55768/0 (socket says 172.21.15.17:55768) 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdff659c640 1 -- 172.21.15.17:0/2402455204 learned_addr learned my addr 172.21.15.17:0/2402455204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.354+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2402455204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 msgr2=0x5651fefca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2402455204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 msgr2=0x5651fefaffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefaffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 -- 172.21.15.17:0/2402455204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fefab120 con 0x5651fefa9b40 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefbf310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfec03b940 tx=0x7fdfec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e152a36feb8905fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdfdffff640 1 -- 172.21.15.17:0/2402455204 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec06d070 con 0x5651fefa9b40 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdfdffff640 1 -- 172.21.15.17:0/2402455204 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec042a90 con 0x5651fefa9b40 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.355+0000 7fdfdffff640 1 -- 172.21.15.17:0/2402455204 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec063070 con 0x5651fefa9b40 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 -- 172.21.15.17:0/2402455204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 msgr2=0x5651fefbf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefbf310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfec03b940 tx=0x7fdfec009780 comp rx=0 tx=0).stop 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 -- 172.21.15.17:0/2402455204 shutdown_connections 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa9b40 0x5651fefbf310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 --2- 172.21.15.17:0/2402455204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa85d0 0x5651fefaffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 -- 172.21.15.17:0/2402455204 >> 172.21.15.17:0/2402455204 conn(0x5651fef71310 msgr2=0x5651fefaf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 -- 172.21.15.17:0/2402455204 shutdown_connections 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.356+0000 7fdffebe5740 1 -- 172.21.15.17:0/2402455204 wait complete. 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 -- start start 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 Processor -- start 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 0x5651fefbbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800f870 con 0x5651fefa9b40 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800f1a0 con 0x5651fefb3370 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800c3e0 con 0x5651fefa85d0 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdffebe5740 10 client.0 _ll_register_callbacks cb 0x7fdff0009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdff659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdff659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58986/0 (socket says 172.21.15.17:58986) 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdff659c640 1 -- 172.21.15.17:0/728009276 learned_addr learned my addr 172.21.15.17:0/728009276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.357+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 0x5651fefbbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff6d9d640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 -- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 msgr2=0x5651fefb6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 -- 172.21.15.17:0/728009276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 msgr2=0x5651fefbbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 0x5651fefbbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 -- 172.21.15.17:0/728009276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fefb75c0 con 0x5651fefa85d0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 0x5651fefbbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdff659c640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8004910 tx=0x7fdfe80cc9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed1d2a38773a055 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdfddffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe809fbf0 con 0x5651fefa85d0 2024-09-10T11:49:05.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfec042a90 con 0x5651fefa85d0 2024-09-10T11:49:05.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fdfe8099b40 con 0x5651fefa85d0 2024-09-10T11:49:05.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdfe80a44b0 con 0x5651fefa85d0 2024-09-10T11:49:05.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdffebe5740 10 client.25693 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:05.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.358+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5651ff02d560 con 0x5651fefa85d0 2024-09-10T11:49:05.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec042a90 con 0x5651fefa85d0 2024-09-10T11:49:05.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fdfe809cb70 con 0x5651fefa85d0 2024-09-10T11:49:05.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 10 client.25693 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 10 client.25693 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 20 client.25693 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651ff02fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 4 client.25693 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651fef15d70 con 0x5651fefc2e30 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.359+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651ff02fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdfddffb640 10 client.25693 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdff5d9b640 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651ff02fbf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=79d57a26f539097d server_cookie=f0f880f4d1d66f22 in_seq=0 out_seq=0 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdfddffb640 1 -- 172.21.15.17:0/728009276 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651fef15d70 con 0x5651fefc2e30 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdfddffb640 10 client.25693 handle_command_reply: tid=0 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 client.25693 shutdown 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 msgr2=0x5651fefbb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8004910 tx=0x7fdfe80cc9b0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 shutdown_connections 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x5651fefc2e30 0x5651ff02fbf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5651fefb3370 0x5651fefb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5651fefa9b40 0x5651fefbbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 --2- 172.21.15.17:0/728009276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651fefa85d0 0x5651fefbb840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 >> 172.21.15.17:0/728009276 conn(0x5651fef71310 msgr2=0x5651fefb1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.360+0000 7fdfddffb640 0 client.25693 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.361+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 shutdown_connections 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.361+0000 7fdffebe5740 1 -- 172.21.15.17:0/728009276 wait complete. 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.361+0000 7fdffebe5740 20 client.25693 trim_cache size 0 max 16384 2024-09-10T11:49:05.367 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 msgr2=0x7fdfe00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 0x7fdfe00a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdff00092f0 tx=0x7fdff0009600 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 msgr2=0x7fdff8196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800bf70 tx=0x7fdfe8009670 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 shutdown_connections 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fdfe00a2c00 0x7fdfe00a50c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8102790 0x7fdff81967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdff8106f10 0x7fdff819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 --2- 172.21.15.17:0/1102516735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdff8101de0 0x7fdff8196270 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.363+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 >> 172.21.15.17:0/1102516735 conn(0x7fdff80fd8e0 msgr2=0x7fdff80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.364+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 shutdown_connections 2024-09-10T11:49:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:05.364+0000 7fdffc80c640 1 -- 172.21.15.17:0/1102516735 wait complete. 2024-09-10T11:49:05.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:05 smithi017 ceph-mon[30817]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 10 KiB/s rd, 41 MiB/s wr, 7.01k op/s 2024-09-10T11:49:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:05 smithi081 ceph-mon[35059]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 10 KiB/s rd, 41 MiB/s wr, 7.01k op/s 2024-09-10T11:49:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:05 smithi026 ceph-mon[34817]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 10 KiB/s rd, 41 MiB/s wr, 7.01k op/s 2024-09-10T11:49:06.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:49:07.100 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:07.512 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:07 smithi017 ceph-mon[30817]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 -- 172.21.15.17:0/2161075620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6624102d30 msgr2=0x7f6624103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 --2- 172.21.15.17:0/2161075620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6624102d30 0x7f6624103110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6614009930 tx=0x7f661402a420 comp rx=0 tx=0).stop 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 -- 172.21.15.17:0/2161075620 shutdown_connections 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 --2- 172.21.15.17:0/2161075620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66241082a0 0x7f662410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 --2- 172.21.15.17:0/2161075620 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241036e0 0x7f6624107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 --2- 172.21.15.17:0/2161075620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6624102d30 0x7f6624103110 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 -- 172.21.15.17:0/2161075620 >> 172.21.15.17:0/2161075620 conn(0x7f66240fc7d0 msgr2=0x7f66240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 -- 172.21.15.17:0/2161075620 shutdown_connections 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 -- 172.21.15.17:0/2161075620 wait complete. 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.609+0000 7f662a1de640 1 Processor -- start 2024-09-10T11:49:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 -- start start 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241082a0 0x7f6624101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66241120a0 con 0x7f66241036e0 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6624111f20 con 0x7f66241082a0 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f662a1de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6624112220 con 0x7f6624102d30 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f66237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f66237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59006/0 (socket says 172.21.15.17:59006) 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f66237fe640 1 -- 172.21.15.17:0/4018189364 learned_addr learned my addr 172.21.15.17:0/4018189364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55782/0 (socket says 172.21.15.17:55782) 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.610+0000 7f6623fff640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241082a0 0x7f6624101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 -- 172.21.15.17:0/4018189364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 msgr2=0x7f6624100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 -- 172.21.15.17:0/4018189364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241082a0 msgr2=0x7f6624101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241082a0 0x7f6624101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 -- 172.21.15.17:0/4018189364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66241a6a60 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f66237fe640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6622ffd640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f66240697d0 tx=0x7f661800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6620ff9640 1 -- 172.21.15.17:0/4018189364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618007bb0 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6620ff9640 1 -- 172.21.15.17:0/4018189364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6618007d50 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a6d50 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f6620ff9640 1 -- 172.21.15.17:0/4018189364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618018780 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.611+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a7250 con 0x7f66241036e0 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.613+0000 7f662c5b7740 1 Processor -- start 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 -- start start 2024-09-10T11:49:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b84e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 0x55a83b84ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 0x55a83b85b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a83b7b42f0 con 0x55a83b859370 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a83b75bcf0 con 0x55a83b84fb40 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f662c5b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a83b7b02b0 con 0x55a83b84e5d0 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 0x55a83b85b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 0x55a83b84ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 0x55a83b85b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55788/0 (socket says 172.21.15.17:55788) 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f6622ffd640 1 -- 172.21.15.17:0/3306990344 learned_addr learned my addr 172.21.15.17:0/3306990344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f6623fff640 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b84e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 -- 172.21.15.17:0/3306990344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 msgr2=0x55a83b84e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b84e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 -- 172.21.15.17:0/3306990344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 msgr2=0x55a83b85b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 0x55a83b85b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f66237fe640 1 -- 172.21.15.17:0/3306990344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a83b7403a0 con 0x55a83b84e5d0 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.614+0000 7f6623fff640 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b84e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.615+0000 7f66237fe640 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 0x55a83b84ea10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f6614031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d8911240d931a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.615+0000 7f6609ffb640 1 -- 172.21.15.17:0/3306990344 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614035040 con 0x55a83b84e5d0 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.615+0000 7f6609ffb640 1 -- 172.21.15.17:0/3306990344 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66140035f0 con 0x55a83b84e5d0 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.615+0000 7f6609ffb640 1 -- 172.21.15.17:0/3306990344 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661403c640 con 0x55a83b84e5d0 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 -- 172.21.15.17:0/3306990344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 msgr2=0x55a83b84ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 0x55a83b84ea10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f6614031660 comp rx=0 tx=0).stop 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 -- 172.21.15.17:0/3306990344 shutdown_connections 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84e5d0 0x55a83b84ea10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b859370 0x55a83b85b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 --2- 172.21.15.17:0/3306990344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b84e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 -- 172.21.15.17:0/3306990344 >> 172.21.15.17:0/3306990344 conn(0x55a83b817310 msgr2=0x55a83b84ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f6620ff9640 1 -- 172.21.15.17:0/4018189364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f661800f450 con 0x7f66241036e0 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 -- 172.21.15.17:0/3306990344 shutdown_connections 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.616+0000 7f662c5b7740 1 -- 172.21.15.17:0/3306990344 wait complete. 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.617+0000 7f662c5b7740 1 -- start start 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.617+0000 7f662c5b7740 1 Processor -- start 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.617+0000 7f6620ff9640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 0x7f660c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.617+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84e5d0 0x55a83b858df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.617+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b856740 0x55a83b8654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f662c5b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a83b85c010 con 0x55a83b856740 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f662c5b7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55a83b76f060 con 0x55a83b84e5d0 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f662c5b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a83b85c190 con 0x55a83b84fb40 2024-09-10T11:49:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6620ff9640 1 -- 172.21.15.17:0/4018189364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66180d5b10 con 0x7f66241036e0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f662c5b7740 10 client.0 _ll_register_callbacks cb 0x55a83b4c28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6623fff640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 0x7f660c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6623fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b856740 0x55a83b8654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59014/0 (socket says 172.21.15.17:59014) 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 -- 172.21.15.17:0/181991762 learned_addr learned my addr 172.21.15.17:0/181991762 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 -- 172.21.15.17:0/181991762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84e5d0 msgr2=0x55a83b858df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84e5d0 0x55a83b858df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 -- 172.21.15.17:0/181991762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b856740 msgr2=0x55a83b8654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b856740 0x55a83b8654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6622ffd640 1 -- 172.21.15.17:0/181991762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a83b5253c0 con 0x55a83b84fb40 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.618+0000 7f6623fff640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 0x7f660c0a4fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f661c0098b0 tx=0x7f661c013c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f6622ffd640 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66180a2100 tx=0x7f66180a2290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef7b3a08c8552963 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f6602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66180a0540 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66140035f0 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f66180aabe0 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f66180a2b00 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f662c5b7740 10 client.25705 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.619+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a83b867fd0 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66140035f0 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f66180bb190 con 0x55a83b84fb40 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 10 client.25705 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 10 client.25705 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 20 client.25705 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:07.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8693e0 0x55a83b86b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 4 client.25705 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a83b7c1860 con 0x55a83b8693e0 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.620+0000 7f66237fe640 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8693e0 0x55a83b86b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.621+0000 7f66237fe640 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8693e0 0x55a83b86b850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a3cf461b6accca05 server_cookie=c79a3dd0203aab5b in_seq=0 out_seq=0 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.621+0000 7f6602ffd640 10 client.25705 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.622+0000 7f6602ffd640 1 -- 172.21.15.17:0/181991762 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a83b7c1860 con 0x55a83b8693e0 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.622+0000 7f6602ffd640 10 client.25705 handle_command_reply: tid=0 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.622+0000 7f662c5b7740 1 client.25705 shutdown 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 msgr2=0x55a83b8560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f66180a2100 tx=0x7f66180a2290 comp rx=0 tx=0).stop 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 shutdown_connections 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8693e0 0x55a83b86b850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b8560a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b856740 0x55a83b8654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 --2- 172.21.15.17:0/181991762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84e5d0 0x55a83b858df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 >> 172.21.15.17:0/181991762 conn(0x55a83b817310 msgr2=0x55a83b850960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f6602ffd640 0 client.25705 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 shutdown_connections 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 1 -- 172.21.15.17:0/181991762 wait complete. 2024-09-10T11:49:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.623+0000 7f662c5b7740 20 client.25705 trim_cache size 0 max 16384 2024-09-10T11:49:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.651+0000 7f662c5b7740 1 Processor -- start 2024-09-10T11:49:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 -- start start 2024-09-10T11:49:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b84ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b8652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f66237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b84ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66241af7a0 con 0x55a83b84e5d0 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.655+0000 7f662c5b7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66241b12e0 con 0x55a83b84fb40 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.656+0000 7f662c5b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66241afe70 con 0x55a83b856740 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.656+0000 7f6623fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.656+0000 7f6623fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59020/0 (socket says 172.21.15.17:59020) 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.656+0000 7f6623fff640 1 -- 172.21.15.17:0/825443959 learned_addr learned my addr 172.21.15.17:0/825443959 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:07.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.657+0000 7f6622ffd640 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b8652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6623fff640 1 -- 172.21.15.17:0/825443959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 msgr2=0x55a83b8652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6623fff640 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b8652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6623fff640 1 -- 172.21.15.17:0/825443959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 msgr2=0x55a83b84ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6623fff640 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b84ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6623fff640 1 -- 172.21.15.17:0/825443959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a83b854610 con 0x55a83b856740 2024-09-10T11:49:07.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.661+0000 7f6622ffd640 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b8652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.667+0000 7f6623fff640 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c009fa0 tx=0x7f661c00e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50bca547df1cf83a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.670+0000 7f66097fa640 1 -- 172.21.15.17:0/825443959 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c02e070 con 0x55a83b856740 2024-09-10T11:49:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.670+0000 7f66097fa640 1 -- 172.21.15.17:0/825443959 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f661c004040 con 0x55a83b856740 2024-09-10T11:49:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.670+0000 7f66097fa640 1 -- 172.21.15.17:0/825443959 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c0206b0 con 0x55a83b856740 2024-09-10T11:49:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 -- 172.21.15.17:0/825443959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 msgr2=0x55a83b8657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c009fa0 tx=0x7f661c00e000 comp rx=0 tx=0).stop 2024-09-10T11:49:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 -- 172.21.15.17:0/825443959 shutdown_connections 2024-09-10T11:49:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b856740 0x55a83b8657f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b84fb40 0x55a83b8652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 --2- 172.21.15.17:0/825443959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b84ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.673+0000 7f662c5b7740 1 -- 172.21.15.17:0/825443959 >> 172.21.15.17:0/825443959 conn(0x55a83b817310 msgr2=0x55a83b84a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.676+0000 7f662c5b7740 1 -- 172.21.15.17:0/825443959 shutdown_connections 2024-09-10T11:49:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.676+0000 7f662c5b7740 1 -- 172.21.15.17:0/825443959 wait complete. 2024-09-10T11:49:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.677+0000 7f662c5b7740 1 -- start start 2024-09-10T11:49:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.677+0000 7f662c5b7740 1 Processor -- start 2024-09-10T11:49:07.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.678+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b861820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.678+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b852a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f662c5b7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f662c5b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66241b0c10 con 0x55a83b84e5d0 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f662c5b7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66241b0540 con 0x55a83b856740 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f662c5b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66241ad780 con 0x55a83b84fb40 2024-09-10T11:49:07.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f662c5b7740 10 client.0 _ll_register_callbacks cb 0x7f661800a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b852a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f6623fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f6623fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57712/0 (socket says 172.21.15.17:57712) 2024-09-10T11:49:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.679+0000 7f6623fff640 1 -- 172.21.15.17:0/2277421162 learned_addr learned my addr 172.21.15.17:0/2277421162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f66237fe640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b861820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f6623fff640 1 -- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 msgr2=0x55a83b852a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f6623fff640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b852a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f6623fff640 1 -- 172.21.15.17:0/2277421162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 msgr2=0x55a83b861820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:07.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f6623fff640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b861820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.680+0000 7f6623fff640 1 -- 172.21.15.17:0/2277421162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a83b853510 con 0x55a83b856740 2024-09-10T11:49:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.691+0000 7f6623fff640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f661c005ee0 tx=0x7f661c009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418bbccd7402c416 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.691+0000 7f6602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:07.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.691+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c037060 con 0x55a83b856740 2024-09-10T11:49:07.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.692+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f661c004a40 con 0x55a83b856740 2024-09-10T11:49:07.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.693+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f661c004040 con 0x55a83b856740 2024-09-10T11:49:07.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.696+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f661c02e040 con 0x55a83b856740 2024-09-10T11:49:07.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.696+0000 7f662c5b7740 10 client.25751 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:07.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.696+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a83b8d3e00 con 0x55a83b856740 2024-09-10T11:49:07.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f661c004040 con 0x55a83b856740 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f661c00f040 con 0x55a83b856740 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 10 client.25751 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 10 client.25751 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 20 client.25751 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8d4400 0x55a83b8d6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 4 client.25751 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.697+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a83b7bbd70 con 0x55a83b8d4400 2024-09-10T11:49:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.698+0000 7f66237fe640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8d4400 0x55a83b8d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.699+0000 7f6602ffd640 10 client.25751 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.699+0000 7f66237fe640 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8d4400 0x55a83b8d6820 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=683d4b3fff3b33ab server_cookie=72a321359d27b7cc in_seq=0 out_seq=0 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f6602ffd640 1 -- 172.21.15.17:0/2277421162 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a83b7bbd70 con 0x55a83b8d4400 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f6602ffd640 10 client.25751 handle_command_reply: tid=0 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 client.25751 shutdown 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 msgr2=0x55a83b852fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f661c005ee0 tx=0x7f661c009600 comp rx=0 tx=0).stop 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 shutdown_connections 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55a83b8d4400 0x55a83b8d6820 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83b84fb40 0x55a83b852a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a83b856740 0x55a83b852fd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 --2- 172.21.15.17:0/2277421162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a83b84e5d0 0x55a83b861820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.700+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 >> 172.21.15.17:0/2277421162 conn(0x55a83b817310 msgr2=0x55a83b8494e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.701+0000 7f6602ffd640 0 client.25751 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.701+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 shutdown_connections 2024-09-10T11:49:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.701+0000 7f662c5b7740 1 -- 172.21.15.17:0/2277421162 wait complete. 2024-09-10T11:49:07.705 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:07 smithi081 ceph-mon[35059]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-10T11:49:07.705 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.701+0000 7f662c5b7740 20 client.25751 trim_cache size 0 max 16384 2024-09-10T11:49:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 msgr2=0x7f660c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 0x7f660c0a4fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f661c0098b0 tx=0x7f661c013c90 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 msgr2=0x7f6624100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f66240697d0 tx=0x7f661800cdd0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 shutdown_connections 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f660c0a2b10 0x7f660c0a4fd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66241082a0 0x7f6624101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66241036e0 0x7f6624100ed0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 --2- 172.21.15.17:0/4018189364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6624102d30 0x7f6624100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.702+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 >> 172.21.15.17:0/4018189364 conn(0x7f66240fc7d0 msgr2=0x7f6624105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.704+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 shutdown_connections 2024-09-10T11:49:07.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:07.704+0000 7f662a1de640 1 -- 172.21.15.17:0/4018189364 wait complete. 2024-09-10T11:49:07.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:07 smithi026 ceph-mon[34817]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 67 GiB used, 1006 GiB / 1.0 TiB avail; 9.8 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-10T11:49:08.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:49:08.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:08 smithi026 ceph-mon[34817]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 12 KiB/s rd, 51 MiB/s wr, 8.60k op/s 2024-09-10T11:49:08.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:08 smithi017 ceph-mon[30817]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 12 KiB/s rd, 51 MiB/s wr, 8.60k op/s 2024-09-10T11:49:08.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:08 smithi081 ceph-mon[35059]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 12 KiB/s rd, 51 MiB/s wr, 8.60k op/s 2024-09-10T11:49:09.095 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 -- 172.21.15.17:0/2866991439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec101de0 msgr2=0x7f8fec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 --2- 172.21.15.17:0/2866991439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec101de0 0x7f8fec1021c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009900 tx=0x7f8fe802a410 comp rx=0 tx=0).stop 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 -- 172.21.15.17:0/2866991439 shutdown_connections 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 --2- 172.21.15.17:0/2866991439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec106f10 0x7f8fec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 --2- 172.21.15.17:0/2866991439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec102790 0x7f8fec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 --2- 172.21.15.17:0/2866991439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec101de0 0x7f8fec1021c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.679+0000 7f8ff3354640 1 -- 172.21.15.17:0/2866991439 >> 172.21.15.17:0/2866991439 conn(0x7f8fec0fd8c0 msgr2=0x7f8fec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.680+0000 7f8ff3354640 1 -- 172.21.15.17:0/2866991439 shutdown_connections 2024-09-10T11:49:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.680+0000 7f8ff3354640 1 -- 172.21.15.17:0/2866991439 wait complete. 2024-09-10T11:49:09.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.680+0000 7f8ff3354640 1 Processor -- start 2024-09-10T11:49:09.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff3354640 1 -- start start 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff3354640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 0x7f8fec1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff3354640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff3354640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec106f10 0x7f8fec10dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 0x7f8fec1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.681+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 0x7f8fec1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59038/0 (socket says 172.21.15.17:59038) 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55824/0 (socket says 172.21.15.17:55824) 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 -- 172.21.15.17:0/896622615 learned_addr learned my addr 172.21.15.17:0/896622615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec111f70 con 0x7f8fec102790 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec111df0 con 0x7f8fec106f10 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1120f0 con 0x7f8fec101de0 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 -- 172.21.15.17:0/896622615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 msgr2=0x7f8fec1a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 0x7f8fec1a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 -- 172.21.15.17:0/896622615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec106f10 msgr2=0x7f8fec10dca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:49:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec106f10 0x7f8fec10dca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.682+0000 7f8ff08ef640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec10e560 con 0x7f8fec102790 2024-09-10T11:49:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e9f0 tx=0x7f8fdc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8fe27fc640 1 -- 172.21.15.17:0/896622615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00cd80 con 0x7f8fec102790 2024-09-10T11:49:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8fe27fc640 1 -- 172.21.15.17:0/896622615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fdc010910 con 0x7f8fec102790 2024-09-10T11:49:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec10e850 con 0x7f8fec102790 2024-09-10T11:49:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec1ab710 con 0x7f8fec102790 2024-09-10T11:49:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.683+0000 7f8fe27fc640 1 -- 172.21.15.17:0/896622615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0188f0 con 0x7f8fec102790 2024-09-10T11:49:09.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.686+0000 7f8fe27fc640 1 -- 172.21.15.17:0/896622615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8fdc010430 con 0x7f8fec102790 2024-09-10T11:49:09.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.687+0000 7f8ff572d740 1 Processor -- start 2024-09-10T11:49:09.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.687+0000 7f8ff572d740 1 -- start start 2024-09-10T11:49:09.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8fe27fc640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 0x7f8fd80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a01426a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01433760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a0138c2f0 con 0x562a014265d0 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562a01333cf0 con 0x562a01431370 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff572d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562a013882b0 con 0x562a01427b40 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8fe27fc640 1 -- 172.21.15.17:0/896622615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8fdc0cf280 con 0x7f8fec102790 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59050/0 (socket says 172.21.15.17:59050) 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 -- 172.21.15.17:0/847735961 learned_addr learned my addr 172.21.15.17:0/847735961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01433760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 0x7f8fd80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 -- 172.21.15.17:0/847735961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 msgr2=0x562a01433760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01433760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff10f0640 1 -- 172.21.15.17:0/847735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 msgr2=0x562a01426a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.688+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a01426a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a01426a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8ff10f0640 1 -- 172.21.15.17:0/847735961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a013183a0 con 0x562a01427b40 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009900 tx=0x7f8fe8005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16981816dc4b147a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 0x7f8fd80a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562a01427070 tx=0x7f8fe4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8fd77fe640 1 -- 172.21.15.17:0/847735961 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8040070 con 0x562a01427b40 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8fd77fe640 1 -- 172.21.15.17:0/847735961 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe8031870 con 0x562a01427b40 2024-09-10T11:49:09.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.689+0000 7f8fd77fe640 1 -- 172.21.15.17:0/847735961 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8035040 con 0x562a01427b40 2024-09-10T11:49:09.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 -- 172.21.15.17:0/847735961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 msgr2=0x562a01426090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009900 tx=0x7f8fe8005be0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 -- 172.21.15.17:0/847735961 shutdown_connections 2024-09-10T11:49:09.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01433760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a01426a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 --2- 172.21.15.17:0/847735961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01426090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 -- 172.21.15.17:0/847735961 >> 172.21.15.17:0/847735961 conn(0x562a013ef310 msgr2=0x562a01422c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 -- 172.21.15.17:0/847735961 shutdown_connections 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.690+0000 7f8ff572d740 1 -- 172.21.15.17:0/847735961 wait complete. 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 -- start start 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 Processor -- start 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01427b40 0x562a0142deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01431370 0x562a0142e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a014340b0 con 0x562a01427b40 2024-09-10T11:49:09.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562a01347060 con 0x562a014265d0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff572d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562a01434230 con 0x562a01431370 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.691+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57758/0 (socket says 172.21.15.17:57758) 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 -- 172.21.15.17:0/2940434718 learned_addr learned my addr 172.21.15.17:0/2940434718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff572d740 10 client.0 _ll_register_callbacks cb 0x562a0109a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01427b40 0x562a0142deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 -- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01431370 msgr2=0x562a0142e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01431370 0x562a0142e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 -- 172.21.15.17:0/2940434718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01427b40 msgr2=0x562a0142deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01427b40 0x562a0142deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 -- 172.21.15.17:0/2940434718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a010fd3c0 con 0x562a014265d0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fe802a930 tx=0x7f8fe8031500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d6505e1d14b0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8fd4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.692+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8040070 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe8031870 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8fe8004240 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8fe8035040 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 10 client.25760 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562a0143fa70 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe8031870 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8fe8003680 con 0x562a014265d0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 10 client.25760 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 10 client.25760 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 20 client.25760 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014431b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 4 client.25760 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.693+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a01399860 con 0x562a01440dc0 2024-09-10T11:49:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.694+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.695+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014431b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe9e17447fa1b27 server_cookie=cbeee63032dc7b8c in_seq=0 out_seq=0 2024-09-10T11:49:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.695+0000 7f8fd4ff9640 10 client.25760 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.695+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/2940434718 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a01399860 con 0x562a01440dc0 2024-09-10T11:49:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.695+0000 7f8fd4ff9640 10 client.25760 handle_command_reply: tid=0 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.695+0000 7f8ff572d740 1 client.25760 shutdown 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 msgr2=0x562a01430c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fe802a930 tx=0x7f8fe8031500 comp rx=0 tx=0).stop 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 shutdown_connections 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014431b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01431370 0x562a0142e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8fd4ff9640 0 client.25760 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01427b40 0x562a0142deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2940434718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a014265d0 0x562a01430c00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 >> 172.21.15.17:0/2940434718 conn(0x562a013ef310 msgr2=0x562a01428930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 shutdown_connections 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 1 -- 172.21.15.17:0/2940434718 wait complete. 2024-09-10T11:49:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.696+0000 7f8ff572d740 20 client.25760 trim_cache size 0 max 16384 2024-09-10T11:49:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 Processor -- start 2024-09-10T11:49:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 -- start start 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01421c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01448780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000e400 con 0x562a014265d0 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000ff40 con 0x562a01431370 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.710+0000 7f8ff572d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000ead0 con 0x562a01427b40 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55856/0 (socket says 172.21.15.17:55856) 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01448780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff10f0640 1 -- 172.21.15.17:0/2525855511 learned_addr learned my addr 172.21.15.17:0/2525855511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01421c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 -- 172.21.15.17:0/2525855511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 msgr2=0x562a01421c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01421c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 -- 172.21.15.17:0/2525855511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 msgr2=0x562a0143d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 -- 172.21.15.17:0/2525855511 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a01426ea0 con 0x562a01431370 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01421c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01448780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4010a70 tx=0x7f8fe40098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bb8c67e3112986 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8fd6ffd640 1 -- 172.21.15.17:0/2525855511 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4009be0 con 0x562a01431370 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.711+0000 7f8fd6ffd640 1 -- 172.21.15.17:0/2525855511 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe4013030 con 0x562a01431370 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8fd6ffd640 1 -- 172.21.15.17:0/2525855511 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400ed50 con 0x562a01431370 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 -- 172.21.15.17:0/2525855511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 msgr2=0x562a01448780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01448780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4010a70 tx=0x7f8fe40098e0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 -- 172.21.15.17:0/2525855511 shutdown_connections 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a01427b40 0x562a01421c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01431370 0x562a01448780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 --2- 172.21.15.17:0/2525855511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a014265d0 0x562a0143d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 -- 172.21.15.17:0/2525855511 >> 172.21.15.17:0/2525855511 conn(0x562a013ef310 msgr2=0x562a01421500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 -- 172.21.15.17:0/2525855511 shutdown_connections 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.712+0000 7f8ff572d740 1 -- 172.21.15.17:0/2525855511 wait complete. 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 -- start start 2024-09-10T11:49:09.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 Processor -- start 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01427b40 0x562a01435150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 0x562a014358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000f870 con 0x562a01431370 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000f1a0 con 0x562a01427b40 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd000c3e0 con 0x562a014265d0 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.713+0000 7f8ff572d740 10 client.0 _ll_register_callbacks cb 0x7f8fe4009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59066/0 (socket says 172.21.15.17:59066) 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 -- 172.21.15.17:0/1923279384 learned_addr learned my addr 172.21.15.17:0/1923279384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 0x562a014358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01427b40 0x562a01435150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 -- 172.21.15.17:0/1923279384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01427b40 msgr2=0x562a01435150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01427b40 0x562a01435150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 -- 172.21.15.17:0/1923279384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 msgr2=0x562a014358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 0x562a014358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 -- 172.21.15.17:0/1923279384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a01429120 con 0x562a014265d0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff18f1640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 0x562a014358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8ff10f0640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8003ad0 tx=0x7f8fe8005580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3e08913451ffaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8fd4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8061060 con 0x562a014265d0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe4013030 con 0x562a014265d0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.714+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f8fe8004240 con 0x562a014265d0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8fe8040040 con 0x562a014265d0 2024-09-10T11:49:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 10 client.25723 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562a014ab680 con 0x562a014265d0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe4013030 con 0x562a014265d0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8fe8004b70 con 0x562a014265d0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 10 client.25723 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 10 client.25723 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 20 client.25723 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 4 client.25723 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.715+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a01393d70 con 0x562a01440dc0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.716+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.716+0000 7f8fd4ff9640 10 client.25723 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.716+0000 7f8ff08ef640 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014add20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30efc8e1d91c6cd3 server_cookie=26abea08a674aaec in_seq=0 out_seq=0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.716+0000 7f8fd4ff9640 1 -- 172.21.15.17:0/1923279384 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a01393d70 con 0x562a01440dc0 2024-09-10T11:49:09.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8fd4ff9640 10 client.25723 handle_command_reply: tid=0 2024-09-10T11:49:09.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 client.25723 shutdown 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 msgr2=0x562a01439e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8003ad0 tx=0x7f8fe8005580 comp rx=0 tx=0).stop 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 shutdown_connections 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x562a01440dc0 0x562a014add20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a01431370 0x562a014358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a01427b40 0x562a01435150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 --2- 172.21.15.17:0/1923279384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562a014265d0 0x562a01439e20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8fd4ff9640 0 client.25723 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 >> 172.21.15.17:0/1923279384 conn(0x562a013ef310 msgr2=0x562a01428930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 shutdown_connections 2024-09-10T11:49:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.717+0000 7f8ff572d740 1 -- 172.21.15.17:0/1923279384 wait complete. 2024-09-10T11:49:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff572d740 20 client.25723 trim_cache size 0 max 16384 2024-09-10T11:49:09.724 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 msgr2=0x7f8fd80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 0x7f8fd80a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562a01427070 tx=0x7f8fe4009500 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 msgr2=0x7f8fec1a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e9f0 tx=0x7f8fdc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 shutdown_connections 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f8fd80a2c00 0x7f8fd80a50c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8fec106f10 0x7f8fec10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fec102790 0x7f8fec1a4cb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 --2- 172.21.15.17:0/896622615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec101de0 0x7f8fec1a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.718+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 >> 172.21.15.17:0/896622615 conn(0x7f8fec0fd8c0 msgr2=0x7f8fec0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.719+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 shutdown_connections 2024-09-10T11:49:09.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:09.719+0000 7f8ff3354640 1 -- 172.21.15.17:0/896622615 wait complete. 2024-09-10T11:49:10.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:49:10.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:10 smithi081 ceph-mon[35059]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 37 MiB/s wr, 6.08k op/s 2024-09-10T11:49:10.959 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:10 smithi017 ceph-mon[30817]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 37 MiB/s wr, 6.08k op/s 2024-09-10T11:49:11.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:10 smithi026 ceph-mon[34817]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 37 MiB/s wr, 6.08k op/s 2024-09-10T11:49:11.073 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:11.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 -- 172.21.15.17:0/81599750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80696e0 msgr2=0x7f94b8100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 --2- 172.21.15.17:0/81599750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80696e0 0x7f94b8100430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009900 tx=0x7f94a802a410 comp rx=0 tx=0).stop 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 -- 172.21.15.17:0/81599750 shutdown_connections 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 --2- 172.21.15.17:0/81599750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 0x7f94b81052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 --2- 172.21.15.17:0/81599750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b8069b50 0x7f94b8100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 --2- 172.21.15.17:0/81599750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80696e0 0x7f94b8100430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 -- 172.21.15.17:0/81599750 >> 172.21.15.17:0/81599750 conn(0x7f94b8077230 msgr2=0x7f94b80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 -- 172.21.15.17:0/81599750 shutdown_connections 2024-09-10T11:49:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.726+0000 7f94bdce1640 1 -- 172.21.15.17:0/81599750 wait complete. 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.727+0000 7f94bdce1640 1 Processor -- start 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.727+0000 7f94bdce1640 1 -- start start 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b80696e0 0x7f94b8102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 0x7f94b81035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8110e60 con 0x7f94b8104e30 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8110ce0 con 0x7f94b80696e0 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94bdce1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8110fe0 con 0x7f94b8069b50 2024-09-10T11:49:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58838/0 (socket says 172.21.15.17:58838) 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1313739352 learned_addr learned my addr 172.21.15.17:0/1313739352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 0x7f94b81035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b77fe640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b80696e0 0x7f94b8102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1313739352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b80696e0 msgr2=0x7f94b8102b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b80696e0 0x7f94b8102b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 msgr2=0x7f94b81035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 0x7f94b81035a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.728+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1313739352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b81a6930 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00e9f0 tx=0x7f94ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94b4ff9640 1 -- 172.21.15.17:0/1313739352 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00cd80 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94b4ff9640 1 -- 172.21.15.17:0/1313739352 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ac010910 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b81a6c20 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b81a71b0 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.729+0000 7f94b4ff9640 1 -- 172.21.15.17:0/1313739352 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac018980 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.733+0000 7f94b4ff9640 1 -- 172.21.15.17:0/1313739352 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f94ac010ac0 con 0x7f94b8069b50 2024-09-10T11:49:11.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.733+0000 7f94c00ba740 1 Processor -- start 2024-09-10T11:49:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.733+0000 7f94c00ba740 1 -- start start 2024-09-10T11:49:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.733+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94c00ba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55585aeb82f0 con 0x55585af5d370 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94c00ba740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55585ae5fcf0 con 0x55585af525d0 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94c00ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55585aeb42b0 con 0x55585af53b40 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af52a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42246/0 (socket says 172.21.15.17:42246) 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b77fe640 1 -- 172.21.15.17:0/1736844520 learned_addr learned my addr 172.21.15.17:0/1736844520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1736844520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 msgr2=0x55585af52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1736844520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 msgr2=0x55585af52a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af52a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.734+0000 7f94b6ffd640 1 -- 172.21.15.17:0/1736844520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55585ae443a0 con 0x55585af5d370 2024-09-10T11:49:11.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af5f760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0cce20 tx=0x7f94ac0d7930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a03bd800f38871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f949dffb640 1 -- 172.21.15.17:0/1736844520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0e2070 con 0x55585af5d370 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f949dffb640 1 -- 172.21.15.17:0/1736844520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ac0d1480 con 0x55585af5d370 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f949dffb640 1 -- 172.21.15.17:0/1736844520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0dda70 con 0x55585af5d370 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f94b4ff9640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 0x7f94a00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.735+0000 7f94b7fff640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 0x7f94a00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94b4ff9640 1 -- 172.21.15.17:0/1313739352 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f94ac0cf3d0 con 0x7f94b8069b50 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 -- 172.21.15.17:0/1736844520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 msgr2=0x55585af5f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94b7fff640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 0x7f94a00a5140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94b0005fd0 tx=0x7f94b0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af5f760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0cce20 tx=0x7f94ac0d7930 comp rx=0 tx=0).stop 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 -- 172.21.15.17:0/1736844520 shutdown_connections 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af5f760 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af52a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 --2- 172.21.15.17:0/1736844520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 -- 172.21.15.17:0/1736844520 >> 172.21.15.17:0/1736844520 conn(0x55585af1b310 msgr2=0x55585af4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 -- 172.21.15.17:0/1736844520 shutdown_connections 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.736+0000 7f94c00ba740 1 -- 172.21.15.17:0/1736844520 wait complete. 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 -- start start 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 Processor -- start 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af5cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 0x55585af5a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55585af60070 con 0x55585af53b40 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55585ae73060 con 0x55585af525d0 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55585af601f0 con 0x55585af5d370 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.737+0000 7f94c00ba740 10 client.0 _ll_register_callbacks cb 0x55585abc68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 0x55585af5a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55306/0 (socket says 172.21.15.17:55306) 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 0x55585af5a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58856/0 (socket says 172.21.15.17:58856) 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3491952702 learned_addr learned my addr 172.21.15.17:0/3491952702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:11.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3491952702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 msgr2=0x55585af5a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 0x55585af5a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 msgr2=0x55585af5cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af5cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3491952702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55585ac293c0 con 0x55585af53b40 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f94ac098040 tx=0x7f94ac0cff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aebde6d7b02be9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f9496ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac086070 con 0x55585af53b40 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ac0d1480 con 0x55585af53b40 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.738+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f94ac099ee0 con 0x55585af53b40 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f94ac097e80 con 0x55585af53b40 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 10 client.16107 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:11.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55585af60070 con 0x55585af53b40 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ac0d1480 con 0x55585af53b40 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f94ac09be40 con 0x55585af53b40 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 10 client.16107 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 10 client.16107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 20 client.16107 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.739+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585af6cd20 0x55585af6f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.740+0000 7f94c00ba740 4 client.16107 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.740+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55585aec5860 con 0x55585af6cd20 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.740+0000 7f94b77fe640 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585af6cd20 0x55585af6f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.740+0000 7f94b77fe640 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585af6cd20 0x55585af6f110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2230682ca74d88bb server_cookie=3a5dae85cf63c3e7 in_seq=0 out_seq=0 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.740+0000 7f9496ffd640 10 client.16107 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f9496ffd640 1 -- 172.21.15.17:0/3491952702 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55585aec5860 con 0x55585af6cd20 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f9496ffd640 10 client.16107 handle_command_reply: tid=0 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 client.16107 shutdown 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 msgr2=0x55585af5a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f94ac098040 tx=0x7f94ac0cff10 comp rx=0 tx=0).stop 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 shutdown_connections 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585af6cd20 0x55585af6f110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af5d370 0x55585af5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af53b40 0x55585af5a090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f9496ffd640 0 client.16107 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3491952702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af5cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 >> 172.21.15.17:0/3491952702 conn(0x55585af1b310 msgr2=0x55585af54960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 shutdown_connections 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.741+0000 7f94c00ba740 1 -- 172.21.15.17:0/3491952702 wait complete. 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.742+0000 7f94c00ba740 20 client.16107 trim_cache size 0 max 16384 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 Processor -- start 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 -- start start 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 0x55585af4d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af74cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81af8a0 con 0x55585af5d370 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81b13e0 con 0x55585af53b40 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.757+0000 7f94c00ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81aff70 con 0x55585af525d0 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 0x55585af4d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 0x55585af4d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58864/0 (socket says 172.21.15.17:58864) 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42270/0 (socket says 172.21.15.17:42270) 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b77fe640 1 -- 172.21.15.17:0/944214785 learned_addr learned my addr 172.21.15.17:0/944214785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b7fff640 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af74cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 -- 172.21.15.17:0/944214785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 msgr2=0x55585af4d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 0x55585af4d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 -- 172.21.15.17:0/944214785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 msgr2=0x55585af74cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af74cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 -- 172.21.15.17:0/944214785 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55585af4e390 con 0x55585af53b40 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94ac099e90 tx=0x7f94ac00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d843e6c442bab0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.758+0000 7f949d7fa640 1 -- 172.21.15.17:0/944214785 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac086070 con 0x55585af53b40 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.759+0000 7f949d7fa640 1 -- 172.21.15.17:0/944214785 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ac09c2e0 con 0x55585af53b40 2024-09-10T11:49:11.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.759+0000 7f949d7fa640 1 -- 172.21.15.17:0/944214785 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac09b540 con 0x55585af53b40 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- 172.21.15.17:0/944214785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 msgr2=0x55585af74770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94ac099e90 tx=0x7f94ac00cf20 comp rx=0 tx=0).stop 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- 172.21.15.17:0/944214785 shutdown_connections 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af74cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af53b40 0x55585af74770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 --2- 172.21.15.17:0/944214785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af525d0 0x55585af4d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- 172.21.15.17:0/944214785 >> 172.21.15.17:0/944214785 conn(0x55585af1b310 msgr2=0x55585af5c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- 172.21.15.17:0/944214785 shutdown_connections 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- 172.21.15.17:0/944214785 wait complete. 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.760+0000 7f94c00ba740 1 -- start start 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 Processor -- start 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af65d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af56ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af57500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81b0d10 con 0x55585af5d370 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81b0640 con 0x55585af525d0 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94b81ad880 con 0x55585af53b40 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.761+0000 7f94c00ba740 10 client.0 _ll_register_callbacks cb 0x7f94ac0e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af57500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af57500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55318/0 (socket says 172.21.15.17:55318) 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b7fff640 1 -- 172.21.15.17:0/3381047777 learned_addr learned my addr 172.21.15.17:0/3381047777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af56ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 msgr2=0x55585af65d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af65d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3381047777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 msgr2=0x55585af57500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af57500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.762+0000 7f94b6ffd640 1 -- 172.21.15.17:0/3381047777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55585af5ab40 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f94b6ffd640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af56ef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09c490 tx=0x7f94ac0d2e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a753bbaa37d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f9496ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0d6020 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ac09c2e0 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f94ac09b230 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f94ac0ba050 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f94c00ba740 10 client.25741 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55585af5ab40 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.763+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ac09c2e0 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f94ac097930 con 0x55585af53b40 2024-09-10T11:49:11.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 10 client.25741 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 10 client.25741 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 20 client.25741 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585afd79b0 0x55585afd9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 4 client.25741 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55585aebfd70 con 0x55585afd79b0 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94b77fe640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585afd79b0 0x55585afd9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f9496ffd640 10 client.25741 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.764+0000 7f94b77fe640 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585afd79b0 0x55585afd9da0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61158e0797ea907f server_cookie=3946a813366f4e30 in_seq=0 out_seq=0 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f9496ffd640 1 -- 172.21.15.17:0/3381047777 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55585aebfd70 con 0x55585afd79b0 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f9496ffd640 10 client.25741 handle_command_reply: tid=0 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 client.25741 shutdown 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 msgr2=0x55585af56ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af56ef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09c490 tx=0x7f94ac0d2e10 comp rx=0 tx=0).stop 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 shutdown_connections 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x55585afd79b0 0x55585afd9da0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55585af53b40 0x55585af56ef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55585af5d370 0x55585af57500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 --2- 172.21.15.17:0/3381047777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55585af525d0 0x55585af65d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 >> 172.21.15.17:0/3381047777 conn(0x55585af1b310 msgr2=0x55585af58830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.765+0000 7f9496ffd640 0 client.25741 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.766+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 shutdown_connections 2024-09-10T11:49:11.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.766+0000 7f94c00ba740 1 -- 172.21.15.17:0/3381047777 wait complete. 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.766+0000 7f94c00ba740 20 client.25741 trim_cache size 0 max 16384 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 msgr2=0x7f94a00a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 0x7f94a00a5140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f94b0005fd0 tx=0x7f94b0009600 comp rx=0 tx=0).stop 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 msgr2=0x7f94b8103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00e9f0 tx=0x7f94ac00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 shutdown_connections 2024-09-10T11:49:11.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f94a00a2c80 0x7f94a00a5140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b8069b50 0x7f94b8103060 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94b8104e30 0x7f94b81035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 --2- 172.21.15.17:0/1313739352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94b80696e0 0x7f94b8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 >> 172.21.15.17:0/1313739352 conn(0x7f94b8077230 msgr2=0x7f94b80fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 shutdown_connections 2024-09-10T11:49:11.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:11.767+0000 7f94bdce1640 1 -- 172.21.15.17:0/1313739352 wait complete. 2024-09-10T11:49:12.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:49:12.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:12 smithi081 ceph-mon[35059]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 46 MiB/s wr, 7.66k op/s 2024-09-10T11:49:13.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:12 smithi026 ceph-mon[34817]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 46 MiB/s wr, 7.66k op/s 2024-09-10T11:49:13.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:12 smithi017 ceph-mon[30817]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 10 KiB/s rd, 46 MiB/s wr, 7.66k op/s 2024-09-10T11:49:13.109 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.779+0000 7f8131733640 1 -- 172.21.15.17:0/2081761500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a5170 msgr2=0x7f81240b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.779+0000 7f8131733640 1 --2- 172.21.15.17:0/2081761500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a5170 0x7f81240b7030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8120009860 tx=0x7f812002a410 comp rx=0 tx=0).stop 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 -- 172.21.15.17:0/2081761500 shutdown_connections 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 --2- 172.21.15.17:0/2081761500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a5170 0x7f81240b7030 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 --2- 172.21.15.17:0/2081761500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 0x7f81240b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 --2- 172.21.15.17:0/2081761500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a4850 0x7f81240a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 -- 172.21.15.17:0/2081761500 >> 172.21.15.17:0/2081761500 conn(0x7f812401a110 msgr2=0x7f812401a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 -- 172.21.15.17:0/2081761500 shutdown_connections 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.781+0000 7f8131733640 1 -- 172.21.15.17:0/2081761500 wait complete. 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 Processor -- start 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 -- start start 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a4850 0x7f812400b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 0x7f8124006640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81240bcfc0 con 0x7f81240a5170 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f81240bce40 con 0x7f81240b7570 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.782+0000 7f8131733640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81240bd140 con 0x7f81240a4850 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.783+0000 7f812affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a4850 0x7f812400b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.784+0000 7f812a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.784+0000 7f812a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55342/0 (socket says 172.21.15.17:55342) 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.784+0000 7f812a7fc640 1 -- 172.21.15.17:0/1399039235 learned_addr learned my addr 172.21.15.17:0/1399039235 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.784+0000 7f812b7fe640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 0x7f8124006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.785+0000 7f812a7fc640 1 -- 172.21.15.17:0/1399039235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a4850 msgr2=0x7f812400b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.785+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a4850 0x7f812400b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.785+0000 7f812a7fc640 1 -- 172.21.15.17:0/1399039235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 msgr2=0x7f8124006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.785+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 0x7f8124006640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.785+0000 7f812a7fc640 1 -- 172.21.15.17:0/1399039235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8124006f00 con 0x7f81240a5170 2024-09-10T11:49:13.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.786+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f812002aa00 tx=0x7f8120030a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.788+0000 7f8113fff640 1 -- 172.21.15.17:0/1399039235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120040070 con 0x7f81240a5170 2024-09-10T11:49:13.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.788+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8124007190 con 0x7f81240a5170 2024-09-10T11:49:13.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.788+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8124013250 con 0x7f81240a5170 2024-09-10T11:49:13.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.791+0000 7f8133b0c740 1 Processor -- start 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 -- start start 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 0x55d12d07d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07d780 0x55d12d07dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d08a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d12cfe32f0 con 0x55d12d07d780 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d12cf8acf0 con 0x55d12d088520 2024-09-10T11:49:13.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.792+0000 7f8133b0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d12cfdf2b0 con 0x55d12d07ecf0 2024-09-10T11:49:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.793+0000 7f8113fff640 1 -- 172.21.15.17:0/1399039235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8120045460 con 0x7f81240a5170 2024-09-10T11:49:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.793+0000 7f8113fff640 1 -- 172.21.15.17:0/1399039235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120031620 con 0x7f81240a5170 2024-09-10T11:49:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.794+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 0x55d12d07d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.794+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 0x55d12d07d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58904/0 (socket says 172.21.15.17:58904) 2024-09-10T11:49:13.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.794+0000 7f812b7fe640 1 -- 172.21.15.17:0/3639489396 learned_addr learned my addr 172.21.15.17:0/3639489396 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:13.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.794+0000 7f812a7fc640 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d08a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.794+0000 7f812affd640 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07d780 0x55d12d07dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.797+0000 7f812a7fc640 1 -- 172.21.15.17:0/3639489396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 msgr2=0x55d12d07d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.797+0000 7f812a7fc640 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 0x55d12d07d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.797+0000 7f812a7fc640 1 -- 172.21.15.17:0/3639489396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07d780 msgr2=0x55d12d07dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.797+0000 7f812a7fc640 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07d780 0x55d12d07dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.797+0000 7f812a7fc640 1 -- 172.21.15.17:0/3639489396 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d12cf6f3a0 con 0x55d12d088520 2024-09-10T11:49:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.803+0000 7f812a7fc640 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d08a910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f812400c150 tx=0x7f812002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a732eedf650adc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.804+0000 7f8113fff640 1 -- 172.21.15.17:0/1399039235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8120039040 con 0x7f81240a5170 2024-09-10T11:49:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.805+0000 7f8113fff640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 0x7f81140a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.806+0000 7f81117fa640 1 -- 172.21.15.17:0/3639489396 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81200f48c0 con 0x55d12d088520 2024-09-10T11:49:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.806+0000 7f81117fa640 1 -- 172.21.15.17:0/3639489396 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81200f9020 con 0x55d12d088520 2024-09-10T11:49:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.806+0000 7f81117fa640 1 -- 172.21.15.17:0/3639489396 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81200f35e0 con 0x55d12d088520 2024-09-10T11:49:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.807+0000 7f8133b0c740 1 -- 172.21.15.17:0/3639489396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 msgr2=0x55d12d08a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.807+0000 7f8133b0c740 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d08a910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f812400c150 tx=0x7f812002a410 comp rx=0 tx=0).stop 2024-09-10T11:49:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.807+0000 7f8113fff640 1 -- 172.21.15.17:0/1399039235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f81200f0fa0 con 0x7f81240a5170 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f812b7fe640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 0x7f81140a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 -- 172.21.15.17:0/3639489396 shutdown_connections 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d08a910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07d780 0x55d12d07dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 --2- 172.21.15.17:0/3639489396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07ecf0 0x55d12d07d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 -- 172.21.15.17:0/3639489396 >> 172.21.15.17:0/3639489396 conn(0x55d12d046310 msgr2=0x55d12d079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 -- 172.21.15.17:0/3639489396 shutdown_connections 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 -- 172.21.15.17:0/3639489396 wait complete. 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.809+0000 7f8133b0c740 1 -- start start 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.810+0000 7f8133b0c740 1 Processor -- start 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.810+0000 7f812b7fe640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 0x7f81140a5260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f812c0680a0 tx=0x7f812c050650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d087d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d085500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d12d08afe0 con 0x55d12d07ecf0 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d12cf9e060 con 0x55d12d088520 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d12d08b160 con 0x55d12d07d780 2024-09-10T11:49:13.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f8133b0c740 10 client.0 _ll_register_callbacks cb 0x55d12ccf18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f812a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f812a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55346/0 (socket says 172.21.15.17:55346) 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.811+0000 7f812a7fc640 1 -- 172.21.15.17:0/1385436833 learned_addr learned my addr 172.21.15.17:0/1385436833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 -- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 msgr2=0x55d12d087d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d087d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 -- 172.21.15.17:0/1385436833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 msgr2=0x55d12d085500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d085500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 -- 172.21.15.17:0/1385436833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d12cd543c0 con 0x55d12d07ecf0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f812a7fc640 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f81200c2fd0 tx=0x7f8120049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a299d899ba5e6da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f810eff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81200f8070 con 0x55d12d07ecf0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81200f9020 con 0x55d12d07ecf0 2024-09-10T11:49:13.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.812+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f81200ba100 con 0x55d12d07ecf0 2024-09-10T11:49:13.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.813+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f81200b9d30 con 0x55d12d07ecf0 2024-09-10T11:49:13.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.815+0000 7f8133b0c740 10 client.16122 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:13.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.815+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d12d08afe0 con 0x55d12d07ecf0 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.815+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81200f9020 con 0x55d12d07ecf0 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.816+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f812004d030 con 0x55d12d07ecf0 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 10 client.16122 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 20 client.16122 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d097a10 0x55d12d099e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 4 client.16122 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d12cff0860 con 0x55d12d097a10 2024-09-10T11:49:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.819+0000 7f812affd640 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d097a10 0x55d12d099e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.835+0000 7f812affd640 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d097a10 0x55d12d099e00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37410a23c0fe1662 server_cookie=98029cc2c6fb80d6 in_seq=0 out_seq=0 2024-09-10T11:49:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.835+0000 7f810eff5640 10 client.16122 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.837+0000 7f810eff5640 1 -- 172.21.15.17:0/1385436833 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d12cff0860 con 0x55d12d097a10 2024-09-10T11:49:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.837+0000 7f810eff5640 10 client.16122 handle_command_reply: tid=0 2024-09-10T11:49:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.837+0000 7f8133b0c740 1 client.16122 shutdown 2024-09-10T11:49:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.837+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 msgr2=0x55d12d084fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.837+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f81200c2fd0 tx=0x7f8120049000 comp rx=0 tx=0).stop 2024-09-10T11:49:13.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 shutdown_connections 2024-09-10T11:49:13.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d097a10 0x55d12d099e00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d085500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d084fc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 --2- 172.21.15.17:0/1385436833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d087d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.838+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 >> 172.21.15.17:0/1385436833 conn(0x55d12d046310 msgr2=0x55d12d07fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.839+0000 7f810eff5640 0 client.16122 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.839+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 shutdown_connections 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.839+0000 7f8133b0c740 1 -- 172.21.15.17:0/1385436833 wait complete. 2024-09-10T11:49:13.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.839+0000 7f8133b0c740 20 client.16122 trim_cache size 0 max 16384 2024-09-10T11:49:13.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.866+0000 7f8133b0c740 1 Processor -- start 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 -- start start 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d079fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d0802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f811800e430 con 0x55d12d07ecf0 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f811800ff70 con 0x55d12d088520 2024-09-10T11:49:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.867+0000 7f8133b0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f811800eb00 con 0x55d12d07d780 2024-09-10T11:49:13.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42320/0 (socket says 172.21.15.17:42320) 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 -- 172.21.15.17:0/2246696349 learned_addr learned my addr 172.21.15.17:0/2246696349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812affd640 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d079fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 -- 172.21.15.17:0/2246696349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 msgr2=0x55d12d079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d079fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 -- 172.21.15.17:0/2246696349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 msgr2=0x55d12d0802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d0802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.868+0000 7f812b7fe640 1 -- 172.21.15.17:0/2246696349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d12d07ab10 con 0x55d12d088520 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.869+0000 7f812b7fe640 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f812c050a30 tx=0x7f812c068410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c3317442bbf4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.869+0000 7f8110ff9640 1 -- 172.21.15.17:0/2246696349 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c08d070 con 0x55d12d088520 2024-09-10T11:49:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.870+0000 7f8110ff9640 1 -- 172.21.15.17:0/2246696349 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812c083050 con 0x55d12d088520 2024-09-10T11:49:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.870+0000 7f8110ff9640 1 -- 172.21.15.17:0/2246696349 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c088be0 con 0x55d12d088520 2024-09-10T11:49:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 -- 172.21.15.17:0/2246696349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 msgr2=0x55d12d080810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f812c050a30 tx=0x7f812c068410 comp rx=0 tx=0).stop 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 -- 172.21.15.17:0/2246696349 shutdown_connections 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d080810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d0802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 --2- 172.21.15.17:0/2246696349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d079fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 -- 172.21.15.17:0/2246696349 >> 172.21.15.17:0/2246696349 conn(0x55d12d046310 msgr2=0x55d12d0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 -- 172.21.15.17:0/2246696349 shutdown_connections 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.871+0000 7f8133b0c740 1 -- 172.21.15.17:0/2246696349 wait complete. 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 -- start start 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 Processor -- start 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d081d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d082250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f811800f8a0 con 0x55d12d07ecf0 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f811800f1d0 con 0x55d12d088520 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.872+0000 7f8133b0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f811800c410 con 0x55d12d07d780 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.873+0000 7f8133b0c740 10 client.0 _ll_register_callbacks cb 0x7f81200f2940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.873+0000 7f812affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58922/0 (socket says 172.21.15.17:58922) 2024-09-10T11:49:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 -- 172.21.15.17:0/749238305 learned_addr learned my addr 172.21.15.17:0/749238305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 -- 172.21.15.17:0/749238305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 msgr2=0x55d12d082250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d082250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 -- 172.21.15.17:0/749238305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 msgr2=0x55d12d081d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d081d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.874+0000 7f812affd640 1 -- 172.21.15.17:0/749238305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d12d082a80 con 0x55d12d07d780 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.875+0000 7f812affd640 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55d12d09a620 tx=0x7f811c011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b8a1f5f23fb4e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.875+0000 7f810eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.876+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c004260 con 0x55d12d07d780 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.876+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f812c083050 con 0x55d12d07d780 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.876+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f811c004400 con 0x55d12d07d780 2024-09-10T11:49:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.876+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f811c02a050 con 0x55d12d07d780 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.877+0000 7f8133b0c740 10 client.25756 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.877+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d12d1136e0 con 0x55d12d07d780 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.877+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812c083050 con 0x55d12d07d780 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.877+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8120003d00 con 0x55d12d07d780 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 10 client.25756 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 10 client.25756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 20 client.25756 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d113e40 0x55d12d1162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 4 client.25756 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d12cfead70 con 0x55d12d113e40 2024-09-10T11:49:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.878+0000 7f812a7fc640 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d113e40 0x55d12d1162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.879+0000 7f810eff5640 10 client.25756 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:13.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.885+0000 7f812a7fc640 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d113e40 0x55d12d1162c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d6f9b023e968d13 server_cookie=dc60707e8d74b29b in_seq=0 out_seq=0 2024-09-10T11:49:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f810eff5640 1 -- 172.21.15.17:0/749238305 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d12cfead70 con 0x55d12d113e40 2024-09-10T11:49:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f810eff5640 10 client.25756 handle_command_reply: tid=0 2024-09-10T11:49:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 client.25756 shutdown 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 msgr2=0x55d12d090b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55d12d09a620 tx=0x7f811c011b50 comp rx=0 tx=0).stop 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 shutdown_connections 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d12d113e40 0x55d12d1162c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d12d088520 0x55d12d082250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d12d07ecf0 0x55d12d081d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 --2- 172.21.15.17:0/749238305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d12d07d780 0x55d12d090b90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.887+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 >> 172.21.15.17:0/749238305 conn(0x55d12d046310 msgr2=0x55d12d078690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.889+0000 7f810eff5640 0 client.25756 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:13.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.889+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 shutdown_connections 2024-09-10T11:49:13.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.889+0000 7f8133b0c740 1 -- 172.21.15.17:0/749238305 wait complete. 2024-09-10T11:49:13.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.889+0000 7f8133b0c740 20 client.25756 trim_cache size 0 max 16384 2024-09-10T11:49:13.892 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:13.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.894+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 msgr2=0x7f81140a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 0x7f81140a5260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f812c0680a0 tx=0x7f812c050650 comp rx=0 tx=0).stop 2024-09-10T11:49:13.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 msgr2=0x7f812400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:13.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f812002aa00 tx=0x7f8120030a80 comp rx=0 tx=0).stop 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 shutdown_connections 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f81140a2da0 0x7f81140a5260 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.895+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81240b7570 0x7f8124006640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.896+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81240a5170 0x7f812400ba60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.896+0000 7f8131733640 1 --2- 172.21.15.17:0/1399039235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81240a4850 0x7f812400b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.896+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 >> 172.21.15.17:0/1399039235 conn(0x7f812401a110 msgr2=0x7f81240b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:13.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.898+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 shutdown_connections 2024-09-10T11:49:13.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:13.899+0000 7f8131733640 1 -- 172.21.15.17:0/1399039235 wait complete. 2024-09-10T11:49:14.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:14 smithi081 ceph-mon[35059]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 42 MiB/s wr, 6.93k op/s 2024-09-10T11:49:15.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:14 smithi026 ceph-mon[34817]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 42 MiB/s wr, 6.93k op/s 2024-09-10T11:49:15.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:14 smithi017 ceph-mon[30817]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 8.1 KiB/s rd, 42 MiB/s wr, 6.93k op/s 2024-09-10T11:49:15.683 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T11:49:15.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T11:49:15.988 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 -- 172.21.15.17:0/2023699319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901036e0 msgr2=0x7fde90107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 --2- 172.21.15.17:0/2023699319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901036e0 0x7fde90107b90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fde84009930 tx=0x7fde8402a420 comp rx=0 tx=0).stop 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 -- 172.21.15.17:0/2023699319 shutdown_connections 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 --2- 172.21.15.17:0/2023699319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde901082a0 0x7fde9010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 --2- 172.21.15.17:0/2023699319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901036e0 0x7fde90107b90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 --2- 172.21.15.17:0/2023699319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde90102d30 0x7fde90103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 -- 172.21.15.17:0/2023699319 >> 172.21.15.17:0/2023699319 conn(0x7fde900fc7d0 msgr2=0x7fde900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 -- 172.21.15.17:0/2023699319 shutdown_connections 2024-09-10T11:49:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.609+0000 7fde96e40640 1 -- 172.21.15.17:0/2023699319 wait complete. 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 Processor -- start 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 -- start start 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde901036e0 0x7fde90198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 0x7fde9019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde90112090 con 0x7fde901082a0 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fde90111f10 con 0x7fde90102d30 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.610+0000 7fde96e40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde90112210 con 0x7fde901036e0 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde901036e0 0x7fde90198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42340/0 (socket says 172.21.15.17:42340) 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 -- 172.21.15.17:0/3317882882 learned_addr learned my addr 172.21.15.17:0/3317882882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde953dd640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 0x7fde9019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 -- 172.21.15.17:0/3317882882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde901036e0 msgr2=0x7fde90198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde901036e0 0x7fde90198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 -- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 msgr2=0x7fde9019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 0x7fde9019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 -- 172.21.15.17:0/3317882882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9019d5c0 con 0x7fde90102d30 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde953dd640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 0x7fde9019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde94bdc640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde8000e9f0 tx=0x7fde8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.611+0000 7fde8dffb640 1 -- 172.21.15.17:0/3317882882 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8000cd80 con 0x7fde90102d30 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.612+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9019d8b0 con 0x7fde90102d30 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.612+0000 7fde8dffb640 1 -- 172.21.15.17:0/3317882882 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde80010910 con 0x7fde90102d30 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.612+0000 7fde8dffb640 1 -- 172.21.15.17:0/3317882882 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde800188f0 con 0x7fde90102d30 2024-09-10T11:49:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.612+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901008c0 con 0x7fde90102d30 2024-09-10T11:49:16.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.614+0000 7fde8dffb640 1 -- 172.21.15.17:0/3317882882 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fde80010ac0 con 0x7fde90102d30 2024-09-10T11:49:16.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.614+0000 7fde99219740 1 Processor -- start 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 -- start start 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55626f42a280 con 0x55626f4c5480 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55626f3d1b10 con 0x55626f4cfd40 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde99219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55626f426240 con 0x55626f4c4b60 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde953dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde953dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:58956/0 (socket says 172.21.15.17:58956) 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde953dd640 1 -- 172.21.15.17:0/1940273401 learned_addr learned my addr 172.21.15.17:0/1940273401 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde8dffb640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 0x7fde780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.615+0000 7fde953dd640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 0x7fde780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 -- 172.21.15.17:0/1940273401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 msgr2=0x55626f4c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 -- 172.21.15.17:0/1940273401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 msgr2=0x55626f4cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 -- 172.21.15.17:0/1940273401 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626f3de1f0 con 0x55626f4cfd40 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8dffb640 1 -- 172.21.15.17:0/3317882882 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fde800cf420 con 0x7fde90102d30 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4d2130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde8402aa10 tx=0x7fde84005a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e870d52aedd1d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde76ffd640 1 -- 172.21.15.17:0/1940273401 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8404b020 con 0x55626f4cfd40 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde76ffd640 1 -- 172.21.15.17:0/1940273401 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde84047e30 con 0x55626f4cfd40 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde76ffd640 1 -- 172.21.15.17:0/1940273401 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84035050 con 0x55626f4cfd40 2024-09-10T11:49:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.616+0000 7fde953dd640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 0x7fde780a50c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde88009fd0 tx=0x7fde88004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 -- 172.21.15.17:0/1940273401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 msgr2=0x55626f4d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4d2130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde8402aa10 tx=0x7fde84005a40 comp rx=0 tx=0).stop 2024-09-10T11:49:16.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 -- 172.21.15.17:0/1940273401 shutdown_connections 2024-09-10T11:49:16.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4d2130 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 --2- 172.21.15.17:0/1940273401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 -- 172.21.15.17:0/1940273401 >> 172.21.15.17:0/1940273401 conn(0x55626f4c10f0 msgr2=0x55626f4c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 -- 172.21.15.17:0/1940273401 shutdown_connections 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.617+0000 7fde99219740 1 -- 172.21.15.17:0/1940273401 wait complete. 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 -- start start 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 Processor -- start 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4cfd40 0x55626f4cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.618+0000 7fde99219740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55626f4d2910 con 0x55626f4c5480 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde99219740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55626f3e4f10 con 0x55626f4c4b60 2024-09-10T11:49:16.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde99219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55626f4d2a90 con 0x55626f4cfd40 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42360/0 (socket says 172.21.15.17:42360) 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde99219740 10 client.0 _ll_register_callbacks cb 0x55626f3ada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 -- 172.21.15.17:0/4289382479 learned_addr learned my addr 172.21.15.17:0/4289382479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde953dd640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4cfd40 0x55626f4cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde8ffff640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 -- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4cfd40 msgr2=0x55626f4cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4cfd40 0x55626f4cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 -- 172.21.15.17:0/4289382479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 msgr2=0x55626f4cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 -- 172.21.15.17:0/4289382479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626f19b6a0 con 0x55626f4c4b60 2024-09-10T11:49:16.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde94bdc640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde80098660 tx=0x7fde8009b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c164cf2e7f6073 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde800a0040 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fde8009b0e0 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.619+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde84047e30 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde800a4900 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 10 client.25805 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55626f4de540 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde84047e30 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fde800979e0 con 0x55626f4c4b60 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 10 client.25805 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 20 client.25805 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f4df9f0 0x55626f4e1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 4 client.25805 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626f4377f0 con 0x55626f4df9f0 2024-09-10T11:49:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.620+0000 7fde8ffff640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f4df9f0 0x55626f4e1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.621+0000 7fde6ffff640 10 client.25805 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.621+0000 7fde8ffff640 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f4df9f0 0x55626f4e1e60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35291969e5e35078 server_cookie=fddcc94bdcd7ea81 in_seq=0 out_seq=0 2024-09-10T11:49:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.621+0000 7fde6ffff640 1 -- 172.21.15.17:0/4289382479 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55626f4377f0 con 0x55626f4df9f0 2024-09-10T11:49:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.621+0000 7fde6ffff640 10 client.25805 handle_command_reply: tid=0 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 client.25805 shutdown 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 msgr2=0x55626f4ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde80098660 tx=0x7fde8009b670 comp rx=0 tx=0).stop 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 shutdown_connections 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f4df9f0 0x55626f4e1e60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde6ffff640 0 client.25805 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4cfd40 0x55626f4cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 --2- 172.21.15.17:0/4289382479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c4b60 0x55626f4ccc40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.622+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 >> 172.21.15.17:0/4289382479 conn(0x55626f4c10f0 msgr2=0x55626f4c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.623+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 shutdown_connections 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.623+0000 7fde99219740 1 -- 172.21.15.17:0/4289382479 wait complete. 2024-09-10T11:49:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.623+0000 7fde99219740 20 client.25805 trim_cache size 0 max 16384 2024-09-10T11:49:16.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 Processor -- start 2024-09-10T11:49:16.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 -- start start 2024-09-10T11:49:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ab380 con 0x55626f4c5480 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fde901acec0 con 0x55626f4cfd40 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55408/0 (socket says 172.21.15.17:55408) 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde99219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde901aba50 con 0x55626f4c4b60 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde8ffff640 1 -- 172.21.15.17:0/1564324829 learned_addr learned my addr 172.21.15.17:0/1564324829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.643+0000 7fde94bdc640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde953dd640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 -- 172.21.15.17:0/1564324829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 msgr2=0x55626f4e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 -- 172.21.15.17:0/1564324829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 msgr2=0x55626f4c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 -- 172.21.15.17:0/1564324829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626f4c0b90 con 0x55626f4c5480 2024-09-10T11:49:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde94bdc640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde8ffff640 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fde8402aa10 tx=0x7fde84005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe6cff0d520d10a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.644+0000 7fde767fc640 1 -- 172.21.15.17:0/1564324829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84035070 con 0x55626f4c5480 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde767fc640 1 -- 172.21.15.17:0/1564324829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde84054030 con 0x55626f4c5480 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde767fc640 1 -- 172.21.15.17:0/1564324829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8404b050 con 0x55626f4c5480 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 -- 172.21.15.17:0/1564324829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 msgr2=0x55626f4e7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fde8402aa10 tx=0x7fde84005a40 comp rx=0 tx=0).stop 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 -- 172.21.15.17:0/1564324829 shutdown_connections 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4cfd40 0x55626f4c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4c5480 0x55626f4e7c40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 --2- 172.21.15.17:0/1564324829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 -- 172.21.15.17:0/1564324829 >> 172.21.15.17:0/1564324829 conn(0x55626f4c10f0 msgr2=0x55626f4c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.645+0000 7fde99219740 1 -- 172.21.15.17:0/1564324829 shutdown_connections 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 -- 172.21.15.17:0/1564324829 wait complete. 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 -- start start 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 Processor -- start 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.646+0000 7fde99219740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 0x55626f4d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde99219740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ac7f0 con 0x55626f4cfd40 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde99219740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ac120 con 0x55626f4c5480 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde99219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde901a9380 con 0x55626f4c4b60 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde99219740 10 client.0 _ll_register_callbacks cb 0x7fde8000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 0x55626f4d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde94bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42382/0 (socket says 172.21.15.17:42382) 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde8ffff640 1 -- 172.21.15.17:0/359530203 learned_addr learned my addr 172.21.15.17:0/359530203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 -- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 msgr2=0x55626f4d8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4d8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 -- 172.21.15.17:0/359530203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 msgr2=0x55626f4d4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 -- 172.21.15.17:0/359530203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55626f4d4f10 con 0x55626f4cfd40 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde94bdc640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde8ffff640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde953dd640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 0x55626f4d49d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fde88005f10 tx=0x7fde88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4813dc867f97e2e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.647+0000 7fde6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88004d20 con 0x55626f4cfd40 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fde88005020 con 0x55626f4cfd40 2024-09-10T11:49:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde84054030 con 0x55626f4cfd40 2024-09-10T11:49:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde88005220 con 0x55626f4cfd40 2024-09-10T11:49:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 10 client.16140 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55626f54b450 con 0x55626f4cfd40 2024-09-10T11:49:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde84054030 con 0x55626f4cfd40 2024-09-10T11:49:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fde8801d9d0 con 0x55626f4cfd40 2024-09-10T11:49:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 10 client.16140 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 20 client.16140 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.648+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f54bc50 0x55626f54e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.649+0000 7fde99219740 4 client.16140 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.649+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55626f431d00 con 0x55626f54bc50 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.649+0000 7fde94bdc640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f54bc50 0x55626f54e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.649+0000 7fde6ffff640 10 client.16140 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.649+0000 7fde94bdc640 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f54bc50 0x55626f54e070 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36661703f74a6e41 server_cookie=7dc78a8177cfb1 in_seq=0 out_seq=0 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.650+0000 7fde6ffff640 1 -- 172.21.15.17:0/359530203 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55626f431d00 con 0x55626f54bc50 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.650+0000 7fde6ffff640 10 client.16140 handle_command_reply: tid=0 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.650+0000 7fde99219740 1 client.16140 shutdown 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.650+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 msgr2=0x55626f4d49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.650+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 0x55626f4d49d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fde88005f10 tx=0x7fde88004a40 comp rx=0 tx=0).stop 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 shutdown_connections 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55626f54bc50 0x55626f54e070 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55626f4cfd40 0x55626f4d49d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55626f4c5480 0x55626f4d4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 --2- 172.21.15.17:0/359530203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55626f4c4b60 0x55626f4d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 >> 172.21.15.17:0/359530203 conn(0x55626f4c10f0 msgr2=0x55626f4c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde6ffff640 0 client.16140 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 shutdown_connections 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.651+0000 7fde99219740 1 -- 172.21.15.17:0/359530203 wait complete. 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.652+0000 7fde99219740 20 client.16140 trim_cache size 0 max 16384 2024-09-10T11:49:16.656 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:49:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T11:49:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "1ade14df-a2ef-44bf-9e23-c136b20e3a0f", 2024-09-10T11:49:16.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T11:49:16.657 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 msgr2=0x7fde780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 0x7fde780a50c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde88009fd0 tx=0x7fde88004ab0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 msgr2=0x7fde90198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde8000e9f0 tx=0x7fde8000eeb0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 shutdown_connections 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fde780a2c00 0x7fde780a50c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde901036e0 0x7fde90198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde901082a0 0x7fde9019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 --2- 172.21.15.17:0/3317882882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde90102d30 0x7fde90198610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 >> 172.21.15.17:0/3317882882 conn(0x7fde900fc7d0 msgr2=0x7fde90105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 shutdown_connections 2024-09-10T11:49:16.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:16.653+0000 7fde96e40640 1 -- 172.21.15.17:0/3317882882 wait complete. 2024-09-10T11:49:16.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:16 smithi017 ceph-mon[30817]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-10T11:49:16.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:16 smithi081 ceph-mon[35059]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-10T11:49:17.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:16 smithi026 ceph-mon[34817]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 68 GiB used, 1005 GiB / 1.0 TiB avail; 9.1 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-10T11:49:17.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:49:17.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub queued for path: / 2024-09-10T11:49:17.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:17.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:17 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub queued for path: / 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:49:18.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:49:18.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:17 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub queued for path: / 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.024 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:17 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.795+0000 7f4982a87640 1 -- 172.21.15.17:0/3069798617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c106f10 msgr2=0x7f497c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.795+0000 7f4982a87640 1 --2- 172.21.15.17:0/3069798617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c106f10 0x7f497c10ea90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ca0 tx=0x7f497402a8f0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 -- 172.21.15.17:0/3069798617 shutdown_connections 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 --2- 172.21.15.17:0/3069798617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c102790 0x7f497c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 --2- 172.21.15.17:0/3069798617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c106f10 0x7f497c10ea90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 --2- 172.21.15.17:0/3069798617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c101de0 0x7f497c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 -- 172.21.15.17:0/3069798617 >> 172.21.15.17:0/3069798617 conn(0x7f497c0fd8c0 msgr2=0x7f497c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 -- 172.21.15.17:0/3069798617 shutdown_connections 2024-09-10T11:49:18.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.796+0000 7f4982a87640 1 -- 172.21.15.17:0/3069798617 wait complete. 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 Processor -- start 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 -- start start 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c101de0 0x7f497c075a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c102790 0x7f497c075f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f497c111fc0 con 0x7f497c102790 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f497c111e40 con 0x7f497c101de0 2024-09-10T11:49:18.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.797+0000 7f4982a87640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f497c112140 con 0x7f497c106f10 2024-09-10T11:49:18.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.799+0000 7f4981024640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.799+0000 7f4981024640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59016/0 (socket says 172.21.15.17:59016) 2024-09-10T11:49:18.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.799+0000 7f4981024640 1 -- 172.21.15.17:0/3732482437 learned_addr learned my addr 172.21.15.17:0/3732482437 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.800+0000 7f4981024640 1 -- 172.21.15.17:0/3732482437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c101de0 msgr2=0x7f497c075a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.800+0000 7f4981024640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c101de0 0x7f497c075a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.800+0000 7f4981024640 1 -- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c102790 msgr2=0x7f497c075f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.800+0000 7f4981024640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c102790 0x7f497c075f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.800+0000 7f4981024640 1 -- 172.21.15.17:0/3732482437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c06d330 con 0x7f497c106f10 2024-09-10T11:49:18.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.801+0000 7f4981024640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4974030820 tx=0x7f4974030850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.802+0000 7f4979ffb640 1 -- 172.21.15.17:0/3732482437 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974030e00 con 0x7f497c106f10 2024-09-10T11:49:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.802+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c06d5c0 con 0x7f497c106f10 2024-09-10T11:49:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.802+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c071620 con 0x7f497c106f10 2024-09-10T11:49:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.805+0000 7f4984e60740 1 Processor -- start 2024-09-10T11:49:18.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.806+0000 7f4984e60740 1 -- start start 2024-09-10T11:49:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea7e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea7edc0 0x55d09ea89140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d09e9e42e0 con 0x55d09ea7edc0 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d09e98bce0 con 0x55d09ea7e4a0 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.807+0000 7f4984e60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d09e9e02a0 con 0x55d09ea89680 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f4979ffb640 1 -- 172.21.15.17:0/3732482437 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4974036040 con 0x7f497c106f10 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f4979ffb640 1 -- 172.21.15.17:0/3732482437 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974004350 con 0x7f497c106f10 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f497bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f497bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:59022/0 (socket says 172.21.15.17:59022) 2024-09-10T11:49:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f497bfff640 1 -- 172.21.15.17:0/2979128755 learned_addr learned my addr 172.21.15.17:0/2979128755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:18.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.808+0000 7f497bfff640 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea7e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.811+0000 7f4980823640 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea7edc0 0x55d09ea89140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.812+0000 7f497bfff640 1 -- 172.21.15.17:0/2979128755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 msgr2=0x55d09ea7e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.812+0000 7f497bfff640 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea7e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.812+0000 7f497bfff640 1 -- 172.21.15.17:0/2979128755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea7edc0 msgr2=0x55d09ea89140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.812+0000 7f497bfff640 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea7edc0 0x55d09ea89140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.812+0000 7f497bfff640 1 -- 172.21.15.17:0/2979128755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09e970440 con 0x55d09ea89680 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.813+0000 7f4979ffb640 1 -- 172.21.15.17:0/3732482437 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4974043070 con 0x7f497c106f10 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.814+0000 7f4979ffb640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 0x7f496c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.814+0000 7f497bfff640 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4968009f80 tx=0x7f4968009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3fdcb8ee69cc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.815+0000 7f4979ffb640 1 -- 172.21.15.17:0/3732482437 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f49740f0ec0 con 0x7f497c106f10 2024-09-10T11:49:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.815+0000 7f4980823640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 0x7f496c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.818+0000 7f4966ffd640 1 -- 172.21.15.17:0/2979128755 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968013110 con 0x55d09ea89680 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.818+0000 7f4966ffd640 1 -- 172.21.15.17:0/2979128755 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49680132b0 con 0x55d09ea89680 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.819+0000 7f4984e60740 1 -- 172.21.15.17:0/2979128755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 msgr2=0x55d09ea8ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.819+0000 7f4966ffd640 1 -- 172.21.15.17:0/2979128755 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968013110 con 0x55d09ea89680 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.819+0000 7f4984e60740 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4968009f80 tx=0x7f4968009620 comp rx=0 tx=0).stop 2024-09-10T11:49:18.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4980823640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 0x7f496c0a5180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55d09ea7b890 tx=0x7f4970005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 -- 172.21.15.17:0/2979128755 shutdown_connections 2024-09-10T11:49:18.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea89680 0x55d09ea8ba70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea7edc0 0x55d09ea89140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 --2- 172.21.15.17:0/2979128755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea7e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 -- 172.21.15.17:0/2979128755 >> 172.21.15.17:0/2979128755 conn(0x55d09ea7aa30 msgr2=0x55d09ea7ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 -- 172.21.15.17:0/2979128755 shutdown_connections 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.820+0000 7f4984e60740 1 -- 172.21.15.17:0/2979128755 wait complete. 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.821+0000 7f4984e60740 1 -- start start 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.821+0000 7f4984e60740 1 Processor -- start 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4984e60740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4984e60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4984e60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4980823640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4980823640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42414/0 (socket says 172.21.15.17:42414) 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.822+0000 7f4980823640 1 -- 172.21.15.17:0/3206248820 learned_addr learned my addr 172.21.15.17:0/3206248820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.823+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d09ea8c2a0 con 0x55d09ea89680 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.823+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d09e99f050 con 0x55d09ea7e4a0 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.823+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d09ea8c420 con 0x55d09ea7edc0 2024-09-10T11:49:18.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4984e60740 10 client.0 _ll_register_callbacks cb 0x55d09e9df160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:18.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4980823640 1 -- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 msgr2=0x55d09ea861e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:49:18.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4980823640 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea861e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4980823640 1 -- 172.21.15.17:0/3206248820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 msgr2=0x55d09ea86720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4980823640 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.824+0000 7f4980823640 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09e7553c0 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.825+0000 7f4980823640 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4970004650 tx=0x7f4970004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ef8ffec5ef70c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.825+0000 7f495bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.826+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497000fad0 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.826+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49680132b0 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.826+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f497000fc70 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.826+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f497000fe70 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.827+0000 7f4984e60740 10 client.25820 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.827+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d09ea97d60 con 0x55d09ea7e4a0 2024-09-10T11:49:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.828+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497001f900 con 0x55d09ea7e4a0 2024-09-10T11:49:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.828+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f497001d8a0 con 0x55d09ea7e4a0 2024-09-10T11:49:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 10 client.25820 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 10 client.25820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 20 client.25820 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09ea99640 0x55d09ea9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 4 client.25820 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.830+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f49680132b0 con 0x55d09ea99640 2024-09-10T11:49:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.831+0000 7f497bfff640 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09ea99640 0x55d09ea9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.832+0000 7f497bfff640 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09ea99640 0x55d09ea9bb00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f89ef7ff38386b server_cookie=4761b4702194c831 in_seq=0 out_seq=0 2024-09-10T11:49:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.832+0000 7f495bfff640 10 client.25820 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.833+0000 7f495bfff640 1 -- 172.21.15.17:0/3206248820 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f496800e720 con 0x55d09ea99640 2024-09-10T11:49:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.833+0000 7f495bfff640 10 client.25820 handle_command_reply: tid=0 2024-09-10T11:49:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 client.25820 shutdown 2024-09-10T11:49:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 msgr2=0x55d09ea88f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4970004650 tx=0x7f4970004730 comp rx=0 tx=0).stop 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 shutdown_connections 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09ea99640 0x55d09ea9bb00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea861e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea86720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 --2- 172.21.15.17:0/3206248820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea88f30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 >> 172.21.15.17:0/3206248820 conn(0x55d09ea7aa30 msgr2=0x55d09ea80760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.834+0000 7f495bfff640 0 client.25820 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.835+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 shutdown_connections 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.835+0000 7f4984e60740 1 -- 172.21.15.17:0/3206248820 wait complete. 2024-09-10T11:49:18.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.835+0000 7f4984e60740 20 client.25820 trim_cache size 0 max 16384 2024-09-10T11:49:18.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.871+0000 7f4984e60740 1 Processor -- start 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.871+0000 7f4984e60740 1 -- start start 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7e4a0 0x55d09ea84ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f496000e4a0 con 0x55d09ea89680 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f496000ffe0 con 0x55d09ea7edc0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4984e60740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f496000eb70 con 0x55d09ea7e4a0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f497bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f497bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42418/0 (socket says 172.21.15.17:42418) 2024-09-10T11:49:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f497bfff640 1 -- 172.21.15.17:0/3497612028 learned_addr learned my addr 172.21.15.17:0/3497612028 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.872+0000 7f4980823640 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7e4a0 0x55d09ea84ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f4981024640 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 -- 172.21.15.17:0/3497612028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7e4a0 msgr2=0x55d09ea84ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7e4a0 0x55d09ea84ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 -- 172.21.15.17:0/3497612028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 msgr2=0x55d09ea79a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea79a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 -- 172.21.15.17:0/3497612028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09ea85190 con 0x55d09ea7edc0 2024-09-10T11:49:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.873+0000 7f497bfff640 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4968013750 tx=0x7f4968005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5dbf93fa2245296 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.875+0000 7f49667fc640 1 -- 172.21.15.17:0/3497612028 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680095a0 con 0x55d09ea7edc0 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.875+0000 7f49667fc640 1 -- 172.21.15.17:0/3497612028 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49680132b0 con 0x55d09ea7edc0 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.875+0000 7f49667fc640 1 -- 172.21.15.17:0/3497612028 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968003850 con 0x55d09ea7edc0 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.876+0000 7f4984e60740 1 -- 172.21.15.17:0/3497612028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 msgr2=0x55d09ea818b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.876+0000 7f4984e60740 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4968013750 tx=0x7f4968005040 comp rx=0 tx=0).stop 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.877+0000 7f4984e60740 1 -- 172.21.15.17:0/3497612028 shutdown_connections 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.877+0000 7f4984e60740 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea79a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.877+0000 7f4984e60740 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7edc0 0x55d09ea818b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.877+0000 7f4984e60740 1 --2- 172.21.15.17:0/3497612028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7e4a0 0x55d09ea84ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.877+0000 7f4984e60740 1 -- 172.21.15.17:0/3497612028 >> 172.21.15.17:0/3497612028 conn(0x55d09ea7aa30 msgr2=0x55d09ea79350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.879+0000 7f4984e60740 1 -- 172.21.15.17:0/3497612028 shutdown_connections 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.879+0000 7f4984e60740 1 -- 172.21.15.17:0/3497612028 wait complete. 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.880+0000 7f4984e60740 1 -- start start 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.880+0000 7f4984e60740 1 Processor -- start 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.881+0000 7f4984e60740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea8d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4984e60740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4984e60740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea8df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f497bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4984e60740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f496000f910 con 0x55d09ea89680 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4984e60740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f496000f240 con 0x55d09ea7e4a0 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4980823640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea8d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4980823640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea8d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:42434/0 (socket says 172.21.15.17:42434) 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4980823640 1 -- 172.21.15.17:0/2235372260 learned_addr learned my addr 172.21.15.17:0/2235372260 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.882+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f496000c480 con 0x55d09ea7edc0 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f4984e60740 10 client.0 _ll_register_callbacks cb 0x7f4970009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f497bfff640 1 -- 172.21.15.17:0/2235372260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 msgr2=0x55d09ea8d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f497bfff640 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea8d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f497bfff640 1 -- 172.21.15.17:0/2235372260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 msgr2=0x55d09ea8df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:18.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f497bfff640 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea8df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.883+0000 7f497bfff640 1 -- 172.21.15.17:0/2235372260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09eb033e0 con 0x55d09ea7edc0 2024-09-10T11:49:18.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.884+0000 7f497bfff640 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea8d9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d09ea7b5f0 tx=0x7f4968005540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cddb65ab46754813 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:18.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.884+0000 7f495bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.886+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680052b0 con 0x55d09ea7edc0 2024-09-10T11:49:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.887+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f496800e720 con 0x55d09ea7edc0 2024-09-10T11:49:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.887+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49680132b0 con 0x55d09ea7edc0 2024-09-10T11:49:18.890 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:18 smithi017 ceph-mon[30817]: scrub summary: active paths [/] 2024-09-10T11:49:18.890 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:18 smithi017 ceph-mon[30817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.890 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:18 smithi017 ceph-mon[30817]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 11 KiB/s rd, 52 MiB/s wr, 8.62k op/s 2024-09-10T11:49:18.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.889+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f496800e940 con 0x55d09ea7edc0 2024-09-10T11:49:18.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.889+0000 7f4984e60740 10 client.25789 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:18.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.889+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d09eb04660 con 0x55d09ea7edc0 2024-09-10T11:49:18.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49680132b0 con 0x55d09ea7edc0 2024-09-10T11:49:18.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f4968027360 con 0x55d09ea7edc0 2024-09-10T11:49:18.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4984e60740 10 client.25789 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:18.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4984e60740 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:18.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4984e60740 20 client.25789 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:18.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09eb04b60 0x55d09eb06f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:18.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4984e60740 4 client.25789 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:49:18.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.894+0000 7f4980823640 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09eb04b60 0x55d09eb06f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:18.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.895+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d09e9f1850 con 0x55d09eb04b60 2024-09-10T11:49:18.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.898+0000 7f4980823640 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09eb04b60 0x55d09eb06f80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd82081791f8073 server_cookie=5a7c42093db756a9 in_seq=0 out_seq=0 2024-09-10T11:49:18.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f495bfff640 10 client.25789 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:18.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f495bfff640 1 -- 172.21.15.17:0/2235372260 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f497001e530 con 0x55d09eb04b60 2024-09-10T11:49:18.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f495bfff640 10 client.25789 handle_command_reply: tid=0 2024-09-10T11:49:18.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f4984e60740 1 client.25789 shutdown 2024-09-10T11:49:18.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 msgr2=0x55d09ea8d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.899+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea8d9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d09ea7b5f0 tx=0x7f4968005540 comp rx=0 tx=0).stop 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 shutdown_connections 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55d09eb04b60 0x55d09eb06f80 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f495bfff640 0 client.25789 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d09ea7edc0 0x55d09ea8d9c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d09ea89680 0x55d09ea8df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 --2- 172.21.15.17:0/2235372260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d09ea7e4a0 0x55d09ea8d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.900+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 >> 172.21.15.17:0/2235372260 conn(0x55d09ea7aa30 msgr2=0x55d09ea817a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.902+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 shutdown_connections 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.902+0000 7f4984e60740 1 -- 172.21.15.17:0/2235372260 wait complete. 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.902+0000 7f4984e60740 20 client.25789 trim_cache size 0 max 16384 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T11:49:18.904 INFO:teuthology.orchestra.run.smithi017.stdout: "1ade14df-a2ef-44bf-9e23-c136b20e3a0f": { 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "1ade14df-a2ef-44bf-9e23-c136b20e3a0f", 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:49:18.905 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:49:18.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.903+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 msgr2=0x7f496c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.903+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 0x7f496c0a5180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55d09ea7b890 tx=0x7f4970005f90 comp rx=0 tx=0).stop 2024-09-10T11:49:18.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.903+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 msgr2=0x7f497c06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:18.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.903+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4974030820 tx=0x7f4974030850 comp rx=0 tx=0).stop 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 shutdown_connections 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f496c0a2cc0 0x7f496c0a5180 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497c106f10 0x7f497c06ca70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f497c102790 0x7f497c075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 --2- 172.21.15.17:0/3732482437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f497c101de0 0x7f497c075a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 >> 172.21.15.17:0/3732482437 conn(0x7f497c0fd8c0 msgr2=0x7f497c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 shutdown_connections 2024-09-10T11:49:18.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:18.904+0000 7f4982a87640 1 -- 172.21.15.17:0/3732482437 wait complete. 2024-09-10T11:49:18.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:18 smithi081 ceph-mon[35059]: scrub summary: active paths [/] 2024-09-10T11:49:18.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:18 smithi081 ceph-mon[35059]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:18.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:18 smithi081 ceph-mon[35059]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 11 KiB/s rd, 52 MiB/s wr, 8.62k op/s 2024-09-10T11:49:19.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:18 smithi026 ceph-mon[34817]: scrub summary: active paths [/] 2024-09-10T11:49:19.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:18 smithi026 ceph-mon[34817]: scrub summary: idle+waiting paths [/] 2024-09-10T11:49:19.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:18 smithi026 ceph-mon[34817]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1011 GiB / 1.0 TiB avail; 11 KiB/s rd, 52 MiB/s wr, 8.62k op/s 2024-09-10T11:49:19.767 INFO:tasks.cephfs.filesystem:scrub status for tag:1ade14df-a2ef-44bf-9e23-c136b20e3a0f - {'path': '/', 'tag': '1ade14df-a2ef-44bf-9e23-c136b20e3a0f', 'options': 'recursive,force'} 2024-09-10T11:49:20.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:20 smithi081 ceph-mon[35059]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 36 MiB/s wr, 5.99k op/s 2024-09-10T11:49:21.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:20 smithi026 ceph-mon[34817]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 36 MiB/s wr, 5.99k op/s 2024-09-10T11:49:21.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:20 smithi017 ceph-mon[30817]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 62 GiB used, 1010 GiB / 1.0 TiB avail; 8.5 KiB/s rd, 36 MiB/s wr, 5.99k op/s 2024-09-10T11:49:22.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:22 smithi081 ceph-mon[35059]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 7.78k op/s 2024-09-10T11:49:23.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:22 smithi026 ceph-mon[34817]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 7.78k op/s 2024-09-10T11:49:23.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:22 smithi017 ceph-mon[30817]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 7.78k op/s 2024-09-10T11:49:24.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:24 smithi081 ceph-mon[35059]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 39 MiB/s wr, 7.10k op/s 2024-09-10T11:49:25.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:24 smithi026 ceph-mon[34817]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 39 MiB/s wr, 7.10k op/s 2024-09-10T11:49:25.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:24 smithi017 ceph-mon[30817]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 39 MiB/s wr, 7.10k op/s 2024-09-10T11:49:25.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:25 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:49:25.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:25 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:49:25.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:25 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:49:25.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:25 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:49:26.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:25 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:49:26.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:25 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:49:26.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:25 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:49:26.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:25 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:49:26.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:25 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:49:26.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:25 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:49:26.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:25 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:49:26.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:25 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:49:26.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:26 smithi081 ceph-mon[35059]: scrub summary: idle 2024-09-10T11:49:26.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:26 smithi081 ceph-mon[35059]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 34 MiB/s wr, 6.36k op/s 2024-09-10T11:49:27.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:26 smithi026 ceph-mon[34817]: scrub summary: idle 2024-09-10T11:49:27.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:26 smithi026 ceph-mon[34817]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 34 MiB/s wr, 6.36k op/s 2024-09-10T11:49:27.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:26 smithi017 ceph-mon[30817]: scrub summary: idle 2024-09-10T11:49:27.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:26 smithi017 ceph-mon[30817]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 34 MiB/s wr, 6.36k op/s 2024-09-10T11:49:28.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:28 smithi081 ceph-mon[35059]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 12 KiB/s rd, 48 MiB/s wr, 9.26k op/s 2024-09-10T11:49:29.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:28 smithi026 ceph-mon[34817]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 12 KiB/s rd, 48 MiB/s wr, 9.26k op/s 2024-09-10T11:49:29.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:28 smithi017 ceph-mon[30817]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 12 KiB/s rd, 48 MiB/s wr, 9.26k op/s 2024-09-10T11:49:30.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:30 smithi081 ceph-mon[35059]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.53k op/s 2024-09-10T11:49:31.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:30 smithi026 ceph-mon[34817]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.53k op/s 2024-09-10T11:49:31.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:30 smithi017 ceph-mon[30817]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.53k op/s 2024-09-10T11:49:32.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:32 smithi081 ceph-mon[35059]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.56k op/s 2024-09-10T11:49:33.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:32 smithi026 ceph-mon[34817]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.56k op/s 2024-09-10T11:49:33.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:32 smithi017 ceph-mon[30817]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 32 MiB/s wr, 6.56k op/s 2024-09-10T11:49:34.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:34 smithi081 ceph-mon[35059]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 MiB/s wr, 4.61k op/s 2024-09-10T11:49:35.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:34 smithi026 ceph-mon[34817]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 MiB/s wr, 4.61k op/s 2024-09-10T11:49:35.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:34 smithi017 ceph-mon[30817]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 22 MiB/s wr, 4.61k op/s 2024-09-10T11:49:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:36 smithi081 ceph-mon[35059]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 18 MiB/s wr, 3.69k op/s 2024-09-10T11:49:37.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:36 smithi026 ceph-mon[34817]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 18 MiB/s wr, 3.69k op/s 2024-09-10T11:49:37.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:36 smithi017 ceph-mon[30817]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.4 KiB/s rd, 18 MiB/s wr, 3.69k op/s 2024-09-10T11:49:38.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:38 smithi081 ceph-mon[35059]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 6.30k op/s 2024-09-10T11:49:39.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:38 smithi026 ceph-mon[34817]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 6.30k op/s 2024-09-10T11:49:39.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:38 smithi017 ceph-mon[30817]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 10 KiB/s rd, 31 MiB/s wr, 6.30k op/s 2024-09-10T11:49:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:40 smithi081 ceph-mon[35059]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 3.38k op/s 2024-09-10T11:49:41.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:40 smithi026 ceph-mon[34817]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 3.38k op/s 2024-09-10T11:49:41.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:40 smithi017 ceph-mon[30817]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 3.38k op/s 2024-09-10T11:49:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:42 smithi081 ceph-mon[35059]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 MiB/s wr, 3.45k op/s 2024-09-10T11:49:43.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:42 smithi026 ceph-mon[34817]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 MiB/s wr, 3.45k op/s 2024-09-10T11:49:43.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:42 smithi017 ceph-mon[30817]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 17 MiB/s wr, 3.45k op/s 2024-09-10T11:49:44.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:44 smithi081 ceph-mon[35059]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 3.35k op/s 2024-09-10T11:49:45.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:44 smithi026 ceph-mon[34817]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 3.35k op/s 2024-09-10T11:49:45.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:44 smithi017 ceph-mon[30817]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 8.2 KiB/s rd, 17 MiB/s wr, 3.35k op/s 2024-09-10T11:49:46.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:46 smithi081 ceph-mon[35059]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 3.28k op/s 2024-09-10T11:49:47.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:46 smithi026 ceph-mon[34817]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 3.28k op/s 2024-09-10T11:49:47.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:46 smithi017 ceph-mon[30817]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.3 KiB/s rd, 17 MiB/s wr, 3.28k op/s 2024-09-10T11:49:49.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:48 smithi026 ceph-mon[34817]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.83k op/s 2024-09-10T11:49:49.022 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:48 smithi017 ceph-mon[30817]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.83k op/s 2024-09-10T11:49:49.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:48 smithi081 ceph-mon[35059]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.83k op/s 2024-09-10T11:49:49.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T11:49:50.301 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:50.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 -- 172.21.15.17:0/1038149113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c105d90 msgr2=0x7fd48c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:50.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 --2- 172.21.15.17:0/1038149113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c105d90 0x7fd48c106220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd484009be0 tx=0x7fd48402a780 comp rx=0 tx=0).stop 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 -- 172.21.15.17:0/1038149113 shutdown_connections 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 --2- 172.21.15.17:0/1038149113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c105d90 0x7fd48c106220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 --2- 172.21.15.17:0/1038149113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c1012a0 0x7fd48c105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 --2- 172.21.15.17:0/1038149113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c100980 0x7fd48c100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.957+0000 7fd4915e3640 1 -- 172.21.15.17:0/1038149113 >> 172.21.15.17:0/1038149113 conn(0x7fd48c0fc610 msgr2=0x7fd48c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.958+0000 7fd4915e3640 1 -- 172.21.15.17:0/1038149113 shutdown_connections 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.963+0000 7fd4915e3640 1 -- 172.21.15.17:0/1038149113 wait complete. 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.963+0000 7fd4915e3640 1 Processor -- start 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 -- start start 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c100980 0x7fd48c114890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 0x7fd48c114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 0x7fd48c10ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c118490 con 0x7fd48c10d920 2024-09-10T11:49:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c118310 con 0x7fd48c1012a0 2024-09-10T11:49:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.964+0000 7fd4915e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c118610 con 0x7fd48c100980 2024-09-10T11:49:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.965+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 0x7fd48c114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.965+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 0x7fd48c114dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:45552/0 (socket says 172.21.15.17:45552) 2024-09-10T11:49:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.965+0000 7fd48b7fe640 1 -- 172.21.15.17:0/3180897939 learned_addr learned my addr 172.21.15.17:0/3180897939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:50.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.965+0000 7fd490de2640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 0x7fd48c10ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 -- 172.21.15.17:0/3180897939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c100980 msgr2=0x7fd48c114890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:49:50.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c100980 0x7fd48c114890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 -- 172.21.15.17:0/3180897939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 msgr2=0x7fd48c114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:50.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 0x7fd48c114dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 -- 172.21.15.17:0/3180897939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c10e5a0 con 0x7fd48c10d920 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.966+0000 7fd490de2640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 0x7fd48c10ddd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd484034040 tx=0x7fd484032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.967+0000 7fd4897fa640 1 -- 172.21.15.17:0/3180897939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484042020 con 0x7fd48c10d920 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.967+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c1123c0 con 0x7fd48c10d920 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.967+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c112900 con 0x7fd48c10d920 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.967+0000 7fd4897fa640 1 -- 172.21.15.17:0/3180897939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd48403ee20 con 0x7fd48c10d920 2024-09-10T11:49:50.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.967+0000 7fd4897fa640 1 -- 172.21.15.17:0/3180897939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48403b3c0 con 0x7fd48c10d920 2024-09-10T11:49:50.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 Processor -- start 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 -- start start 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370670 0x55e3b9370a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e3b92d62e0 con 0x55e3b9370670 2024-09-10T11:49:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e3b927dce0 con 0x55e3b9370f90 2024-09-10T11:49:50.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:50 smithi017 ceph-mon[30817]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 3.03k op/s 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.974+0000 7fd494c1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e3b92d22a0 con 0x55e3b937b850 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd4897fa640 1 -- 172.21.15.17:0/3180897939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd484045020 con 0x7fd48c10d920 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52806/0 (socket says 172.21.15.17:52806) 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 -- 172.21.15.17:0/3347798717 learned_addr learned my addr 172.21.15.17:0/3347798717 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370670 0x55e3b9370a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 -- 172.21.15.17:0/3347798717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 msgr2=0x55e3b937b310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 -- 172.21.15.17:0/3347798717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370670 msgr2=0x55e3b9370a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370670 0x55e3b9370a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.975+0000 7fd48b7fe640 1 -- 172.21.15.17:0/3347798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b9262440 con 0x55e3b937b850 2024-09-10T11:49:50.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.976+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ee0 tx=0x7fd47c0097c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb14f15e4bee33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.976+0000 7fd4727fc640 1 -- 172.21.15.17:0/3347798717 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c004250 con 0x55e3b937b850 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.976+0000 7fd4727fc640 1 -- 172.21.15.17:0/3347798717 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c0043f0 con 0x55e3b937b850 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.977+0000 7fd4727fc640 1 -- 172.21.15.17:0/3347798717 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0035f0 con 0x55e3b937b850 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.978+0000 7fd494c1e740 1 -- 172.21.15.17:0/3347798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 msgr2=0x55e3b937dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.978+0000 7fd494c1e740 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ee0 tx=0x7fd47c0097c0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.978+0000 7fd4897fa640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 0x7fd4740a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.979+0000 7fd4897fa640 1 -- 172.21.15.17:0/3180897939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd4840eff10 con 0x7fd48c10d920 2024-09-10T11:49:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.979+0000 7fd494c1e740 1 -- 172.21.15.17:0/3347798717 shutdown_connections 2024-09-10T11:49:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.979+0000 7fd494c1e740 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b937b850 0x55e3b937dc40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.980+0000 7fd494c1e740 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.980+0000 7fd494c1e740 1 --2- 172.21.15.17:0/3347798717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370670 0x55e3b9370a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.980+0000 7fd494c1e740 1 -- 172.21.15.17:0/3347798717 >> 172.21.15.17:0/3347798717 conn(0x55e3b936cc00 msgr2=0x55e3b936cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:50.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.981+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 0x7fd4740a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.982+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 0x7fd4740a5260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd47c004bf0 tx=0x7fd47c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:50.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.986+0000 7fd494c1e740 1 -- 172.21.15.17:0/3347798717 shutdown_connections 2024-09-10T11:49:50.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.986+0000 7fd494c1e740 1 -- 172.21.15.17:0/3347798717 wait complete. 2024-09-10T11:49:50.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.986+0000 7fd494c1e740 1 -- start start 2024-09-10T11:49:50.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.987+0000 7fd494c1e740 1 Processor -- start 2024-09-10T11:49:50.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.988+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.989+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.989+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b937b850 0x55e3b9378930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:50.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.990+0000 7fd494c1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e3b937e420 con 0x55e3b9370f90 2024-09-10T11:49:50.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.990+0000 7fd494c1e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e3b9291050 con 0x55e3b937b850 2024-09-10T11:49:50.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.990+0000 7fd494c1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e3b937e5a0 con 0x55e3b9370670 2024-09-10T11:49:50.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.990+0000 7fd494c1e740 10 client.0 _ll_register_callbacks cb 0x55e3b92d1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:50.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.992+0000 7fd490de2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b937b850 0x55e3b9378930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.992+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.992+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33008/0 (socket says 172.21.15.17:33008) 2024-09-10T11:49:50.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.992+0000 7fd48b7fe640 1 -- 172.21.15.17:0/2438768325 learned_addr learned my addr 172.21.15.17:0/2438768325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:50.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.992+0000 7fd48bfff640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.994+0000 7fd48b7fe640 1 -- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 msgr2=0x55e3b937b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.994+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.994+0000 7fd48b7fe640 1 -- 172.21.15.17:0/2438768325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b937b850 msgr2=0x55e3b9378930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:50.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.994+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b937b850 0x55e3b9378930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:50.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.994+0000 7fd48b7fe640 1 -- 172.21.15.17:0/2438768325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b90473c0 con 0x55e3b9370f90 2024-09-10T11:49:50.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.995+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd47c005a50 tx=0x7fd47c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d9e6743dec9e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:50.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:50.995+0000 7fd46b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.000+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c01c950 con 0x55e3b9370f90 2024-09-10T11:49:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.000+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd47c0043f0 con 0x55e3b9370f90 2024-09-10T11:49:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.000+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd47c024040 con 0x55e3b9370f90 2024-09-10T11:49:51.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:50 smithi026 ceph-mon[34817]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 3.03k op/s 2024-09-10T11:49:51.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.020+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd47c01caf0 con 0x55e3b9370f90 2024-09-10T11:49:51.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.020+0000 7fd494c1e740 10 client.16155 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:51.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.020+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e3b9389e20 con 0x55e3b9370f90 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.021+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c0043f0 con 0x55e3b9370f90 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fd47c033420 con 0x55e3b9370f90 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 10 client.16155 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 20 client.16155 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b938b640 0x55e3b938daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 4 client.16155 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:51.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.022+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3b92e3850 con 0x55e3b938b640 2024-09-10T11:49:51.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.028+0000 7fd48bfff640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b938b640 0x55e3b938daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.032+0000 7fd48bfff640 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b938b640 0x55e3b938daa0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca320f3c104c18f server_cookie=7a4b3f1bdb0d57c8 in_seq=0 out_seq=0 2024-09-10T11:49:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.032+0000 7fd46b7fe640 10 client.16155 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.035+0000 7fd46b7fe640 1 -- 172.21.15.17:0/2438768325 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3b92e3850 con 0x55e3b938b640 2024-09-10T11:49:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.035+0000 7fd46b7fe640 10 client.16155 handle_command_reply: tid=0 2024-09-10T11:49:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.035+0000 7fd494c1e740 1 client.16155 shutdown 2024-09-10T11:49:51.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.038+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 msgr2=0x55e3b93783f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.038+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd47c005a50 tx=0x7fd47c004af0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 shutdown_connections 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b938b640 0x55e3b938daa0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b937b850 0x55e3b9378930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b9370f90 0x55e3b93783f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 --2- 172.21.15.17:0/2438768325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd46b7fe640 0 client.16155 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 >> 172.21.15.17:0/2438768325 conn(0x55e3b936cc00 msgr2=0x55e3b9372930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.039+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 shutdown_connections 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.040+0000 7fd494c1e740 1 -- 172.21.15.17:0/2438768325 wait complete. 2024-09-10T11:49:51.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.040+0000 7fd494c1e740 20 client.16155 trim_cache size 0 max 16384 2024-09-10T11:49:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.076+0000 7fd494c1e740 1 Processor -- start 2024-09-10T11:49:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 -- start start 2024-09-10T11:49:51.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370670 0x55e3b9387710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800e2c0 con 0x55e3b937b850 2024-09-10T11:49:51.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800fe00 con 0x55e3b9370670 2024-09-10T11:49:51.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.077+0000 7fd494c1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800e990 con 0x55e3b9370f90 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52830/0 (socket says 172.21.15.17:52830) 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 -- 172.21.15.17:0/938524610 learned_addr learned my addr 172.21.15.17:0/938524610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48bfff640 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370670 0x55e3b9387710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 -- 172.21.15.17:0/938524610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370670 msgr2=0x55e3b9387710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370670 0x55e3b9387710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 -- 172.21.15.17:0/938524610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 msgr2=0x55e3b93938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.080+0000 7fd48b7fe640 1 -- 172.21.15.17:0/938524610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b938e120 con 0x55e3b9370f90 2024-09-10T11:49:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.082+0000 7fd48b7fe640 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033870 tx=0x7fd47c005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7add3120b4402cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:51.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.085+0000 7fd471ffb640 1 -- 172.21.15.17:0/938524610 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c033420 con 0x55e3b9370f90 2024-09-10T11:49:51.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.085+0000 7fd471ffb640 1 -- 172.21.15.17:0/938524610 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c039030 con 0x55e3b9370f90 2024-09-10T11:49:51.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.085+0000 7fd471ffb640 1 -- 172.21.15.17:0/938524610 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c033c20 con 0x55e3b9370f90 2024-09-10T11:49:51.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.087+0000 7fd494c1e740 1 -- 172.21.15.17:0/938524610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 msgr2=0x55e3b93933b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:51.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.087+0000 7fd494c1e740 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033870 tx=0x7fd47c005e70 comp rx=0 tx=0).stop 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 -- 172.21.15.17:0/938524610 shutdown_connections 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370f90 0x55e3b93933b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 --2- 172.21.15.17:0/938524610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370670 0x55e3b9387710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 -- 172.21.15.17:0/938524610 >> 172.21.15.17:0/938524610 conn(0x55e3b936cc00 msgr2=0x55e3b937a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 -- 172.21.15.17:0/938524610 shutdown_connections 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 -- 172.21.15.17:0/938524610 wait complete. 2024-09-10T11:49:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.090+0000 7fd494c1e740 1 -- start start 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 Processor -- start 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800f730 con 0x55e3b937b850 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800f060 con 0x55e3b9370f90 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd47800c350 con 0x55e3b9370670 2024-09-10T11:49:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.091+0000 7fd494c1e740 10 client.0 _ll_register_callbacks cb 0x7fd47c009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.093+0000 7fd490de2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.094+0000 7fd490de2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33030/0 (socket says 172.21.15.17:33030) 2024-09-10T11:49:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.094+0000 7fd48b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.094+0000 7fd490de2640 1 -- 172.21.15.17:0/1655634055 learned_addr learned my addr 172.21.15.17:0/1655634055 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.094+0000 7fd48bfff640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.095+0000 7fd490de2640 1 -- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 msgr2=0x55e3b937fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.095+0000 7fd490de2640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.095+0000 7fd490de2640 1 -- 172.21.15.17:0/1655634055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 msgr2=0x55e3b937ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.095+0000 7fd490de2640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.095+0000 7fd490de2640 1 -- 172.21.15.17:0/1655634055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b936d890 con 0x55e3b937b850 2024-09-10T11:49:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.096+0000 7fd490de2640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd4840c4e60 tx=0x7fd4840bc140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545f6e1738ed3670 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.096+0000 7fd46b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:51.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.096+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4840bce20 con 0x55e3b937b850 2024-09-10T11:49:51.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.097+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd47c039030 con 0x55e3b937b850 2024-09-10T11:49:51.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.097+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd484004b40 con 0x55e3b937b850 2024-09-10T11:49:51.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.097+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd4840bc720 con 0x55e3b937b850 2024-09-10T11:49:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.098+0000 7fd494c1e740 10 client.16158 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.098+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e3b93704a0 con 0x55e3b937b850 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.098+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c039030 con 0x55e3b937b850 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.098+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fd4840bbb70 con 0x55e3b937b850 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 10 client.16158 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 20 client.16158 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b93f6f10 0x55e3b93f9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 4 client.16158 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T11:49:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.099+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3b92ddd60 con 0x55e3b93f6f10 2024-09-10T11:49:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.104+0000 7fd48bfff640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b93f6f10 0x55e3b93f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:51.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.112+0000 7fd46b7fe640 10 client.16158 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:51.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.112+0000 7fd48bfff640 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b93f6f10 0x55e3b93f9330 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34d625db5b46fd72 server_cookie=e3666ae3a4510ba7 in_seq=0 out_seq=0 2024-09-10T11:49:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.113+0000 7fd46b7fe640 1 -- 172.21.15.17:0/1655634055 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e3b92ddd60 con 0x55e3b93f6f10 2024-09-10T11:49:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.113+0000 7fd46b7fe640 10 client.16158 handle_command_reply: tid=0 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.113+0000 7fd494c1e740 1 client.16158 shutdown 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 msgr2=0x55e3b93f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd4840c4e60 tx=0x7fd4840bc140 comp rx=0 tx=0).stop 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 shutdown_connections 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x55e3b93f6f10 0x55e3b93f9330 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3b937b850 0x55e3b93f5380 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e3b9370f90 0x55e3b937ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 --2- 172.21.15.17:0/1655634055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3b9370670 0x55e3b937fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 >> 172.21.15.17:0/1655634055 conn(0x55e3b936cc00 msgr2=0x55e3b936b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd46b7fe640 0 client.16158 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 shutdown_connections 2024-09-10T11:49:51.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.114+0000 7fd494c1e740 1 -- 172.21.15.17:0/1655634055 wait complete. 2024-09-10T11:49:51.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.115+0000 7fd494c1e740 20 client.16158 trim_cache size 0 max 16384 2024-09-10T11:49:51.118 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:49:51.118 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T11:49:51.118 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-09-10T11:49:51.118 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:49:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 msgr2=0x7fd4740a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 0x7fd4740a5260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd47c004bf0 tx=0x7fd47c009260 comp rx=0 tx=0).stop 2024-09-10T11:49:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 msgr2=0x7fd48c10ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 0x7fd48c10ddd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd484034040 tx=0x7fd484032f70 comp rx=0 tx=0).stop 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 shutdown_connections 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4740a2da0 0x7fd4740a5260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd48c10d920 0x7fd48c10ddd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd48c1012a0 0x7fd48c114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 --2- 172.21.15.17:0/3180897939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd48c100980 0x7fd48c114890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.121+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 >> 172.21.15.17:0/3180897939 conn(0x7fd48c0fc610 msgr2=0x7fd48c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.124+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 shutdown_connections 2024-09-10T11:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:51.125+0000 7fd4915e3640 1 -- 172.21.15.17:0/3180897939 wait complete. 2024-09-10T11:49:51.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:50 smithi081 ceph-mon[35059]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1010 GiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 3.03k op/s 2024-09-10T11:49:51.945 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T11:49:51.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:49:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:52.924 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:52 smithi017 ceph-mon[30817]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 6.3 KiB/s rd, 23 MiB/s wr, 4.49k op/s 2024-09-10T11:49:52.924 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:52 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:49:53.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:52 smithi026 ceph-mon[34817]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 6.3 KiB/s rd, 23 MiB/s wr, 4.49k op/s 2024-09-10T11:49:53.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:52 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:49:53.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:52 smithi081 ceph-mon[35059]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 6.3 KiB/s rd, 23 MiB/s wr, 4.49k op/s 2024-09-10T11:49:53.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:52 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 -- 172.21.15.17:0/3912608598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97181068a0 msgr2=0x7f9718106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 --2- 172.21.15.17:0/3912608598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97181068a0 0x7f9718106c80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f971001acb0 tx=0x7f971003b8e0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 -- 172.21.15.17:0/3912608598 shutdown_connections 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 --2- 172.21.15.17:0/3912608598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9718101240 0x7f971810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 --2- 172.21.15.17:0/3912608598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97181008a0 0x7f9718100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 --2- 172.21.15.17:0/3912608598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97181068a0 0x7f9718106c80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.219+0000 7f971e148640 1 -- 172.21.15.17:0/3912608598 >> 172.21.15.17:0/3912608598 conn(0x7f97180fc5c0 msgr2=0x7f97180fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.221+0000 7f971e148640 1 -- 172.21.15.17:0/3912608598 shutdown_connections 2024-09-10T11:49:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.221+0000 7f971e148640 1 -- 172.21.15.17:0/3912608598 wait complete. 2024-09-10T11:49:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 Processor -- start 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 -- start start 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97181008a0 0x7f9718073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9718101240 0x7f9718073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f971806d4c0 con 0x7f97181008a0 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f971806d340 con 0x7f9718101240 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971e148640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f971806d640 con 0x7f971806eb70 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971d947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971d947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49376/0 (socket says 172.21.15.17:49376) 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.222+0000 7f971d947640 1 -- 172.21.15.17:0/2250630019 learned_addr learned my addr 172.21.15.17:0/2250630019 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.223+0000 7f971d947640 1 -- 172.21.15.17:0/2250630019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9718101240 msgr2=0x7f9718073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.223+0000 7f971d947640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9718101240 0x7f9718073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.223+0000 7f971d947640 1 -- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97181008a0 msgr2=0x7f9718073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.223+0000 7f971d947640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97181008a0 0x7f9718073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.223+0000 7f971d947640 1 -- 172.21.15.17:0/2250630019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971806f8e0 con 0x7f971806eb70 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.224+0000 7f971d947640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f970800e970 tx=0x7f970800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.225+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970800ccc0 con 0x7f971806eb70 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.225+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970800ce60 con 0x7f971806eb70 2024-09-10T11:49:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.226+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708010490 con 0x7f971806eb70 2024-09-10T11:49:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.226+0000 7f971e148640 1 -- 172.21.15.17:0/2250630019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971819a140 con 0x7f971806eb70 2024-09-10T11:49:53.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.227+0000 7f971e148640 1 -- 172.21.15.17:0/2250630019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971819a600 con 0x7f971806eb70 2024-09-10T11:49:53.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.228+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f8005290 con 0x7f971806eb70 2024-09-10T11:49:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.232+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9708004680 con 0x7f971806eb70 2024-09-10T11:49:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.233+0000 7f970e7fc640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 0x7f97040a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.234+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f970809a2f0 con 0x7f971806eb70 2024-09-10T11:49:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.236+0000 7f971d146640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 0x7f97040a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:53.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.239+0000 7f971d146640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 0x7f97040a4fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f971003bed0 tx=0x7f9710005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:53.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.239+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f970809c950 con 0x7f971806eb70 2024-09-10T11:49:53.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.684+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96f8005580 con 0x7f971806eb70 2024-09-10T11:49:53.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.688+0000 7f970e7fc640 1 -- 172.21.15.17:0/2250630019 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11956 (secure 0 0 0) 0x7f970809c950 con 0x7f971806eb70 2024-09-10T11:49:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:49:53.694 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"btime":"2024-09-10T11:48:34:322395+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:48:33.997180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24523,24512,24508,24496,24485]},"id":1}]} 2024-09-10T11:49:53.695 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 37 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 msgr2=0x7f97040a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 0x7f97040a4fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f971003bed0 tx=0x7f9710005d80 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 msgr2=0x7f971806f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f970800e970 tx=0x7f970800ed70 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 shutdown_connections 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f97040a2af0 0x7f97040a4fb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f971806eb70 0x7f971806f020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9718101240 0x7f9718073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 --2- 172.21.15.17:0/2250630019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97181008a0 0x7f9718073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 >> 172.21.15.17:0/2250630019 conn(0x7f97180fc5c0 msgr2=0x7f97180fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:53.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 shutdown_connections 2024-09-10T11:49:53.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:53.693+0000 7f9703fff640 1 -- 172.21.15.17:0/2250630019 wait complete. 2024-09-10T11:49:53.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Unable to set osd_memory_target on smithi081 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi026 to 177.0M 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Unable to set osd_memory_target on smithi026 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: Unable to set osd_memory_target on smithi017 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:49:53.985 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:53 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2250630019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Unable to set osd_memory_target on smithi081 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi026 to 177.0M 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Unable to set osd_memory_target on smithi026 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: Unable to set osd_memory_target on smithi017 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:49:54.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:53 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2250630019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:54.203 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Unable to set osd_memory_target on smithi081 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi026 to 177.0M 2024-09-10T11:49:54.204 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Unable to set osd_memory_target on smithi026 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: Unable to set osd_memory_target on smithi017 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' 2024-09-10T11:49:54.205 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:53 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2250630019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:49:54.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T11:49:55.046 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:55.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:55 smithi026 ceph-mon[34817]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.1 KiB/s rd, 56 MiB/s wr, 11.15k op/s 2024-09-10T11:49:55.516 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:55 smithi017 ceph-mon[30817]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.1 KiB/s rd, 56 MiB/s wr, 11.15k op/s 2024-09-10T11:49:55.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.666+0000 7fcc1ce68640 1 -- 172.21.15.17:0/1244631219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc181008d0 msgr2=0x7fcc18100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.666+0000 7fcc167fc640 1 -- 172.21.15.17:0/1244631219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00037070 con 0x7fcc181008d0 2024-09-10T11:49:55.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.666+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/1244631219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc181008d0 0x7fcc18100d30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009890 tx=0x7fcc0002a360 comp rx=0 tx=0).stop 2024-09-10T11:49:55.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 -- 172.21.15.17:0/1244631219 shutdown_connections 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/1244631219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc18101270 0x7fcc1810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/1244631219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc181008d0 0x7fcc18100d30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/1244631219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 0x7fcc18106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 -- 172.21.15.17:0/1244631219 >> 172.21.15.17:0/1244631219 conn(0x7fcc180fc610 msgr2=0x7fcc180fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 -- 172.21.15.17:0/1244631219 shutdown_connections 2024-09-10T11:49:55.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.667+0000 7fcc1ce68640 1 -- 172.21.15.17:0/1244631219 wait complete. 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.668+0000 7fcc1ce68640 1 Processor -- start 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 -- start start 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc18101270 0x7fcc180741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 0x7fcc1806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1806d4a0 con 0x7fcc18101270 2024-09-10T11:49:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1806d320 con 0x7fcc181008d0 2024-09-10T11:49:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc1ce68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1806d620 con 0x7fcc181068d0 2024-09-10T11:49:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60156/0 (socket says 172.21.15.17:60156) 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc177fe640 1 -- 172.21.15.17:0/3726488259 learned_addr learned my addr 172.21.15.17:0/3726488259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc17fff640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 0x7fcc1806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.669+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc18101270 0x7fcc180741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.670+0000 7fcc177fe640 1 -- 172.21.15.17:0/3726488259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 msgr2=0x7fcc1806efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.670+0000 7fcc177fe640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 0x7fcc1806efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.670+0000 7fcc177fe640 1 -- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc18101270 msgr2=0x7fcc180741d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.670+0000 7fcc177fe640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc18101270 0x7fcc180741d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.670+0000 7fcc177fe640 1 -- 172.21.15.17:0/3726488259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1806f860 con 0x7fcc181008d0 2024-09-10T11:49:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.671+0000 7fcc177fe640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cce0 tx=0x7fcc1000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.671+0000 7fcc14ff9640 1 -- 172.21.15.17:0/3726488259 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000f650 con 0x7fcc181008d0 2024-09-10T11:49:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.671+0000 7fcc14ff9640 1 -- 172.21.15.17:0/3726488259 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1000fcd0 con 0x7fcc181008d0 2024-09-10T11:49:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.672+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1806fb50 con 0x7fcc181008d0 2024-09-10T11:49:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.672+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1819a360 con 0x7fcc181008d0 2024-09-10T11:49:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.672+0000 7fcc14ff9640 1 -- 172.21.15.17:0/3726488259 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10018c70 con 0x7fcc181008d0 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.676+0000 7fcc204a3740 1 Processor -- start 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 -- start start 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac13c2f0 con 0x55c7ac1d6780 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac0e3cf0 con 0x55c7ac1e1520 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc204a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac1382b0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.677+0000 7fcc17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60166/0 (socket says 172.21.15.17:60166) 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 -- 172.21.15.17:0/1346820523 learned_addr learned my addr 172.21.15.17:0/1346820523 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc177fe640 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 -- 172.21.15.17:0/1346820523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d7cf0 msgr2=0x55c7ac1d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 -- 172.21.15.17:0/1346820523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 msgr2=0x55c7ac1d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.678+0000 7fcc16ffd640 1 -- 172.21.15.17:0/1346820523 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ac0c83a0 con 0x55c7ac1e1520 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.679+0000 7fcc14ff9640 1 -- 172.21.15.17:0/3726488259 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcc1000f7f0 con 0x7fcc181008d0 2024-09-10T11:49:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.679+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009890 tx=0x7fcc00009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d8b4b3931f854e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.680+0000 7fcc14ff9640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 0x7fcc040a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.680+0000 7fcc14ff9640 1 -- 172.21.15.17:0/3726488259 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcc100cf330 con 0x7fcc181008d0 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.681+0000 7fcc0dffb640 1 -- 172.21.15.17:0/1346820523 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00041070 con 0x55c7ac1e1520 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.681+0000 7fcc0dffb640 1 -- 172.21.15.17:0/1346820523 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc00030850 con 0x55c7ac1e1520 2024-09-10T11:49:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.681+0000 7fcc0dffb640 1 -- 172.21.15.17:0/1346820523 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00037040 con 0x55c7ac1e1520 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.681+0000 7fcc17fff640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 0x7fcc040a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.682+0000 7fcc17fff640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 0x7fcc040a5060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcc08004610 tx=0x7fcc0801c2f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 -- 172.21.15.17:0/1346820523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 msgr2=0x55c7ac1e3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009890 tx=0x7fcc00009510 comp rx=0 tx=0).stop 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 -- 172.21.15.17:0/1346820523 shutdown_connections 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1e1520 0x55c7ac1e3910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 --2- 172.21.15.17:0/1346820523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.684+0000 7fcc204a3740 1 -- 172.21.15.17:0/1346820523 >> 172.21.15.17:0/1346820523 conn(0x55c7ac19f310 msgr2=0x55c7ac1d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.686+0000 7fcc204a3740 1 -- 172.21.15.17:0/1346820523 shutdown_connections 2024-09-10T11:49:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.687+0000 7fcc204a3740 1 -- 172.21.15.17:0/1346820523 wait complete. 2024-09-10T11:49:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.687+0000 7fcc204a3740 1 -- start start 2024-09-10T11:49:55.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.688+0000 7fcc204a3740 1 Processor -- start 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.688+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.688+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1de1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.688+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1de790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.688+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54976/0 (socket says 172.21.15.17:54976) 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc204a3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac1e41c0 con 0x55c7ac1d6780 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc204a3740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac0f7060 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc204a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac1e4340 con 0x55c7ac1e1520 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1de1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 -- 172.21.15.17:0/4050623017 learned_addr learned my addr 172.21.15.17:0/4050623017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:55.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc204a3740 10 client.0 _ll_register_callbacks cb 0x55c7abe4a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 -- 172.21.15.17:0/4050623017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 msgr2=0x55c7ac1de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 -- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 msgr2=0x55c7ac1de1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1de1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.689+0000 7fcc177fe640 1 -- 172.21.15.17:0/4050623017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7abead3c0 con 0x55c7ac1d6780 2024-09-10T11:49:55.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.690+0000 7fcc177fe640 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcc10098510 tx=0x7fcc1009b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46ed4b85ee6ad1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.690+0000 7fcbf6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.691+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1009c240 con 0x55c7ac1d6780 2024-09-10T11:49:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.691+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcc100a4320 con 0x55c7ac1d6780 2024-09-10T11:49:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.691+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc00030850 con 0x55c7ac1d6780 2024-09-10T11:49:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.693+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fcc1009bb40 con 0x55c7ac1d6780 2024-09-10T11:49:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.693+0000 7fcc204a3740 10 client.16170 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.693+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c7ac1efcf0 con 0x55c7ac1d6780 2024-09-10T11:49:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc00030850 con 0x55c7ac1d6780 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fcc100ba2a0 con 0x55c7ac1d6780 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 10 client.16170 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 10 client.16170 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 20 client.16170 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac1f11b0 0x55c7ac1f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 4 client.16170 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7ac149860 con 0x55c7ac1f11b0 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.695+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac1f11b0 0x55c7ac1f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.696+0000 7fcbf6ffd640 10 client.16170 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.697+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac1f11b0 0x55c7ac1f35a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c9de9995430daf1 server_cookie=12734bc1d51880a8 in_seq=0 out_seq=0 2024-09-10T11:49:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.698+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/4050623017 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7ac149860 con 0x55c7ac1f11b0 2024-09-10T11:49:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.698+0000 7fcbf6ffd640 10 client.16170 handle_command_reply: tid=0 2024-09-10T11:49:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.698+0000 7fcc204a3740 1 client.16170 shutdown 2024-09-10T11:49:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 msgr2=0x55c7ac1e0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcc10098510 tx=0x7fcc1009b910 comp rx=0 tx=0).stop 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 shutdown_connections 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac1f11b0 0x55c7ac1f35a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1de790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1de1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 --2- 172.21.15.17:0/4050623017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e0ef0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.699+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 >> 172.21.15.17:0/4050623017 conn(0x55c7ac19f310 msgr2=0x55c7ac1d8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.700+0000 7fcbf6ffd640 0 client.16170 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.701+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 shutdown_connections 2024-09-10T11:49:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.701+0000 7fcc204a3740 1 -- 172.21.15.17:0/4050623017 wait complete. 2024-09-10T11:49:55.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:55 smithi081 ceph-mon[35059]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.1 KiB/s rd, 56 MiB/s wr, 11.15k op/s 2024-09-10T11:49:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.701+0000 7fcc204a3740 20 client.16170 trim_cache size 0 max 16384 2024-09-10T11:49:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.726+0000 7fcc204a3740 1 Processor -- start 2024-09-10T11:49:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 -- start start 2024-09-10T11:49:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b3910 con 0x55c7ac1d6780 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b5450 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc204a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b3fe0 con 0x55c7ac1e1520 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc16ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60186/0 (socket says 172.21.15.17:60186) 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3942491152 learned_addr learned my addr 172.21.15.17:0/3942491152 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.728+0000 7fcc17fff640 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3942491152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 msgr2=0x55c7ac1f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3942491152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 msgr2=0x55c7ac1ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3942491152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ac1d3080 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.729+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc0002c010 tx=0x7fcc00000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=793e915d907aa223 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.732+0000 7fcc0d7fa640 1 -- 172.21.15.17:0/3942491152 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00037040 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.732+0000 7fcc0d7fa640 1 -- 172.21.15.17:0/3942491152 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc00030bc0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.732+0000 7fcc0d7fa640 1 -- 172.21.15.17:0/3942491152 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00041040 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.734+0000 7fcc204a3740 1 -- 172.21.15.17:0/3942491152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 msgr2=0x55c7ac1e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.734+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc0002c010 tx=0x7fcc00000bc0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.734+0000 7fcc204a3740 1 -- 172.21.15.17:0/3942491152 shutdown_connections 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.734+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1e1520 0x55c7ac1f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.734+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1e0110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.735+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3942491152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1d6780 0x55c7ac1ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.735+0000 7fcc204a3740 1 -- 172.21.15.17:0/3942491152 >> 172.21.15.17:0/3942491152 conn(0x55c7ac19f310 msgr2=0x55c7ac1dfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.735+0000 7fcc204a3740 1 -- 172.21.15.17:0/3942491152 shutdown_connections 2024-09-10T11:49:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.735+0000 7fcc204a3740 1 -- 172.21.15.17:0/3942491152 wait complete. 2024-09-10T11:49:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.736+0000 7fcc204a3740 1 -- start start 2024-09-10T11:49:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.736+0000 7fcc204a3740 1 Processor -- start 2024-09-10T11:49:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.737+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.737+0000 7fcc204a3740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1dab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.738+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.738+0000 7fcc177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49420/0 (socket says 172.21.15.17:49420) 2024-09-10T11:49:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.738+0000 7fcc177fe640 1 -- 172.21.15.17:0/3396142255 learned_addr learned my addr 172.21.15.17:0/3396142255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.738+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.738+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1e1520 0x55c7ac1db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.739+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b4d80 con 0x55c7ac1e1520 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.739+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b46b0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.739+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181b18f0 con 0x55c7ac1d6780 2024-09-10T11:49:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.739+0000 7fcc204a3740 10 client.0 _ll_register_callbacks cb 0x7fcc10007920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:55.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3396142255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 msgr2=0x55c7ac1e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3396142255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1e1520 msgr2=0x55c7ac1db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1e1520 0x55c7ac1db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ac1db5c0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.740+0000 7fcc16ffd640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1dab40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55c7ac1c46a0 tx=0x7fcc00030fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837980f3ae1e334a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.741+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc00030bc0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.741+0000 7fcbf6ffd640 10 client.25859 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.741+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/3396142255 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00037070 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.742+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/3396142255 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcc000328d0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.742+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/3396142255 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fcc0005e050 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.742+0000 7fcc204a3740 10 client.25859 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.742+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55c7ac25b9c0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.743+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/3396142255 <== mon.2 v2:172.21.15.26:3300/0 4 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fcc00032ad0 con 0x55c7ac1d7cf0 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.743+0000 7fcc204a3740 10 client.25859 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.743+0000 7fcc204a3740 10 client.25859 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.743+0000 7fcc204a3740 20 client.25859 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.744+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac25bb90 0x55c7ac25df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.744+0000 7fcc204a3740 4 client.25859 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.744+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 --> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcc00030bc0 con 0x55c7ac25bb90 2024-09-10T11:49:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.746+0000 7fcc177fe640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac25bb90 0x55c7ac25df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.750+0000 7fcbf6ffd640 10 client.25859 ms_handle_connect on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.750+0000 7fcc177fe640 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac25bb90 0x55c7ac25df80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=19aba0653eb0a9d3 server_cookie=7dc36d175b52588a in_seq=0 out_seq=0 2024-09-10T11:49:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.750+0000 7fcbf6ffd640 1 -- 172.21.15.17:0/3396142255 <== mds.4 v2:172.21.15.26:6836/2783390333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcc00030bc0 con 0x55c7ac25bb90 2024-09-10T11:49:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.750+0000 7fcbf6ffd640 10 client.25859 handle_command_reply: tid=0 2024-09-10T11:49:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.750+0000 7fcc204a3740 1 client.25859 shutdown 2024-09-10T11:49:55.753 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 msgr2=0x55c7ac1dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1dab40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55c7ac1c46a0 tx=0x7fcc00030fa0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 shutdown_connections 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:6836/2783390333,v1:172.21.15.26:6837/2783390333] conn(0x55c7ac25bb90 0x55c7ac25df80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7ac1e1520 0x55c7ac1db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c7ac1d7cf0 0x55c7ac1dab40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 --2- 172.21.15.17:0/3396142255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c7ac1d6780 0x55c7ac1e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 >> 172.21.15.17:0/3396142255 conn(0x55c7ac19f310 msgr2=0x55c7ac1d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcbf6ffd640 0 client.25859 ms_handle_reset on v2:172.21.15.26:6836/2783390333 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 shutdown_connections 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 1 -- 172.21.15.17:0/3396142255 wait complete. 2024-09-10T11:49:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.751+0000 7fcc204a3740 20 client.25859 trim_cache size 0 max 16384 2024-09-10T11:49:55.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 msgr2=0x7fcc040a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 0x7fcc040a5060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcc08004610 tx=0x7fcc0801c2f0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 msgr2=0x7fcc18073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000cce0 tx=0x7fcc1000a620 comp rx=0 tx=0).stop 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 shutdown_connections 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcc040a2ba0 0x7fcc040a5060 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc181068d0 0x7fcc1806efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc18101270 0x7fcc180741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 --2- 172.21.15.17:0/3726488259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc181008d0 0x7fcc18073c90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 >> 172.21.15.17:0/3726488259 conn(0x7fcc180fc610 msgr2=0x7fcc180fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 shutdown_connections 2024-09-10T11:49:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:55.755+0000 7fcc1ce68640 1 -- 172.21.15.17:0/3726488259 wait complete. 2024-09-10T11:49:57.410 INFO:tasks.workunit.client.0.smithi017.stdout:Syncing()...12 sec 2024-09-10T11:49:57.410 INFO:tasks.workunit.client.0.smithi017.stdout:FFSB benchmark finished at: Tue Sep 10 11:49:57 2024 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:Results: 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:Benchmark took 346.01 sec 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:Total Results 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:=============== 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: ======= ============ ========= ======= =========== ========== 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: write : 14650880 42342.73 100.000% 100.000% 165MB/sec 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:- 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:42342.73 Transactions per Second 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:Throughput Results 2024-09-10T11:49:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:=================== 2024-09-10T11:49:57.412 INFO:tasks.workunit.client.0.smithi017.stdout:Write Throughput: 165MB/sec 2024-09-10T11:49:57.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout:System Call Latency statistics in millisecs 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout:===== 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout: Min Avg Max Total Calls 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout: ======== ======== ======== ============ 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout:[ open] 0.005000 1.758683 2421.794922 11446 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T11:49:57.471 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[1] 2000.000000 - 5000.000000 : 2 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[2] 1000.000000 - 2000.000000 : 3 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[3] 500.000000 - 1000.000000 : 8 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[4] 200.000000 - 500.000000 : 10 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[6] 50.000000 - 100.000000 : 4 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[7] 20.000000 - 50.000000 : 14 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[8] 10.000000 - 20.000000 : 39 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[9] 5.000000 - 10.000000 : 44 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[10] 2.000000 - 5.000000 : 43 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[11] 1.000000 - 2.000000 : 48 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[12] 0.500000 - 1.000000 : 126 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[13] 0.200000 - 0.500000 : 18 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[14] 0.100000 - 0.200000 : 27 2024-09-10T11:49:57.472 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[15] 0.050000 - 0.100000 : 235 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[16] 0.020000 - 0.050000 : 4636 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[17] 0.010000 - 0.020000 : 5377 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[18] 0.000000 - 0.010000 : 810 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout:[ write] 0.001000 0.698222 16229.594727 14650880 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[0] 5000.000000 - 10000.000000 : 69 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[1] 2000.000000 - 5000.000000 : 676 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[2] 1000.000000 - 2000.000000 : 1501 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[3] 500.000000 - 1000.000000 : 529 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[4] 200.000000 - 500.000000 : 752 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[5] 100.000000 - 200.000000 : 2439 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[6] 50.000000 - 100.000000 : 27894 2024-09-10T11:49:57.473 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[7] 20.000000 - 50.000000 : 63599 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[8] 10.000000 - 20.000000 : 3446 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[9] 5.000000 - 10.000000 : 2020 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[10] 2.000000 - 5.000000 : 10953 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[11] 1.000000 - 2.000000 : 1401 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[12] 0.500000 - 1.000000 : 1053 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[13] 0.200000 - 0.500000 : 1173 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[14] 0.100000 - 0.200000 : 1332 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[15] 0.050000 - 0.100000 : 5986 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[16] 0.020000 - 0.050000 : 30090 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[17] 0.010000 - 0.020000 : 58285 2024-09-10T11:49:57.474 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[18] 0.000000 - 0.010000 : 14437674 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout:[ lseek] 0.000000 0.000855 96.431999 14650880 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[7] 20.000000 - 50.000000 : 41 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[8] 10.000000 - 20.000000 : 76 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[9] 5.000000 - 10.000000 : 76 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[10] 2.000000 - 5.000000 : 110 2024-09-10T11:49:57.475 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[11] 1.000000 - 2.000000 : 118 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[12] 0.500000 - 1.000000 : 132 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[13] 0.200000 - 0.500000 : 151 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[14] 0.100000 - 0.200000 : 173 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[15] 0.050000 - 0.100000 : 613 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[16] 0.020000 - 0.050000 : 3118 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[17] 0.010000 - 0.020000 : 6891 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[18] 0.000000 - 0.010000 : 14639379 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout:[ close] 0.001000 0.004822 0.122000 11446 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T11:49:57.476 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-10T11:49:57.478 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[14] 0.100000 - 0.200000 : 1 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[15] 0.050000 - 0.100000 : 2 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[16] 0.020000 - 0.050000 : 41 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[17] 0.010000 - 0.020000 : 79 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: msec_range[18] 0.000000 - 0.010000 : 11323 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-10T11:49:57.479 INFO:tasks.workunit.client.0.smithi017.stdout:3.9% User Time 2024-09-10T11:49:57.480 INFO:tasks.workunit.client.0.smithi017.stdout:13.3% System Time 2024-09-10T11:49:57.480 INFO:tasks.workunit.client.0.smithi017.stdout:17.2% CPU Utilization 2024-09-10T11:49:57.481 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd .. 2024-09-10T11:49:57.482 INFO:tasks.workunit.client.0.smithi017.stderr:+ rm -r tmp ffsb 2024-09-10T11:49:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:57.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:57 smithi081 ceph-mon[35059]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 57 MiB/s wr, 11.34k op/s 2024-09-10T11:49:57.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:57 smithi026 ceph-mon[34817]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 57 MiB/s wr, 11.34k op/s 2024-09-10T11:49:57.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:57 smithi017 ceph-mon[30817]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 7.6 KiB/s rd, 57 MiB/s wr, 11.34k op/s 2024-09-10T11:49:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 -- 172.21.15.17:0/227185076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 msgr2=0x7f32c010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 --2- 172.21.15.17:0/227185076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c010ec70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009cd0 tx=0x7f32b802a8d0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 -- 172.21.15.17:0/227185076 shutdown_connections 2024-09-10T11:49:58.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 --2- 172.21.15.17:0/227185076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c010ec70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 --2- 172.21.15.17:0/227185076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 --2- 172.21.15.17:0/227185076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 -- 172.21.15.17:0/227185076 >> 172.21.15.17:0/227185076 conn(0x7f32c00fc7d0 msgr2=0x7f32c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 -- 172.21.15.17:0/227185076 shutdown_connections 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.118+0000 7f32c56ab640 1 -- 172.21.15.17:0/227185076 wait complete. 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 Processor -- start 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 -- start start 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01120d0 con 0x7f32c0108300 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f32c0111f50 con 0x7f32c0103780 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32c56ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32c0112250 con 0x7f32c0102dd0 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.119+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55012/0 (socket says 172.21.15.17:55012) 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32bf7fe640 1 -- 172.21.15.17:0/2083936614 learned_addr learned my addr 172.21.15.17:0/2083936614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 -- 172.21.15.17:0/2083936614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 msgr2=0x7f32c0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 -- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 msgr2=0x7f32c019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 -- 172.21.15.17:0/2083936614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c019d540 con 0x7f32c0103780 2024-09-10T11:49:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32beffd640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0198ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32c00697d0 tx=0x7f32a800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32bcff9640 1 -- 172.21.15.17:0/2083936614 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a800cc40 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c019d830 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32bcff9640 1 -- 172.21.15.17:0/2083936614 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32a800cde0 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32bcff9640 1 -- 172.21.15.17:0/2083936614 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80188e0 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.120+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c01a5110 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32bcff9640 1 -- 172.21.15.17:0/2083936614 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f32a8018a80 con 0x7f32c0103780 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 Processor -- start 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 -- start start 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777bff2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bfff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55777bf582f0 con 0x55777bffd370 2024-09-10T11:49:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55777beffcf0 con 0x55777bff3b40 2024-09-10T11:49:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32c7a84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55777bf542b0 con 0x55777bff25d0 2024-09-10T11:49:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.123+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60240/0 (socket says 172.21.15.17:60240) 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32bf7fe640 1 -- 172.21.15.17:0/4163004914 learned_addr learned my addr 172.21.15.17:0/4163004914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32b7fff640 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bfff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777bff2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32bcff9640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 0x7f32ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 -- 172.21.15.17:0/4163004914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 msgr2=0x55777bff2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 -- 172.21.15.17:0/4163004914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 msgr2=0x55777bfff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bfff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 -- 172.21.15.17:0/4163004914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777bee43a0 con 0x55777bff25d0 2024-09-10T11:49:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32bcff9640 1 -- 172.21.15.17:0/2083936614 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f32a80cf290 con 0x7f32c0103780 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 0x7f32ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32beffd640 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777bff2a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009fd0 tx=0x7f32b00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6580ef5451ebbb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32b57fa640 1 -- 172.21.15.17:0/4163004914 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0004310 con 0x55777bff25d0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32b57fa640 1 -- 172.21.15.17:0/4163004914 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b00044b0 con 0x55777bff25d0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.124+0000 7f32b57fa640 1 -- 172.21.15.17:0/4163004914 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b00035f0 con 0x55777bff25d0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 -- 172.21.15.17:0/4163004914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 msgr2=0x55777bff2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 0x7f32ac0a5040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009df0 tx=0x7f32b80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777bff2a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009fd0 tx=0x7f32b00118d0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 -- 172.21.15.17:0/4163004914 shutdown_connections 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777bff2a10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bfff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 --2- 172.21.15.17:0/4163004914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.125+0000 7f32c7a84740 1 -- 172.21.15.17:0/4163004914 >> 172.21.15.17:0/4163004914 conn(0x55777bfbb310 msgr2=0x55777bfeec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- 172.21.15.17:0/4163004914 shutdown_connections 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- 172.21.15.17:0/4163004914 wait complete. 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- start start 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 Processor -- start 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 0x55777bff9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bffd370 0x55777bffa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55777c004480 con 0x55777bff25d0 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55777bf13060 con 0x55777bffd370 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55777c004600 con 0x55777bff3b40 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32c7a84740 10 client.0 _ll_register_callbacks cb 0x55777bc668c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:58.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.126+0000 7f32beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55034/0 (socket says 172.21.15.17:55034) 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32beffd640 1 -- 172.21.15.17:0/2738498487 learned_addr learned my addr 172.21.15.17:0/2738498487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 0x55777bff9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bffd370 0x55777bffa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 -- 172.21.15.17:0/2738498487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bffd370 msgr2=0x55777bffa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bffd370 0x55777bffa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 -- 172.21.15.17:0/2738498487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 msgr2=0x55777bffcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 -- 172.21.15.17:0/2738498487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777bcc93c0 con 0x55777bff3b40 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32beffd640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 0x55777bff9f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55777bff3070 tx=0x7f32a8009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156942f90db31e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a809b4b0 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f32a809afa0 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b00044b0 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f32a809bb50 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32c7a84740 10 client.25834 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.127+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55777c00fe90 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b00044b0 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f32a809ac10 con 0x55777bff3b40 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 10 client.25834 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 10 client.25834 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 20 client.25834 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c011350 0x55777c0137d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 4 client.25834 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55777bf65860 con 0x55777c011350 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32beffd640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c011350 0x55777c0137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32a67fc640 10 client.25834 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.128+0000 7f32beffd640 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c011350 0x55777c0137d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d5230fac8d46259 server_cookie=4c6116e042c691b1 in_seq=0 out_seq=0 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32a67fc640 1 -- 172.21.15.17:0/2738498487 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55777bf65860 con 0x55777c011350 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32a67fc640 10 client.25834 handle_command_reply: tid=0 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 client.25834 shutdown 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 msgr2=0x55777bff9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 0x55777bff9f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55777bff3070 tx=0x7f32a8009700 comp rx=0 tx=0).stop 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 shutdown_connections 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c011350 0x55777c0137d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff3b40 0x55777bff9f90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32a67fc640 0 client.25834 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bffd370 0x55777bffa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2738498487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777bffcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 >> 172.21.15.17:0/2738498487 conn(0x55777bfbb310 msgr2=0x55777bff4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 shutdown_connections 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.129+0000 7f32c7a84740 1 -- 172.21.15.17:0/2738498487 wait complete. 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.130+0000 7f32c7a84740 20 client.25834 trim_cache size 0 max 16384 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 Processor -- start 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 -- start start 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 0x55777bff5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01ab3b0 con 0x55777bff25d0 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01acef0 con 0x55777bff3b40 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.144+0000 7f32c7a84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01aba80 con 0x55777bffd370 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55048/0 (socket says 172.21.15.17:55048) 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32beffd640 1 -- 172.21.15.17:0/2194237603 learned_addr learned my addr 172.21.15.17:0/2194237603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 0x55777bff5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32b7fff640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 -- 172.21.15.17:0/2194237603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 msgr2=0x55777bff5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 -- 172.21.15.17:0/2194237603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 msgr2=0x55777c00d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 -- 172.21.15.17:0/2194237603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777bff5ba0 con 0x55777bffd370 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32beffd640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 0x55777bff5660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b803e030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7e69fb8aca6f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32b4ff9640 1 -- 172.21.15.17:0/2194237603 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8058070 con 0x55777bffd370 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32b4ff9640 1 -- 172.21.15.17:0/2194237603 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8036040 con 0x55777bffd370 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.145+0000 7f32b4ff9640 1 -- 172.21.15.17:0/2194237603 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b802f630 con 0x55777bffd370 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 -- 172.21.15.17:0/2194237603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 msgr2=0x55777bff5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 0x55777bff5660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b803e030 comp rx=0 tx=0).stop 2024-09-10T11:49:58.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 -- 172.21.15.17:0/2194237603 shutdown_connections 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bffd370 0x55777bff5660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 --2- 172.21.15.17:0/2194237603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bff25d0 0x55777c00d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 -- 172.21.15.17:0/2194237603 >> 172.21.15.17:0/2194237603 conn(0x55777bfbb310 msgr2=0x55777bff9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 -- 172.21.15.17:0/2194237603 shutdown_connections 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.146+0000 7f32c7a84740 1 -- 172.21.15.17:0/2194237603 wait complete. 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 -- start start 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 Processor -- start 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777c009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01ac820 con 0x55777bffd370 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01ac150 con 0x55777bff3b40 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32c01a9390 con 0x55777bff25d0 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32c7a84740 10 client.0 _ll_register_callbacks cb 0x7f32a80d29c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55050/0 (socket says 172.21.15.17:55050) 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32bf7fe640 1 -- 172.21.15.17:0/3025370446 learned_addr learned my addr 172.21.15.17:0/3025370446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32beffd640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777c009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.147+0000 7f32bf7fe640 1 -- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 msgr2=0x55777c009fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777c009fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32bf7fe640 1 -- 172.21.15.17:0/3025370446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 msgr2=0x55777bff6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32bf7fe640 1 -- 172.21.15.17:0/3025370446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777bff7a50 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32b7fff640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32bf7fe640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009ca0 tx=0x7f32b8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f026df934fbdead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8061060 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f32b8004040 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b8036040 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f32b8058040 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32c7a84740 10 client.16188 fetch_fsmap learned FSMap version 37 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55777c07c100 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.148+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8036040 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f32b805b070 con 0x55777bffd370 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 10 client.16188 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T11:49:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 10 client.16188 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 20 client.16188 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c07c770 0x55777c07eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 4 client.16188 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 --> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55777bf5fd70 con 0x55777c07c770 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32beffd640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c07c770 0x55777c07eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32a67fc640 10 client.16188 ms_handle_connect on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32beffd640 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c07c770 0x55777c07eb90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a885b14ba0619c60 server_cookie=cef0a8a7f7e21d52 in_seq=0 out_seq=0 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32a67fc640 1 -- 172.21.15.17:0/3025370446 <== mds.3 v2:172.21.15.81:6834/997801833 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55777bf5fd70 con 0x55777c07c770 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32a67fc640 10 client.16188 handle_command_reply: tid=0 2024-09-10T11:49:58.173 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 1 client.16188 shutdown 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 msgr2=0x55777bff7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.149+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009ca0 tx=0x7f32b8005ef0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 shutdown_connections 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:6834/997801833,v1:172.21.15.81:6835/997801833] conn(0x55777c07c770 0x55777c07eb90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55777bffd370 0x55777bff7220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55777bff3b40 0x55777bff6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 --2- 172.21.15.17:0/3025370446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55777bff25d0 0x55777c009fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 >> 172.21.15.17:0/3025370446 conn(0x55777bfbb310 msgr2=0x55777bffb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32a67fc640 0 client.16188 ms_handle_reset on v2:172.21.15.81:6834/997801833 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 shutdown_connections 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 1 -- 172.21.15.17:0/3025370446 wait complete. 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c7a84740 20 client.16188 trim_cache size 0 max 16384 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 msgr2=0x7f32ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 0x7f32ac0a5040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009df0 tx=0x7f32b80095c0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 msgr2=0x7f32c0198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0198ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32c00697d0 tx=0x7f32a800ee50 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 shutdown_connections 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f32ac0a2b80 0x7f32ac0a5040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c0108300 0x7f32c019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32c0103780 0x7f32c0198ad0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 --2- 172.21.15.17:0/2083936614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32c0102dd0 0x7f32c0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:58.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.150+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 >> 172.21.15.17:0/2083936614 conn(0x7f32c00fc7d0 msgr2=0x7f32c0105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:58.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.151+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 shutdown_connections 2024-09-10T11:49:58.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:58.151+0000 7f32c56ab640 1 -- 172.21.15.17:0/2083936614 wait complete. 2024-09-10T11:49:58.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T11:49:59.214 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:49:59.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T11:49:59.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T11:49:59.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:49:59 smithi017 ceph-mon[30817]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 80 MiB/s wr, 16.33k op/s 2024-09-10T11:49:59.657 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-10T11:49:59.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T11:49:59.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:49:59 smithi081 ceph-mon[35059]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 80 MiB/s wr, 16.33k op/s 2024-09-10T11:49:59.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:49:59 smithi026 ceph-mon[34817]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 80 MiB/s wr, 16.33k op/s 2024-09-10T11:49:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/1159599382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 msgr2=0x7f9a08100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/1159599382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a08100ca0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009900 tx=0x7f99fc02a3f0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/1159599382 shutdown_connections 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/1159599382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a081011e0 0x7f9a08105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/1159599382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a08105ec0 0x7f9a08106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/1159599382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a08100ca0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.822+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/1159599382 >> 172.21.15.17:0/1159599382 conn(0x7f9a080fc7d0 msgr2=0x7f9a080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.824+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/1159599382 shutdown_connections 2024-09-10T11:49:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.824+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/1159599382 wait complete. 2024-09-10T11:49:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.825+0000 7f9a0f1f0640 1 Processor -- start 2024-09-10T11:49:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.825+0000 7f9a0f1f0640 1 -- start start 2024-09-10T11:49:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 0x7f9a081a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a08105ec0 0x7f9a0819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a08118690 con 0x7f9a081008c0 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a08118510 con 0x7f9a081011e0 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.826+0000 7f9a0f1f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a08118810 con 0x7f9a08105ec0 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55068/0 (socket says 172.21.15.17:55068) 2024-09-10T11:49:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2832942354 learned_addr learned my addr 172.21.15.17:0/2832942354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:59.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0d78d640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a08105ec0 0x7f9a0819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 0x7f9a081a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2832942354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a08105ec0 msgr2=0x7f9a0819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a08105ec0 0x7f9a0819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2832942354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 msgr2=0x7f9a081a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 0x7f9a081a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2832942354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0819f150 con 0x7f9a081008c0 2024-09-10T11:49:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.827+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 0x7f9a081a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.828+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006010 tx=0x7f99fc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.828+0000 7f9a05ffb640 1 -- 172.21.15.17:0/2832942354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc03f070 con 0x7f9a081008c0 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.828+0000 7f9a05ffb640 1 -- 172.21.15.17:0/2832942354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc031c30 con 0x7f9a081008c0 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.828+0000 7f9a05ffb640 1 -- 172.21.15.17:0/2832942354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc035030 con 0x7f9a081008c0 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.828+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0819f3e0 con 0x7f9a081008c0 2024-09-10T11:49:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.829+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0819f7b0 con 0x7f9a081008c0 2024-09-10T11:49:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.833+0000 7f9a05ffb640 1 -- 172.21.15.17:0/2832942354 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f99fc042070 con 0x7f9a081008c0 2024-09-10T11:49:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.834+0000 7f9a05ffb640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 0x7f99f00a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.834+0000 7f9a05ffb640 1 -- 172.21.15.17:0/2832942354 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f99fc0f0750 con 0x7f9a081008c0 2024-09-10T11:49:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 Processor -- start 2024-09-10T11:49:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 -- start start 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd3004da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd3005a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ffb32f0 con 0x55fd3004eb40 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ff5acf0 con 0x55fd3004d5d0 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.835+0000 7f9a115c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ffaf2b0 con 0x55fd30058370 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.836+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.836+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55076/0 (socket says 172.21.15.17:55076) 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.836+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3819003811 learned_addr learned my addr 172.21.15.17:0/3819003811 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.836+0000 7f9a07fff640 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd3004da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.837+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3819003811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 msgr2=0x55fd3005a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.837+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd3005a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.837+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3819003811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 msgr2=0x55fd3004da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.837+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd3004da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.837+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3819003811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2ff3f3a0 con 0x55fd3004eb40 2024-09-10T11:49:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.838+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 0x7f99f00a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.838+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f99fc004650 tx=0x7f99fc0bcbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245116547dde5a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.839+0000 7f99eeffd640 1 -- 172.21.15.17:0/3819003811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc049070 con 0x55fd3004eb40 2024-09-10T11:49:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.839+0000 7f99eeffd640 1 -- 172.21.15.17:0/3819003811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc0bd6c0 con 0x55fd3004eb40 2024-09-10T11:49:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.839+0000 7f99eeffd640 1 -- 172.21.15.17:0/3819003811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc03b460 con 0x55fd3004eb40 2024-09-10T11:49:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.839+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 0x7f99f00a5190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55fd3004aac0 tx=0x7f9a00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.840+0000 7f9a115c9740 1 -- 172.21.15.17:0/3819003811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 msgr2=0x55fd3004d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.841+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f99fc004650 tx=0x7f99fc0bcbc0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.847+0000 7f9a115c9740 1 -- 172.21.15.17:0/3819003811 shutdown_connections 2024-09-10T11:49:59.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.847+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd3005a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.847+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd3004da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.847+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3819003811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd3004d090 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.847+0000 7f9a115c9740 1 -- 172.21.15.17:0/3819003811 >> 172.21.15.17:0/3819003811 conn(0x55fd30016310 msgr2=0x55fd30049c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.850+0000 7f9a115c9740 1 -- 172.21.15.17:0/3819003811 shutdown_connections 2024-09-10T11:49:59.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.851+0000 7f9a115c9740 1 -- 172.21.15.17:0/3819003811 wait complete. 2024-09-10T11:49:59.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.851+0000 7f9a115c9740 1 -- start start 2024-09-10T11:49:59.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.851+0000 7f9a115c9740 1 Processor -- start 2024-09-10T11:49:59.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.852+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 0x55fd30057d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.852+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 0x55fd30057d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.852+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 0x55fd30057d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49518/0 (socket says 172.21.15.17:49518) 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.852+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/976491566 learned_addr learned my addr 172.21.15.17:0/976491566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.853+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 0x55fd30055010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.853+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 0x55fd30055600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.853+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd3006be40 con 0x55fd30058370 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.853+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ff6e060 con 0x55fd3004eb40 2024-09-10T11:49:59.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.853+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd3006bfc0 con 0x55fd3004d5d0 2024-09-10T11:49:59.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.854+0000 7f9a115c9740 10 client.0 _ll_register_callbacks cb 0x55fd2fcc18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:59.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 0x55fd30055010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a0d78d640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 0x55fd30055600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 -- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 msgr2=0x55fd30057d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 0x55fd30057d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 -- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 msgr2=0x55fd30055600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 0x55fd30055600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a07fff640 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2fd243c0 con 0x55fd3004eb40 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.859+0000 7f9a0d78d640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 0x55fd30055600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:49:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.860+0000 7f9a07fff640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 0x55fd30055010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a080ffce0 tx=0x7f9a00004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdec5954d815e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.860+0000 7f99e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.860+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00013220 con 0x55fd3004eb40 2024-09-10T11:49:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.860+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f9a0000f910 con 0x55fd3004eb40 2024-09-10T11:49:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.860+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99fc0bd6c0 con 0x55fd3004eb40 2024-09-10T11:49:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.861+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9a0000fb10 con 0x55fd3004eb40 2024-09-10T11:49:59.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.861+0000 7f9a115c9740 10 client.25883 fetch_fsmap learned FSMap version 38 2024-09-10T11:49:59.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.861+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fd300778a0 con 0x55fd3004eb40 2024-09-10T11:49:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0000fcb0 con 0x55fd3004eb40 2024-09-10T11:49:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f9a000125f0 con 0x55fd3004eb40 2024-09-10T11:49:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 10 client.25883 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 10 client.25883 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 20 client.25883 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd30078db0 0x55fd3007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 4 client.25883 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.865+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f99fc0bd6c0 con 0x55fd30078db0 2024-09-10T11:49:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.866+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd30078db0 0x55fd3007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.874+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd30078db0 0x55fd3007b1a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e60213b18cc8584 server_cookie=82fab191a5571a74 in_seq=0 out_seq=0 2024-09-10T11:49:59.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.874+0000 7f99e7fff640 10 client.25883 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:59.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.875+0000 7f99e7fff640 1 -- 172.21.15.17:0/976491566 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f99fc0bd6c0 con 0x55fd30078db0 2024-09-10T11:49:59.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.875+0000 7f99e7fff640 10 client.25883 handle_command_reply: tid=0 2024-09-10T11:49:59.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.875+0000 7f9a115c9740 1 client.25883 shutdown 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 msgr2=0x55fd30055010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 0x55fd30055010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a080ffce0 tx=0x7f9a00004a40 comp rx=0 tx=0).stop 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 shutdown_connections 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd30078db0 0x55fd3007b1a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd30058370 0x55fd30055600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004eb40 0x55fd30055010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 --2- 172.21.15.17:0/976491566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd3004d5d0 0x55fd30057d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 >> 172.21.15.17:0/976491566 conn(0x55fd30016310 msgr2=0x55fd3004f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.876+0000 7f99e7fff640 0 client.25883 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.880+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 shutdown_connections 2024-09-10T11:49:59.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.882+0000 7f9a115c9740 1 -- 172.21.15.17:0/976491566 wait complete. 2024-09-10T11:49:59.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.882+0000 7f9a115c9740 20 client.25883 trim_cache size 0 max 16384 2024-09-10T11:49:59.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.912+0000 7f9a115c9740 1 Processor -- start 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 -- start start 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd30074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd30054e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99f400e4c0 con 0x55fd3004eb40 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4010030 con 0x55fd3004d5d0 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.914+0000 7f9a115c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99f400eb90 con 0x55fd30058370 2024-09-10T11:49:59.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.915+0000 7f9a07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.915+0000 7f9a07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55102/0 (socket says 172.21.15.17:55102) 2024-09-10T11:49:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.915+0000 7f9a07fff640 1 -- 172.21.15.17:0/3944824196 learned_addr learned my addr 172.21.15.17:0/3944824196 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.915+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd30074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.915+0000 7f9a0d78d640 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd30054e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.916+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3944824196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 msgr2=0x55fd30054e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.916+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd30054e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.916+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3944824196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 msgr2=0x55fd300548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.916+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.916+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/3944824196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd30055970 con 0x55fd3004d5d0 2024-09-10T11:49:59.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.917+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd30074fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0f0a70 tx=0x7f99fc0095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1044773dbd0cce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.919+0000 7f99ee7fc640 1 -- 172.21.15.17:0/3944824196 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc049040 con 0x55fd3004d5d0 2024-09-10T11:49:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.919+0000 7f99ee7fc640 1 -- 172.21.15.17:0/3944824196 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc0c5c30 con 0x55fd3004d5d0 2024-09-10T11:49:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.920+0000 7f9a115c9740 1 -- 172.21.15.17:0/3944824196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 msgr2=0x55fd30074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.920+0000 7f99ee7fc640 1 -- 172.21.15.17:0/3944824196 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc049040 con 0x55fd3004d5d0 2024-09-10T11:49:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.920+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd30074fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0f0a70 tx=0x7f99fc0095f0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 -- 172.21.15.17:0/3944824196 shutdown_connections 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd30054e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 --2- 172.21.15.17:0/3944824196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd30074fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 -- 172.21.15.17:0/3944824196 >> 172.21.15.17:0/3944824196 conn(0x55fd30016310 msgr2=0x55fd300538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 -- 172.21.15.17:0/3944824196 shutdown_connections 2024-09-10T11:49:59.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 -- 172.21.15.17:0/3944824196 wait complete. 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.921+0000 7f9a115c9740 1 -- start start 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 Processor -- start 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300dbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd300dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99f400f960 con 0x55fd3004eb40 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f99f400f260 con 0x55fd3004d5d0 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99f400c4a0 con 0x55fd30058370 2024-09-10T11:49:59.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.922+0000 7f9a115c9740 10 client.0 _ll_register_callbacks cb 0x7f9a00011a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:49:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.925+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.925+0000 7f9a0cf8c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:60306/0 (socket says 172.21.15.17:60306) 2024-09-10T11:49:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.925+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2812525753 learned_addr learned my addr 172.21.15.17:0/2812525753 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.927+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300dbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.927+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 msgr2=0x55fd300dc4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.927+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd300dc4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.927+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2812525753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 msgr2=0x55fd300dbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.928+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300dbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.928+0000 7f9a0cf8c640 1 -- 172.21.15.17:0/2812525753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd30070180 con 0x55fd3004d5d0 2024-09-10T11:49:59.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f9a0cf8c640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0bcf50 tx=0x7f99fc0bb2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd425af1a9f2536 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:49:59.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f99e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-10T11:49:59.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc049070 con 0x55fd3004d5d0 2024-09-10T11:49:59.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mon.2 v2:172.21.15.26:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f99fc03b460 con 0x55fd3004d5d0 2024-09-10T11:49:59.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99fc0c5c30 con 0x55fd3004d5d0 2024-09-10T11:49:59.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.929+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f99fc03b660 con 0x55fd3004d5d0 2024-09-10T11:49:59.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.931+0000 7f9a115c9740 10 client.25889 fetch_fsmap learned FSMap version 38 2024-09-10T11:49:59.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.931+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fd30071440 con 0x55fd3004d5d0 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mon.2 v2:172.21.15.26:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc0c5c30 con 0x55fd3004d5d0 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mon.2 v2:172.21.15.26:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f99fc0bf070 con 0x55fd3004d5d0 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 10 client.25889 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 10 client.25889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 20 client.25889 populate_metadata read hostname 'smithi017' 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd300717d0 0x55fd300f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:49:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 4 client.25889 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:49:59.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.932+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 --> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd2ffc0860 con 0x55fd300717d0 2024-09-10T11:49:59.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.934+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd300717d0 0x55fd300f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f99e7fff640 10 client.25889 ms_handle_connect on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a07fff640 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd300717d0 0x55fd300f6aa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5eef76907ae59f3f server_cookie=ea4b9bbeea9184ad in_seq=0 out_seq=0 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f99e7fff640 1 -- 172.21.15.17:0/2812525753 <== mds.2 v2:172.21.15.81:6836/4227780996 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd2ffc0860 con 0x55fd300717d0 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f99e7fff640 10 client.25889 handle_command_reply: tid=0 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 client.25889 shutdown 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 msgr2=0x55fd300dba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0bcf50 tx=0x7f99fc0bb2c0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 shutdown_connections 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:6836/4227780996,v1:172.21.15.81:6837/4227780996] conn(0x55fd300717d0 0x55fd300f6aa0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd30058370 0x55fd300dc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd3004eb40 0x55fd300dbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 --2- 172.21.15.17:0/2812525753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fd3004d5d0 0x55fd300dba40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 >> 172.21.15.17:0/2812525753 conn(0x55fd30016310 msgr2=0x55fd30053770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f99e7fff640 0 client.25889 ms_handle_reset on v2:172.21.15.81:6836/4227780996 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 shutdown_connections 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.939+0000 7f9a115c9740 1 -- 172.21.15.17:0/2812525753 wait complete. 2024-09-10T11:49:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.940+0000 7f9a115c9740 20 client.25889 trim_cache size 0 max 16384 2024-09-10T11:49:59.943 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:49:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.941+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 msgr2=0x7f99f00a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.941+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 0x7f99f00a5190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55fd3004aac0 tx=0x7f9a00009500 comp rx=0 tx=0).stop 2024-09-10T11:49:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.941+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 msgr2=0x7f9a081a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:49:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.941+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006010 tx=0x7f99fc003c10 comp rx=0 tx=0).stop 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 shutdown_connections 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f99f00a2cd0 0x7f99f00a5190 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a08105ec0 0x7f9a0819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a081011e0 0x7f9a081a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 --2- 172.21.15.17:0/2832942354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a081008c0 0x7f9a081a4860 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 >> 172.21.15.17:0/2832942354 conn(0x7f9a080fc7d0 msgr2=0x7f9a0810f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:49:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 shutdown_connections 2024-09-10T11:49:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:49:59.944+0000 7f9a0f1f0640 1 -- 172.21.15.17:0/2832942354 wait complete. 2024-09-10T11:50:00.191 DEBUG:teuthology.parallel:result is None 2024-09-10T11:50:00.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T11:50:00.271 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T11:50:00.271 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T11:50:00.281 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T11:50:00.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:00 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:00.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:00 smithi017 ceph-mon[30817]: overall HEALTH_OK 2024-09-10T11:50:00.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:00 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:00.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:00 smithi081 ceph-mon[35059]: overall HEALTH_OK 2024-09-10T11:50:00.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T11:50:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:00 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:00.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:00 smithi026 ceph-mon[34817]: overall HEALTH_OK 2024-09-10T11:50:01.169 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:01.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:01 smithi081 ceph-mon[35059]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 13.63k op/s 2024-09-10T11:50:01.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:01 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:01.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:01 smithi026 ceph-mon[34817]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 13.63k op/s 2024-09-10T11:50:01.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:01 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:01 smithi017 ceph-mon[30817]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 12 KiB/s rd, 67 MiB/s wr, 13.63k op/s 2024-09-10T11:50:01.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:01 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c3159a640 1 -- 172.21.15.17:0/1191092276 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24034020 con 0x7f0c34074590 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 -- 172.21.15.17:0/1191092276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 msgr2=0x7f0c34074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 --2- 172.21.15.17:0/1191092276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34074970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009ca0 tx=0x7f0c2402a950 comp rx=0 tx=0).stop 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 -- 172.21.15.17:0/1191092276 shutdown_connections 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 --2- 172.21.15.17:0/1191092276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 0x7f0c34114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 --2- 172.21.15.17:0/1191092276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c34112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 --2- 172.21.15.17:0/1191092276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34074970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.041+0000 7f0c38984640 1 -- 172.21.15.17:0/1191092276 >> 172.21.15.17:0/1191092276 conn(0x7f0c340fd8c0 msgr2=0x7f0c340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.042+0000 7f0c38984640 1 -- 172.21.15.17:0/1191092276 shutdown_connections 2024-09-10T11:50:03.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.042+0000 7f0c38984640 1 -- 172.21.15.17:0/1191092276 wait complete. 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 Processor -- start 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 -- start start 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34073a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 0x7f0c3406cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341185c0 con 0x7f0c34112b90 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34118440 con 0x7f0c34074eb0 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c38984640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34118740 con 0x7f0c34074590 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34640/0 (socket says 172.21.15.17:34640) 2024-09-10T11:50:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.043+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2275947449 learned_addr learned my addr 172.21.15.17:0/2275947449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:03.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c3259c640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 0x7f0c3406cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2275947449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 msgr2=0x7f0c34073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34073a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 msgr2=0x7f0c3406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 0x7f0c3406cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2275947449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3406d590 con 0x7f0c34074eb0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.045+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d770 tx=0x7f0c2800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.046+0000 7f0c237fe640 1 -- 172.21.15.17:0/2275947449 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28017070 con 0x7f0c34074eb0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.046+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3406d880 con 0x7f0c34074eb0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.046+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c34071790 con 0x7f0c34074eb0 2024-09-10T11:50:03.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.047+0000 7f0c237fe640 1 -- 172.21.15.17:0/2275947449 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c28005500 con 0x7f0c34074eb0 2024-09-10T11:50:03.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.047+0000 7f0c237fe640 1 -- 172.21.15.17:0/2275947449 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28004e00 con 0x7f0c34074eb0 2024-09-10T11:50:03.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.050+0000 7f0c237fe640 1 -- 172.21.15.17:0/2275947449 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c28010460 con 0x7f0c34074eb0 2024-09-10T11:50:03.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.050+0000 7f0c3ad5d740 1 Processor -- start 2024-09-10T11:50:03.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.051+0000 7f0c237fe640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 0x7f0c1c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.051+0000 7f0c237fe640 1 -- 172.21.15.17:0/2275947449 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0c280cfaa0 con 0x7f0c34074eb0 2024-09-10T11:50:03.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 -- start start 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af70090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af70a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e8aed62f0 con 0x561e8af705d0 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561e8ae7dcf0 con 0x561e8af71b40 2024-09-10T11:50:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.052+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e8aed22b0 con 0x561e8af7b370 2024-09-10T11:50:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c32d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 0x7f0c1c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c3259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af70090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af70a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c32d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40584/0 (socket says 172.21.15.17:40584) 2024-09-10T11:50:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.057+0000 7f0c32d9d640 1 -- 172.21.15.17:0/1626594305 learned_addr learned my addr 172.21.15.17:0/1626594305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:03.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 -- 172.21.15.17:0/1626594305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 msgr2=0x561e8af70090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af70090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 -- 172.21.15.17:0/1626594305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 msgr2=0x561e8af70a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af70a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 -- 172.21.15.17:0/1626594305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8ae623a0 con 0x561e8af7b370 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c012920 tx=0x7f0c2c012de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901c0c800285cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 0x7f0c1c0a50c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c015000 tx=0x7f0c2c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c20ff9640 1 -- 172.21.15.17:0/1626594305 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c004030 con 0x561e8af7b370 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.058+0000 7f0c20ff9640 1 -- 172.21.15.17:0/1626594305 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c0041d0 con 0x561e8af7b370 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.059+0000 7f0c20ff9640 1 -- 172.21.15.17:0/1626594305 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c00db30 con 0x561e8af7b370 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/1626594305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 msgr2=0x561e8af7d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c012920 tx=0x7f0c2c012de0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/1626594305 shutdown_connections 2024-09-10T11:50:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8af7d760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af70a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/1626594305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af70090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/1626594305 >> 172.21.15.17:0/1626594305 conn(0x561e8af39310 msgr2=0x561e8af6cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/1626594305 shutdown_connections 2024-09-10T11:50:03.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.063+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/1626594305 wait complete. 2024-09-10T11:50:03.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 -- start start 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 Processor -- start 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af705d0 0x561e8af7ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af78010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 0x561e8af78600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e8af7dfb0 con 0x561e8af7b370 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561e8ae91060 con 0x561e8af71b40 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e8af7e130 con 0x561e8af705d0 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.064+0000 7f0c3ad5d740 10 client.0 _ll_register_callbacks cb 0x561e8abe48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.065+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af78010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.065+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af78010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34660/0 (socket says 172.21.15.17:34660) 2024-09-10T11:50:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.065+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2956009561 learned_addr learned my addr 172.21.15.17:0/2956009561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 0x561e8af78600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2956009561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af705d0 msgr2=0x561e8af7ad60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af705d0 0x561e8af7ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 msgr2=0x561e8af78010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af78010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.066+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2956009561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8ac473c0 con 0x561e8af7b370 2024-09-10T11:50:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.067+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 0x561e8af78600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c020040 tx=0x7f0c2c0125b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c35374822acd584 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.067+0000 7f0c19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:50:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.067+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c01b040 con 0x561e8af7b370 2024-09-10T11:50:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.067+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0c2c00d890 con 0x561e8af7b370 2024-09-10T11:50:03.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.068+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c2c0041d0 con 0x561e8af7b370 2024-09-10T11:50:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.070+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0c2c005790 con 0x561e8af7b370 2024-09-10T11:50:03.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.072+0000 7f0c3ad5d740 10 client.16215 fetch_fsmap learned FSMap version 39 2024-09-10T11:50:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.072+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561e8af89ab0 con 0x561e8af7b370 2024-09-10T11:50:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.075+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c2c0041d0 con 0x561e8af7b370 2024-09-10T11:50:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f0c2c003c40 con 0x561e8af7b370 2024-09-10T11:50:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 10 client.16215 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T11:50:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:50:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 20 client.16215 populate_metadata read hostname 'smithi017' 2024-09-10T11:50:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8af8af10 0x561e8af8d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 4 client.16215 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:50:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e8aee3860 con 0x561e8af8af10 2024-09-10T11:50:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.076+0000 7f0c3259c640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8af8af10 0x561e8af8d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.079+0000 7f0c3259c640 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8af8af10 0x561e8af8d300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=beec7083adeee330 server_cookie=14784a5cf8d36c88 in_seq=0 out_seq=0 2024-09-10T11:50:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.079+0000 7f0c19ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:50:03.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2956009561 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e8aee3860 con 0x561e8af8af10 2024-09-10T11:50:03.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c19ffb640 10 client.16215 handle_command_reply: tid=0 2024-09-10T11:50:03.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 client.16215 shutdown 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 msgr2=0x561e8af78600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 0x561e8af78600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c020040 tx=0x7f0c2c0125b0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 shutdown_connections 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8af8af10 0x561e8af8d300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af7b370 0x561e8af78600 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af78010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2956009561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af705d0 0x561e8af7ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.080+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 >> 172.21.15.17:0/2956009561 conn(0x561e8af39310 msgr2=0x561e8af72930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.081+0000 7f0c19ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.081+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 shutdown_connections 2024-09-10T11:50:03.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.081+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2956009561 wait complete. 2024-09-10T11:50:03.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.083+0000 7f0c3ad5d740 20 client.16215 trim_cache size 0 max 16384 2024-09-10T11:50:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.109+0000 7f0c3ad5d740 1 Processor -- start 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.109+0000 7f0c3ad5d740 1 -- start start 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af6ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 0x561e8af92930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1400e4c0 con 0x561e8af705d0 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14010060 con 0x561e8af7b370 2024-09-10T11:50:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1400eb90 con 0x561e8af71b40 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c31d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40598/0 (socket says 172.21.15.17:40598) 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.110+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2566136677 learned_addr learned my addr 172.21.15.17:0/2566136677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 0x561e8af92930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2566136677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 msgr2=0x561e8af92930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 0x561e8af92930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2566136677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 msgr2=0x561e8af6ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af6ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 -- 172.21.15.17:0/2566136677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8af76560 con 0x561e8af71b40 2024-09-10T11:50:03.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 0x561e8af92930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:50:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.111+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c280049b0 tx=0x7f0c2809c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c91f3fdb20c42da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.112+0000 7f0c1bfff640 1 -- 172.21.15.17:0/2566136677 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280b5070 con 0x561e8af71b40 2024-09-10T11:50:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.112+0000 7f0c1bfff640 1 -- 172.21.15.17:0/2566136677 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c280a4f20 con 0x561e8af71b40 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.112+0000 7f0c1bfff640 1 -- 172.21.15.17:0/2566136677 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28020040 con 0x561e8af71b40 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.113+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2566136677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 msgr2=0x561e8af872b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c280049b0 tx=0x7f0c2809c9b0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2566136677 shutdown_connections 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af71b40 0x561e8af872b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af7b370 0x561e8af92930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2566136677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af6ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.114+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2566136677 >> 172.21.15.17:0/2566136677 conn(0x561e8af39310 msgr2=0x561e8af6c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.115+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2566136677 shutdown_connections 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.115+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2566136677 wait complete. 2024-09-10T11:50:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.115+0000 7f0c3ad5d740 1 -- start start 2024-09-10T11:50:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.116+0000 7f0c3ad5d740 1 Processor -- start 2024-09-10T11:50:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.116+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af7f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.116+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af7fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.116+0000 7f0c3ad5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1400f990 con 0x561e8af705d0 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1400f290 con 0x561e8af71b40 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c3ad5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1400c4a0 con 0x561e8af7b370 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40612/0 (socket says 172.21.15.17:40612) 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2287120972 learned_addr learned my addr 172.21.15.17:0/2287120972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c3ad5d740 10 client.0 _ll_register_callbacks cb 0x7f0c2c012720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c31d9b640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af7fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 msgr2=0x561e8af7fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af7fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2287120972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 msgr2=0x561e8af7f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af7f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 -- 172.21.15.17:0/2287120972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8aff4ef0 con 0x561e8af7b370 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.117+0000 7f0c32d9d640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c012660 tx=0x7f0c2c012540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8fa5e7cd6d761a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0041b0 con 0x561e8af7b370 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f0c2c027d60 con 0x561e8af7b370 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c280a4f20 con 0x561e8af7b370 2024-09-10T11:50:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0c2c041050 con 0x561e8af7b370 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c3ad5d740 10 client.25867 fetch_fsmap learned FSMap version 39 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.118+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561e8aff6120 con 0x561e8af7b370 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c280a4f20 con 0x561e8af7b370 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 39) ==== 8370+0+0 (secure 0 0 0) 0x7f0c2c0035f0 con 0x561e8af7b370 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 10 client.25867 fetch_fsmap finished waiting for FSMap version 39 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 10 client.25867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 20 client.25867 populate_metadata read hostname 'smithi017' 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8aff67a0 0x561e8aff8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 4 client.25867 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:50:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.119+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 --> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e8aeddd70 con 0x561e8aff67a0 2024-09-10T11:50:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.120+0000 7f0c3259c640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8aff67a0 0x561e8aff8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.122+0000 7f0c3259c640 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8aff67a0 0x561e8aff8c00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8842210fba0ad44a server_cookie=343bf2a4c67f4b93 in_seq=0 out_seq=0 2024-09-10T11:50:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.122+0000 7f0c19ffb640 10 client.25867 ms_handle_connect on v2:172.21.15.26:6838/1530868796 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c19ffb640 1 -- 172.21.15.17:0/2287120972 <== mds.1 v2:172.21.15.26:6838/1530868796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e8aeddd70 con 0x561e8aff67a0 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c19ffb640 10 client.25867 handle_command_reply: tid=0 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 client.25867 shutdown 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 msgr2=0x561e8aff4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c012660 tx=0x7f0c2c012540 comp rx=0 tx=0).stop 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 shutdown_connections 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:6838/1530868796,v1:172.21.15.26:6839/1530868796] conn(0x561e8aff67a0 0x561e8aff8c00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e8af7b370 0x561e8aff4900 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561e8af71b40 0x561e8af7fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 --2- 172.21.15.17:0/2287120972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8af705d0 0x561e8af7f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.126+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 >> 172.21.15.17:0/2287120972 conn(0x561e8af39310 msgr2=0x561e8af79870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.127+0000 7f0c19ffb640 0 client.25867 ms_handle_reset on v2:172.21.15.26:6838/1530868796 2024-09-10T11:50:03.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.128+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 shutdown_connections 2024-09-10T11:50:03.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.129+0000 7f0c3ad5d740 1 -- 172.21.15.17:0/2287120972 wait complete. 2024-09-10T11:50:03.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.129+0000 7f0c3ad5d740 20 client.25867 trim_cache size 0 max 16384 2024-09-10T11:50:03.131 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:50:03.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.130+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 msgr2=0x7f0c1c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.130+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 0x7f0c1c0a50c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c015000 tx=0x7f0c2c01d000 comp rx=0 tx=0).stop 2024-09-10T11:50:03.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.130+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 msgr2=0x7f0c3406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:03.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.130+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d770 tx=0x7f0c2800dc30 comp rx=0 tx=0).stop 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.130+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 shutdown_connections 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f0c1c0a2c00 0x7f0c1c0a50c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c34112b90 0x7f0c3406cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c34074eb0 0x7f0c3406ca90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 --2- 172.21.15.17:0/2275947449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34074590 0x7f0c34073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 >> 172.21.15.17:0/2275947449 conn(0x7f0c340fd8c0 msgr2=0x7f0c340ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 shutdown_connections 2024-09-10T11:50:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:03.131+0000 7f0c38984640 1 -- 172.21.15.17:0/2275947449 wait complete. 2024-09-10T11:50:03.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:03 smithi081 ceph-mon[35059]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 67 MiB/s wr, 13.66k op/s 2024-09-10T11:50:03.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:03 smithi026 ceph-mon[34817]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 67 MiB/s wr, 13.66k op/s 2024-09-10T11:50:03.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:03 smithi017 ceph-mon[30817]: pgmap v560: 97 pgs: 97 active+clean; 11 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 14 KiB/s rd, 67 MiB/s wr, 13.66k op/s 2024-09-10T11:50:03.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T11:50:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:04.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:04 smithi017 ceph-mon[30817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:04.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 -- 172.21.15.17:0/3514853124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168101e10 msgr2=0x7f71681021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 --2- 172.21.15.17:0/3514853124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168101e10 0x7f71681021f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7158009ca0 tx=0x7f715802a8c0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 -- 172.21.15.17:0/3514853124 shutdown_connections 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 --2- 172.21.15.17:0/3514853124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71681027c0 0x7f7168106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 --2- 172.21.15.17:0/3514853124 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7168106f40 0x7f716810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 --2- 172.21.15.17:0/3514853124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168101e10 0x7f71681021f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 -- 172.21.15.17:0/3514853124 >> 172.21.15.17:0/3514853124 conn(0x7f71680fd8d0 msgr2=0x7f71680ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 -- 172.21.15.17:0/3514853124 shutdown_connections 2024-09-10T11:50:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.685+0000 7f716dc36640 1 -- 172.21.15.17:0/3514853124 wait complete. 2024-09-10T11:50:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.686+0000 7f716dc36640 1 Processor -- start 2024-09-10T11:50:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.686+0000 7f716dc36640 1 -- start start 2024-09-10T11:50:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 0x7f716819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168106f40 0x7f716819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111fa0 con 0x7f7168106f40 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111e20 con 0x7f71681027c0 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f716dc36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7168112120 con 0x7f7168101e10 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40636/0 (socket says 172.21.15.17:40636) 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f7167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168106f40 0x7f716819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 -- 172.21.15.17:0/297542289 learned_addr learned my addr 172.21.15.17:0/297542289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f7166ffd640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 0x7f716819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 -- 172.21.15.17:0/297542289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 msgr2=0x7f716819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 0x7f716819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 -- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168106f40 msgr2=0x7f716819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168106f40 0x7f716819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f71677fe640 1 -- 172.21.15.17:0/297542289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716819f660 con 0x7f7168101e10 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.687+0000 7f7166ffd640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 0x7f716819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f71677fe640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f715802ade0 tx=0x7f71580319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f7164ff9640 1 -- 172.21.15.17:0/297542289 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715802fa20 con 0x7f7168101e10 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f7164ff9640 1 -- 172.21.15.17:0/297542289 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f715802fbc0 con 0x7f7168101e10 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f7164ff9640 1 -- 172.21.15.17:0/297542289 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715803a660 con 0x7f7168101e10 2024-09-10T11:50:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716819f8f0 con 0x7f7168101e10 2024-09-10T11:50:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.688+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681a7230 con 0x7f7168101e10 2024-09-10T11:50:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.690+0000 7f7164ff9640 1 -- 172.21.15.17:0/297542289 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f71580305c0 con 0x7f7168101e10 2024-09-10T11:50:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.690+0000 7f717000f740 1 Processor -- start 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 -- start start 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121e5d0 0x5572c121ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c122b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572c11842f0 con 0x5572c121fb40 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572c112bcf0 con 0x5572c121e5d0 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f717000f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572c11802b0 con 0x5572c1229370 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f7167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f71677fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121e5d0 0x5572c121ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f7167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54254/0 (socket says 172.21.15.17:54254) 2024-09-10T11:50:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f7166ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c122b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f7167fff640 1 -- 172.21.15.17:0/1858087842 learned_addr learned my addr 172.21.15.17:0/1858087842 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.691+0000 7f7164ff9640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 0x7f71540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 -- 172.21.15.17:0/1858087842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121e5d0 msgr2=0x5572c121ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121e5d0 0x5572c121ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 -- 172.21.15.17:0/1858087842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 msgr2=0x5572c121e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 -- 172.21.15.17:0/1858087842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c11103a0 con 0x5572c1229370 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7164ff9640 1 -- 172.21.15.17:0/297542289 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f71580f05d0 con 0x7f7168101e10 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7167fff640 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7167fff640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 0x7f71540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f7166ffd640 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c122b760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71680ffeb0 tx=0x7f715000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38009d8880ce753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f715dffb640 1 -- 172.21.15.17:0/1858087842 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150004030 con 0x5572c1229370 2024-09-10T11:50:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f715dffb640 1 -- 172.21.15.17:0/1858087842 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7150005500 con 0x5572c1229370 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.692+0000 7f715dffb640 1 -- 172.21.15.17:0/1858087842 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150004c50 con 0x5572c1229370 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f7167fff640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 0x7f71540a5040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f71600104f0 tx=0x7f71600046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 -- 172.21.15.17:0/1858087842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 msgr2=0x5572c122b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c122b760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f71680ffeb0 tx=0x7f715000f730 comp rx=0 tx=0).stop 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 -- 172.21.15.17:0/1858087842 shutdown_connections 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c122b760 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121e5d0 0x5572c121ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 --2- 172.21.15.17:0/1858087842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c121e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 -- 172.21.15.17:0/1858087842 >> 172.21.15.17:0/1858087842 conn(0x5572c11e7310 msgr2=0x5572c121ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 -- 172.21.15.17:0/1858087842 shutdown_connections 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.693+0000 7f717000f740 1 -- 172.21.15.17:0/1858087842 wait complete. 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 -- start start 2024-09-10T11:50:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 Processor -- start 2024-09-10T11:50:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1228d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 0x5572c1226570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572c122c070 con 0x5572c1229370 2024-09-10T11:50:04.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5572c113f060 con 0x5572c121fb40 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5572c122c1f0 con 0x5572c121e5d0 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f717000f740 10 client.0 _ll_register_callbacks cb 0x5572c0e928c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f7166ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f7167fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 0x5572c1226570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f71677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1228d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f7166ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34686/0 (socket says 172.21.15.17:34686) 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.694+0000 7f7166ffd640 1 -- 172.21.15.17:0/2549072023 learned_addr learned my addr 172.21.15.17:0/2549072023 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 -- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 msgr2=0x5572c1228d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1228d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 -- 172.21.15.17:0/2549072023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 msgr2=0x5572c1225fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 -- 172.21.15.17:0/2549072023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c0ef53c0 con 0x5572c1229370 2024-09-10T11:50:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7166ffd640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7167fff640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 0x5572c1226570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7160010d80 tx=0x7f7160004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447d8a998a37e9b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7146ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716000fe40 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f7160004050 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.695+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7150005500 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7160004250 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f717000f740 10 client.16227 fetch_fsmap learned FSMap version 40 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5572c1237b20 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7150005500 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 8378+0+0 (secure 0 0 0) 0x7f7160032480 con 0x5572c1229370 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f717000f740 10 client.16227 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T11:50:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f717000f740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.696+0000 7f717000f740 20 client.16227 populate_metadata read hostname 'smithi017' 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c1238f80 0x5572c123b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f717000f740 4 client.16227 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572c1191860 con 0x5572c1238f80 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f71677fe640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c1238f80 0x5572c123b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f7146ffd640 10 client.16227 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.697+0000 7f71677fe640 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c1238f80 0x5572c123b400 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad9557cf9951e1b server_cookie=4a074b2ea195d979 in_seq=0 out_seq=0 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f7146ffd640 1 -- 172.21.15.17:0/2549072023 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572c1191860 con 0x5572c1238f80 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f7146ffd640 10 client.16227 handle_command_reply: tid=0 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 client.16227 shutdown 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 msgr2=0x5572c1226570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 0x5572c1226570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7160010d80 tx=0x7f7160004730 comp rx=0 tx=0).stop 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 shutdown_connections 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c1238f80 0x5572c123b400 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c1229370 0x5572c1226570 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1225fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 --2- 172.21.15.17:0/2549072023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1228d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 >> 172.21.15.17:0/2549072023 conn(0x5572c11e7310 msgr2=0x5572c1220930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f7146ffd640 0 client.16227 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 shutdown_connections 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.698+0000 7f717000f740 1 -- 172.21.15.17:0/2549072023 wait complete. 2024-09-10T11:50:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.699+0000 7f717000f740 20 client.16227 trim_cache size 0 max 16384 2024-09-10T11:50:04.709 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:04 smithi081 ceph-mon[35059]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.719+0000 7f717000f740 1 Processor -- start 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.719+0000 7f717000f740 1 -- start start 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1235310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c121a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f71681af760 con 0x5572c121e5d0 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f71681b1330 con 0x5572c121fb40 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f717000f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71681afe60 con 0x5572c1229370 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f71677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f71677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54278/0 (socket says 172.21.15.17:54278) 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f71677fe640 1 -- 172.21.15.17:0/1273082015 learned_addr learned my addr 172.21.15.17:0/1273082015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c121a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7166ffd640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1235310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 -- 172.21.15.17:0/1273082015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 msgr2=0x5572c1235310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1235310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 -- 172.21.15.17:0/1273082015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 msgr2=0x5572c1215c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 -- 172.21.15.17:0/1273082015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c1229090 con 0x5572c1229370 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f71677fe640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f7167fff640 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c121a700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7160000c00 tx=0x7f7160005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac0d5bfa91fc911 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.720+0000 7f715d7fa640 1 -- 172.21.15.17:0/1273082015 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160009da0 con 0x5572c1229370 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f715d7fa640 1 -- 172.21.15.17:0/1273082015 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f716002e030 con 0x5572c1229370 2024-09-10T11:50:04.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f715d7fa640 1 -- 172.21.15.17:0/1273082015 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71600288f0 con 0x5572c1229370 2024-09-10T11:50:04.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 -- 172.21.15.17:0/1273082015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 msgr2=0x5572c121a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c121a700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7160000c00 tx=0x7f7160005f10 comp rx=0 tx=0).stop 2024-09-10T11:50:04.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 -- 172.21.15.17:0/1273082015 shutdown_connections 2024-09-10T11:50:04.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c1229370 0x5572c121a700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c121fb40 0x5572c1235310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 --2- 172.21.15.17:0/1273082015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121e5d0 0x5572c1215c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.721+0000 7f717000f740 1 -- 172.21.15.17:0/1273082015 >> 172.21.15.17:0/1273082015 conn(0x5572c11e7310 msgr2=0x5572c1225f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- 172.21.15.17:0/1273082015 shutdown_connections 2024-09-10T11:50:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- 172.21.15.17:0/1273082015 wait complete. 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- start start 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 Processor -- start 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c122d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 0x5572c122d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f71681b0c60 con 0x5572c121fb40 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f71681b0560 con 0x5572c1229370 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.722+0000 7f717000f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71681ad740 con 0x5572c121e5d0 2024-09-10T11:50:04.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40672/0 (socket says 172.21.15.17:40672) 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 -- 172.21.15.17:0/2727794220 learned_addr learned my addr 172.21.15.17:0/2727794220 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f717000f740 10 client.0 _ll_register_callbacks cb 0x7f7160009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7167fff640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 0x5572c122d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7166ffd640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c122d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 -- 172.21.15.17:0/2727794220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 msgr2=0x5572c122d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 0x5572c122d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 -- 172.21.15.17:0/2727794220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 msgr2=0x5572c122d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T11:50:04.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c122d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 -- 172.21.15.17:0/2727794220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c12ab4b0 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7167fff640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 0x5572c122d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f71677fe640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71580bcae0 tx=0x7f71580f3f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28a7a69e8ab9f251 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7146ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71580bc740 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f715802fd70 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f716002e030 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.723+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7158045ea0 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 10 client.25885 fetch_fsmap learned FSMap version 40 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5572c12ac670 con 0x5572c121e5d0 2024-09-10T11:50:04.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f716002e030 con 0x5572c121e5d0 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) ==== 8378+0+0 (secure 0 0 0) 0x7f71580b9450 con 0x5572c121e5d0 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 10 client.25885 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 10 client.25885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 20 client.25885 populate_metadata read hostname 'smithi017' 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c12acd40 0x5572c12af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 4 client.25885 mds_command: new command op to 24523 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 --> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572c118bd70 con 0x5572c12acd40 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.724+0000 7f7166ffd640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c12acd40 0x5572c12af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:04.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f7146ffd640 10 client.25885 ms_handle_connect on v2:172.21.15.81:6838/193630272 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f7166ffd640 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c12acd40 0x5572c12af130 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edad17bf47336024 server_cookie=e4e84e550b42b2b in_seq=0 out_seq=0 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f7146ffd640 1 -- 172.21.15.17:0/2727794220 <== mds.0 v2:172.21.15.81:6838/193630272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572c118bd70 con 0x5572c12acd40 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f7146ffd640 10 client.25885 handle_command_reply: tid=0 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 client.25885 shutdown 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 msgr2=0x5572c1231d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71580bcae0 tx=0x7f71580f3f90 comp rx=0 tx=0).stop 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 shutdown_connections 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:6838/193630272,v1:172.21.15.81:6839/193630272] conn(0x5572c12acd40 0x5572c12af130 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572c1229370 0x5572c122d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572c121fb40 0x5572c122d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 --2- 172.21.15.17:0/2727794220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5572c121e5d0 0x5572c1231d30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 >> 172.21.15.17:0/2727794220 conn(0x5572c11e7310 msgr2=0x5572c121a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f7146ffd640 0 client.25885 ms_handle_reset on v2:172.21.15.81:6838/193630272 2024-09-10T11:50:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 shutdown_connections 2024-09-10T11:50:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 1 -- 172.21.15.17:0/2727794220 wait complete. 2024-09-10T11:50:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.725+0000 7f717000f740 20 client.25885 trim_cache size 0 max 16384 2024-09-10T11:50:04.735 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T11:50:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 msgr2=0x7f71540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 0x7f71540a5040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f71600104f0 tx=0x7f71600046c0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 msgr2=0x7f716819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f715802ade0 tx=0x7f71580319f0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 shutdown_connections 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f71540a2b80 0x7f71540a5040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7168106f40 0x7f716819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71681027c0 0x7f716819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 --2- 172.21.15.17:0/297542289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7168101e10 0x7f716819a6b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 >> 172.21.15.17:0/297542289 conn(0x7f71680fd8d0 msgr2=0x7f71680fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 shutdown_connections 2024-09-10T11:50:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:04.726+0000 7f716dc36640 1 -- 172.21.15.17:0/297542289 wait complete. 2024-09-10T11:50:04.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:04 smithi026 ceph-mon[34817]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T11:50:05.524 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:05 smithi017 ceph-mon[30817]: pgmap v561: 97 pgs: 97 active+clean; 4.4 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 166 KiB/s rd, 59 MiB/s wr, 12.34k op/s 2024-09-10T11:50:05.582 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T11:50:05.583 INFO:tasks.fwd_scrub:done joining 2024-09-10T11:50:05.583 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T11:50:05.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:50:05.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:05 smithi081 ceph-mon[35059]: pgmap v561: 97 pgs: 97 active+clean; 4.4 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 166 KiB/s rd, 59 MiB/s wr, 12.34k op/s 2024-09-10T11:50:05.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/915891407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 msgr2=0x7fd4d41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/915891407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41031c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009860 tx=0x7fd4c402a340 comp rx=0 tx=0).stop 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/915891407 shutdown_connections 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/915891407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4103700 0x7fd4d4109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/915891407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41031c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/915891407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4101b50 0x7fd4d4101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/915891407 >> 172.21.15.17:0/915891407 conn(0x7fd4d40fd2b0 msgr2=0x7fd4d40ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/915891407 shutdown_connections 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/915891407 wait complete. 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.708+0000 7fd4dbb9f640 1 Processor -- start 2024-09-10T11:50:05.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 -- start start 2024-09-10T11:50:05.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 0x7fd4d419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d410d7b0 con 0x7fd4d4103700 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d410d630 con 0x7fd4d4102d40 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4dbb9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d410d930 con 0x7fd4d4101b50 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d993b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d993b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40682/0 (socket says 172.21.15.17:40682) 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d993b640 1 -- 172.21.15.17:0/222098773 learned_addr learned my addr 172.21.15.17:0/222098773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4da13c640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 0x7fd4d419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 -- 172.21.15.17:0/222098773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 msgr2=0x7fd4d4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 -- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 msgr2=0x7fd4d419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 0x7fd4d419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d913a640 1 -- 172.21.15.17:0/222098773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d419fa80 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4da13c640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 0x7fd4d419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.709+0000 7fd4d993b640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4d913a640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41983a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4035040 tx=0x7fd4c4033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4037040 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4c4004040 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d419fd10 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40055c0 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.710+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d41a01b0 con 0x7fd4d4102d40 2024-09-10T11:50:05.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.711+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d4108f80 con 0x7fd4d4102d40 2024-09-10T11:50:05.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.712+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd4c406bd10 con 0x7fd4d4102d40 2024-09-10T11:50:05.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.713+0000 7fd4caffd640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 0x7fd4c00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:05.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.713+0000 7fd4d993b640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 0x7fd4c00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:05.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.713+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd4c40eeb90 con 0x7fd4d4102d40 2024-09-10T11:50:05.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.714+0000 7fd4d993b640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 0x7fd4c00a5050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00096c0 tx=0x7fd4d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:05.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.720+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4c4049020 con 0x7fd4d4102d40 2024-09-10T11:50:05.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:05 smithi026 ceph-mon[34817]: pgmap v561: 97 pgs: 97 active+clean; 4.4 GiB data, 64 GiB used, 1009 GiB / 1.0 TiB avail; 166 KiB/s rd, 59 MiB/s wr, 12.34k op/s 2024-09-10T11:50:05.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.902+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4d402d940 con 0x7fd4d4102d40 2024-09-10T11:50:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.905+0000 7fd4caffd640 1 -- 172.21.15.17:0/222098773 <== mon.2 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7fd4c40bbaa0 con 0x7fd4d4102d40 2024-09-10T11:50:05.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:50:05.906 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:50:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 msgr2=0x7fd4c00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 0x7fd4c00a5050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00096c0 tx=0x7fd4d0009260 comp rx=0 tx=0).stop 2024-09-10T11:50:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 msgr2=0x7fd4d41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41983a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4035040 tx=0x7fd4c4033d90 comp rx=0 tx=0).stop 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 shutdown_connections 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd4c00a2b90 0x7fd4c00a5050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d4103700 0x7fd4d419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4d4102d40 0x7fd4d41983a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 --2- 172.21.15.17:0/222098773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d4101b50 0x7fd4d4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:05.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 >> 172.21.15.17:0/222098773 conn(0x7fd4d40fd2b0 msgr2=0x7fd4d4106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:05.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 shutdown_connections 2024-09-10T11:50:05.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:05.907+0000 7fd4dbb9f640 1 -- 172.21.15.17:0/222098773 wait complete. 2024-09-10T11:50:05.921 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T11:36:09.827861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T11:40:36.301628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T11:40:38.460005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T11:50:05.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T11:50:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 -- 172.21.15.17:0/2290416879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 msgr2=0x7f2c541007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/2290416879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c541007f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009900 tx=0x7f2c4402a410 comp rx=0 tx=0).stop 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 -- 172.21.15.17:0/2290416879 shutdown_connections 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/2290416879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c54101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/2290416879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c54101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/2290416879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c541007f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 -- 172.21.15.17:0/2290416879 >> 172.21.15.17:0/2290416879 conn(0x7f2c540fc1a0 msgr2=0x7f2c540fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 -- 172.21.15.17:0/2290416879 shutdown_connections 2024-09-10T11:50:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.035+0000 7f2c58e8b640 1 -- 172.21.15.17:0/2290416879 wait complete. 2024-09-10T11:50:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 Processor -- start 2024-09-10T11:50:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 -- start start 2024-09-10T11:50:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c5419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c541a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5410f930 con 0x7f2c541003f0 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5410f7b0 con 0x7f2c54100d30 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c58e8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5410fab0 con 0x7f2c541016d0 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54336/0 (socket says 172.21.15.17:54336) 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 -- 172.21.15.17:0/4188514904 learned_addr learned my addr 172.21.15.17:0/4188514904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c51d9b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c5419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c52d9d640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c541a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 -- 172.21.15.17:0/4188514904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 msgr2=0x7f2c541a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c541a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 -- 172.21.15.17:0/4188514904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 msgr2=0x7f2c5419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.036+0000 7f2c5259c640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c5419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c5259c640 1 -- 172.21.15.17:0/4188514904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c541a1c10 con 0x7f2c541003f0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c51d9b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c5419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c52d9d640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c541a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c5259c640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009230 tx=0x7f2c440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4403f030 con 0x7f2c541003f0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c541a1ea0 con 0x7f2c541003f0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c44003ce0 con 0x7f2c541003f0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c44035070 con 0x7f2c541003f0 2024-09-10T11:50:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.037+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c541a2300 con 0x7f2c541003f0 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.038+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5410b2f0 con 0x7f2c541003f0 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.040+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2c44042030 con 0x7f2c541003f0 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.040+0000 7f2c437fe640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 0x7f2c3c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.040+0000 7f2c51d9b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 0x7f2c3c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.040+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2c440ef4c0 con 0x7f2c541003f0 2024-09-10T11:50:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.041+0000 7f2c51d9b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 0x7f2c3c0a5050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c480095f0 tx=0x7f2c48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.048+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c440bbde0 con 0x7f2c541003f0 2024-09-10T11:50:06.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.317+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c54062ec0 con 0x7f2c541003f0 2024-09-10T11:50:06.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.318+0000 7f2c437fe640 1 -- 172.21.15.17:0/4188514904 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f2c440c00e0 con 0x7f2c541003f0 2024-09-10T11:50:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T11:50:06.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 msgr2=0x7f2c3c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 0x7f2c3c0a5050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c480095f0 tx=0x7f2c48005f90 comp rx=0 tx=0).stop 2024-09-10T11:50:06.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 msgr2=0x7f2c54199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009230 tx=0x7f2c440042f0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 shutdown_connections 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2c3c0a2b90 0x7f2c3c0a5050 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c541016d0 0x7f2c541a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c54100d30 0x7f2c5419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 --2- 172.21.15.17:0/4188514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c541003f0 0x7f2c54199ff0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 >> 172.21.15.17:0/4188514904 conn(0x7f2c540fc1a0 msgr2=0x7f2c540fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 shutdown_connections 2024-09-10T11:50:06.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.320+0000 7f2c58e8b640 1 -- 172.21.15.17:0/4188514904 wait complete. 2024-09-10T11:50:06.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T11:50:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 -- 172.21.15.17:0/836161956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 msgr2=0x7f1cb4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 --2- 172.21.15.17:0/836161956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb4100e30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009900 tx=0x7f1ca402a410 comp rx=0 tx=0).stop 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 -- 172.21.15.17:0/836161956 shutdown_connections 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 --2- 172.21.15.17:0/836161956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb41025e0 0x7f1cb4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 --2- 172.21.15.17:0/836161956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb4101c20 0x7f1cb41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 --2- 172.21.15.17:0/836161956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb4100e30 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 -- 172.21.15.17:0/836161956 >> 172.21.15.17:0/836161956 conn(0x7f1cb40fc190 msgr2=0x7f1cb40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 -- 172.21.15.17:0/836161956 shutdown_connections 2024-09-10T11:50:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.450+0000 7f1cba1af640 1 -- 172.21.15.17:0/836161956 wait complete. 2024-09-10T11:50:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 Processor -- start 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 -- start start 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb4101c20 0x7f1cb419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb41025e0 0x7f1cb419f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c690 con 0x7f1cb4100a30 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c510 con 0x7f1cb41025e0 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cba1af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c810 con 0x7f1cb4101c20 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cb37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cb37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54360/0 (socket says 172.21.15.17:54360) 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cb37fe640 1 -- 172.21.15.17:0/3419083213 learned_addr learned my addr 172.21.15.17:0/3419083213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cb2ffd640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb4101c20 0x7f1cb419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.451+0000 7f1cb3fff640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb41025e0 0x7f1cb419f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 -- 172.21.15.17:0/3419083213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb4101c20 msgr2=0x7f1cb419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb4101c20 0x7f1cb419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 -- 172.21.15.17:0/3419083213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb41025e0 msgr2=0x7f1cb419f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb41025e0 0x7f1cb419f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 -- 172.21.15.17:0/3419083213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb419fb00 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb37fe640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4031610 tx=0x7f1ca4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca403f030 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb419fd30 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca4003ad0 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4035070 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.452+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb41a01c0 con 0x7f1cb4100a30 2024-09-10T11:50:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.454+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4107e70 con 0x7f1cb4100a30 2024-09-10T11:50:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.455+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1ca4042030 con 0x7f1cb4100a30 2024-09-10T11:50:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.456+0000 7f1cb0ff9640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 0x7f1c9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.456+0000 7f1cb2ffd640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 0x7f1c9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.456+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f1ca40ef560 con 0x7f1cb4100a30 2024-09-10T11:50:06.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.457+0000 7f1cb2ffd640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 0x7f1c9c0a50d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4069dd0 tx=0x7f1ca8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.460+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ca40bbe80 con 0x7f1cb4100a30 2024-09-10T11:50:06.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:06 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/222098773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:06.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:06 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4188514904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:50:06.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.713+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1cb4062ec0 con 0x7f1cb4100a30 2024-09-10T11:50:06.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.714+0000 7f1cb0ff9640 1 -- 172.21.15.17:0/3419083213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f1ca40c0180 con 0x7f1cb4100a30 2024-09-10T11:50:06.715 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 msgr2=0x7f1c9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 0x7f1c9c0a50d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4069dd0 tx=0x7f1ca8005f90 comp rx=0 tx=0).stop 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 msgr2=0x7f1cb406a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4031610 tx=0x7f1ca4004270 comp rx=0 tx=0).stop 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 shutdown_connections 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f1c9c0a2c10 0x7f1c9c0a50d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb4101c20 0x7f1cb419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb41025e0 0x7f1cb419f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 --2- 172.21.15.17:0/3419083213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb4100a30 0x7f1cb406a060 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.716+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 >> 172.21.15.17:0/3419083213 conn(0x7f1cb40fc190 msgr2=0x7f1cb4105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.717+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 shutdown_connections 2024-09-10T11:50:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.717+0000 7f1cba1af640 1 -- 172.21.15.17:0/3419083213 wait complete. 2024-09-10T11:50:06.727 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:06 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/222098773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:06.728 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:06 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4188514904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:50:06.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T11:50:06.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:06 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/222098773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:06.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:06 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4188514904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T11:50:06.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- 172.21.15.17:0/212987625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 msgr2=0x7fdddc1053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 --2- 172.21.15.17:0/212987625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc1053c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009900 tx=0x7fddc402a410 comp rx=0 tx=0).stop 2024-09-10T11:50:06.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- 172.21.15.17:0/212987625 shutdown_connections 2024-09-10T11:50:06.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 --2- 172.21.15.17:0/212987625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc105900 0x7fdddc10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 --2- 172.21.15.17:0/212987625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc1053c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 --2- 172.21.15.17:0/212987625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc103d50 0x7fdddc104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- 172.21.15.17:0/212987625 >> 172.21.15.17:0/212987625 conn(0x7fdddc0ff4b0 msgr2=0x7fdddc1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- 172.21.15.17:0/212987625 shutdown_connections 2024-09-10T11:50:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- 172.21.15.17:0/212987625 wait complete. 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 Processor -- start 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.847+0000 7fdde1b42640 1 -- start start 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc105900 0x7fdddc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc10f9b0 con 0x7fdddc104f40 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc10f830 con 0x7fdddc105900 2024-09-10T11:50:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdde1b42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc10fb30 con 0x7fdddc103d50 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fddd3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:40722/0 (socket says 172.21.15.17:40722) 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fddd3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54382/0 (socket says 172.21.15.17:54382) 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 -- 172.21.15.17:0/3239896984 learned_addr learned my addr 172.21.15.17:0/3239896984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddbfff640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc105900 0x7fdddc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 -- 172.21.15.17:0/3239896984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc105900 msgr2=0x7fdddc1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc105900 0x7fdddc1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 -- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 msgr2=0x7fdddc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 -- 172.21.15.17:0/3239896984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc1a1c80 con 0x7fdddc103d50 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fddd3fff640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.848+0000 7fdddb7fe640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e9c0 tx=0x7fddcc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.849+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00cd80 con 0x7fdddc103d50 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.849+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdddc1a1f70 con 0x7fdddc103d50 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.849+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddcc0035f0 con 0x7fdddc103d50 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.849+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc010690 con 0x7fdddc103d50 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.849+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdddc1a23e0 con 0x7fdddc103d50 2024-09-10T11:50:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.850+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdddc10b190 con 0x7fdddc103d50 2024-09-10T11:50:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.851+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fddcc0037a0 con 0x7fdddc103d50 2024-09-10T11:50:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.852+0000 7fddd97fa640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 0x7fddc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.852+0000 7fddd3fff640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 0x7fddc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.852+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fddcc0cf450 con 0x7fdddc103d50 2024-09-10T11:50:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.852+0000 7fddd3fff640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 0x7fddc80a50d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fddc40314e0 tx=0x7fddc4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:06.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:06.855+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddcc09c3f0 con 0x7fdddc103d50 2024-09-10T11:50:07.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.081+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdddc02da70 con 0x7fdddc103d50 2024-09-10T11:50:07.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.082+0000 7fddd97fa640 1 -- 172.21.15.17:0/3239896984 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7fddcc09bcf0 con 0x7fdddc103d50 2024-09-10T11:50:07.083 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-10T11:50:07.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 msgr2=0x7fddc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:07.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 0x7fddc80a50d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fddc40314e0 tx=0x7fddc4000bc0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 msgr2=0x7fdddc19a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:07.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e9c0 tx=0x7fddcc00ee80 comp rx=0 tx=0).stop 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 shutdown_connections 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fddc80a2c10 0x7fddc80a50d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdddc105900 0x7fdddc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdddc104f40 0x7fdddc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 --2- 172.21.15.17:0/3239896984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdddc103d50 0x7fdddc19a060 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 >> 172.21.15.17:0/3239896984 conn(0x7fdddc0ff4b0 msgr2=0x7fdddc108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 shutdown_connections 2024-09-10T11:50:07.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.085+0000 7fdde1b42640 1 -- 172.21.15.17:0/3239896984 wait complete. 2024-09-10T11:50:07.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T11:50:07.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 -- 172.21.15.17:0/2424867964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 msgr2=0x7fcd301011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/2424867964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd301011c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009860 tx=0x7fcd2002a340 comp rx=0 tx=0).stop 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 -- 172.21.15.17:0/2424867964 shutdown_connections 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/2424867964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd301011c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/2424867964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30101700 0x7fcd30101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/2424867964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30100420 0x7fcd30100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 -- 172.21.15.17:0/2424867964 >> 172.21.15.17:0/2424867964 conn(0x7fcd300fc1f0 msgr2=0x7fcd300fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 -- 172.21.15.17:0/2424867964 shutdown_connections 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.206+0000 7fcd37fe4640 1 -- 172.21.15.17:0/2424867964 wait complete. 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 Processor -- start 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 -- start start 2024-09-10T11:50:07.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd3019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 0x7fcd301a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010f960 con 0x7fcd30101700 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010f7e0 con 0x7fcd30100420 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd37fe4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010fae0 con 0x7fcd30100d60 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd35d80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd35d80640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34782/0 (socket says 172.21.15.17:34782) 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd35d80640 1 -- 172.21.15.17:0/4143348461 learned_addr learned my addr 172.21.15.17:0/4143348461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd36581640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 0x7fcd301a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd3557f640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd3019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.207+0000 7fcd35d80640 1 -- 172.21.15.17:0/4143348461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 msgr2=0x7fcd3019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd35d80640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd3019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd35d80640 1 -- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 msgr2=0x7fcd301a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd35d80640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 0x7fcd301a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd35d80640 1 -- 172.21.15.17:0/4143348461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd301a1c70 con 0x7fcd30100420 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd36581640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 0x7fcd301a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd3557f640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd3019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd35d80640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00e9c0 tx=0x7fcd2c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00cde0 con 0x7fcd30100420 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd301a1f60 con 0x7fcd30100420 2024-09-10T11:50:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2c0035f0 con 0x7fcd30100420 2024-09-10T11:50:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c010650 con 0x7fcd30100420 2024-09-10T11:50:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.208+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301a23c0 con 0x7fcd30100420 2024-09-10T11:50:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.209+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3010b170 con 0x7fcd30100420 2024-09-10T11:50:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.211+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd2c0037a0 con 0x7fcd30100420 2024-09-10T11:50:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.212+0000 7fcd26ffd640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 0x7fcd1c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:07.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.212+0000 7fcd3557f640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 0x7fcd1c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.212+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fcd2c0cf3d0 con 0x7fcd30100420 2024-09-10T11:50:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.213+0000 7fcd3557f640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 0x7fcd1c0a5050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcd2002a930 tx=0x7fcd20030570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:07.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.218+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd2c09c3d0 con 0x7fcd30100420 2024-09-10T11:50:07.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.517+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fcd3002da50 con 0x7fcd30100420 2024-09-10T11:50:07.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.526+0000 7fcd26ffd640 1 -- 172.21.15.17:0/4143348461 <== mon.2 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740370 (secure 0 0 0) 0x7fcd2c09bcd0 con 0x7fcd30100420 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 18, 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 14150, 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-10T11:50:07.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3008774641 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3008774641 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.539 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/3008774641", 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2024-09-10T11:33:53.328345+0000", 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24109, 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.540 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.542 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.545 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-10T11:50:07.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-10T11:50:07.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-10T11:50:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-10T11:50:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.552 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.554 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-10T11:50:07.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-10T11:50:07.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.561 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-10T11:50:07.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-10T11:50:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:07.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.570 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-10T11:50:07.573 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:50:07.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-10T11:50:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:50:07.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:50:07.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-10T11:50:07.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-10T11:50:07.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:50:07.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-10T11:50:07.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:50:07.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.611 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.614 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:07.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.621 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.635 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-10T11:50:07.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-10T11:50:07.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-10T11:50:07.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:50:07.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-10T11:50:07.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-10T11:50:07.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.652 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.654 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:50:07.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:50:07.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:50:07.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-10T11:50:07.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:50:07.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:50:07.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:50:07.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.693 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-10T11:50:07.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-10T11:50:07.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:07.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.708 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.709 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-10T11:50:07.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:07.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-10T11:50:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:07.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:07.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-10T11:50:07.738 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.739 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.741 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.742 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-10T11:50:07.747 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:50:07.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-10T11:50:07.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.755 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-10T11:50:07.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.758 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.759 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.765 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.768 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.769 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.771 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.772 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.777 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.778 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.780 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.781 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.783 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-10T11:50:07.785 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:50:07.786 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.787 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.790 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-10T11:50:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-10T11:50:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.801 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.804 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.807 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.816 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.818 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.823 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.825 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.831 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.834 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-10T11:50:07.836 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.844 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.847 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.850 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-10T11:50:07.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:07.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-10T11:50:07.854 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:50:07.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.857 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.860 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-10T11:50:07.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.868 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.872 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:07.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.883 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.885 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.886 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:07.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.889 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.894 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.898 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-10T11:50:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-10T11:50:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-10T11:50:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:50:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-10T11:50:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-10T11:50:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:50:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:50:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-10T11:50:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24113, 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-10T11:50:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-10T11:50:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-10T11:50:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-10T11:50:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-10T11:50:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.030 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:50:08.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:50:08.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:08.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:50:08.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.039 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.040 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.045 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:50:08.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-10T11:50:08.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:50:08.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:50:08.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:50:08.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.065 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:50:08.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-10T11:50:08.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:50:08.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-10T11:50:08.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:50:08.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:50:08.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.082 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:50:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-10T11:50:08.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-10T11:50:08.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:50:08.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-10T11:50:08.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.099 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.103 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.106 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-10T11:50:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.115 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:50:08.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-10T11:50:08.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:50:08.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.141 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.154 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.158 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.161 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:50:08.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:50:08.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.173 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:50:08.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.181 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.184 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:50:08.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:50:08.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-10T11:50:08.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:50:08.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.205 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.207 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.208 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.209 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-10T11:50:08.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:08.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:08.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.223 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.225 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.226 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.228 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.229 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.230 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:08.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-10T11:50:08.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.247 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.249 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-10T11:50:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-10T11:50:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.256 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-10T11:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-10T11:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-10T11:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.277 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.278 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:50:08.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.287 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.290 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:50:08.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.292 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.293 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.294 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.295 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-10T11:50:08.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.299 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.303 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.304 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.307 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.309 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.313 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.317 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.318 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.321 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-10T11:50:08.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.326 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-10T11:50:08.331 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.332 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.333 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.336 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.339 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.344 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.345 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.346 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.348 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.349 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-10T11:50:08.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-10T11:50:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-10T11:50:08.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:50:08.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.357 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.358 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.360 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.365 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.371 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.375 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:08.377 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-10T11:50:08.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:08.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.384 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.385 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.390 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-10T11:50:08.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-10T11:50:08.407 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.411 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.418 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.422 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.423 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.427 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.437 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.443 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.450 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.457 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.463 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-10T11:50:08.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.467 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.469 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.472 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-10T11:50:08.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.479 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.482 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:08.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.485 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.499 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.500 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.502 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.503 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.509 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:50:08.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:50:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.520 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-10T11:50:08.528 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "restful" 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.530 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.531 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-09-10T11:50:08.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.544 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:08.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-10T11:50:08.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-10T11:50:08.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-10T11:50:08.560 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-10T11:50:08.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T11:50:08.575 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-10T11:50:08.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-10T11:50:08.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.584 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.591 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T11:50:08.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T11:50:08.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-10T11:50:08.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.599 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T11:50:08.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.604 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-10T11:50:08.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.606 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.607 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-10T11:50:08.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-10T11:50:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-10T11:50:08.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-10T11:50:08.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-10T11:50:08.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.631 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.636 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.639 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-10T11:50:08.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T11:50:08.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T11:50:08.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.650 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.651 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.662 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.666 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T11:50:08.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.672 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-10T11:50:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T11:50:08.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.689 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.690 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.696 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.699 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:08.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.706 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.707 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-10T11:50:08.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.716 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-10T11:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T11:50:08.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.726 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.727 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.730 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-10T11:50:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.741 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-10T11:50:08.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-10T11:50:08.752 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.756 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.759 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.762 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.764 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.769 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.770 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.772 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-10T11:50:08.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.776 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.777 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-10T11:50:08.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.781 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.786 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.797 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.798 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.801 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.806 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.811 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-10T11:50:08.812 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.813 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.816 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.818 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.819 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.822 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.825 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.828 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T11:50:08.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-10T11:50:08.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.836 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.839 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-10T11:50:08.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-10T11:50:08.843 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.849 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-10T11:50:08.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T11:50:08.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.853 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.854 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-10T11:50:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-10T11:50:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.862 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.864 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-10T11:50:08.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-10T11:50:08.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.868 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.873 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.876 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-10T11:50:08.880 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.882 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.884 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.887 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.889 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.890 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-10T11:50:08.893 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.894 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.896 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.897 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-10T11:50:08.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-10T11:50:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.904 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-10T11:50:08.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.915 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.920 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.921 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.923 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.928 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-10T11:50:08.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-10T11:50:08.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-10T11:50:08.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.952 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.953 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.954 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.956 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.964 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-10T11:50:08.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-10T11:50:08.980 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.984 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-10T11:50:08.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T11:50:08.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2024-09-10T11:50:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-10T11:50:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "squid": [ 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-10T11:50:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 3, 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3851758063 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 738548507 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-10T11:50:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3487151896 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3148704408 2024-09-10T11:50:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T11:50:09.003 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:50:09.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:07 smithi026 ceph-mon[34817]: pgmap v562: 97 pgs: 97 active+clean; 3.7 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 5.58k op/s 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:07 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3419083213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:07 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3239896984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:08 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/4143348461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:07 smithi081 ceph-mon[35059]: pgmap v562: 97 pgs: 97 active+clean; 3.7 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 5.58k op/s 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:07 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3419083213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:07 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3239896984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.005 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:08 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/4143348461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 msgr2=0x7fcd1c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 0x7fcd1c0a5050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcd2002a930 tx=0x7fcd20030570 comp rx=0 tx=0).stop 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 msgr2=0x7fcd3019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00e9c0 tx=0x7fcd2c00ee80 comp rx=0 tx=0).stop 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 shutdown_connections 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fcd1c0a2b90 0x7fcd1c0a5050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd30100d60 0x7fcd3019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd30101700 0x7fcd301a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 --2- 172.21.15.17:0/4143348461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd30100420 0x7fcd3019a050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 >> 172.21.15.17:0/4143348461 conn(0x7fcd300fc1f0 msgr2=0x7fcd300fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 shutdown_connections 2024-09-10T11:50:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:07.534+0000 7fcd37fe4640 1 -- 172.21.15.17:0/4143348461 wait complete. 2024-09-10T11:50:09.068 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T11:50:09.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T11:50:09.068 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:07 smithi017 ceph-mon[30817]: pgmap v562: 97 pgs: 97 active+clean; 3.7 GiB data, 63 GiB used, 1009 GiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 5.58k op/s 2024-09-10T11:50:09.069 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:07 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3419083213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.069 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:07 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3239896984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T11:50:09.069 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:08 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/4143348461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T11:50:09.336 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:09.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:09 smithi081 ceph-mon[35059]: pgmap v563: 97 pgs: 97 active+clean; 337 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 174 KiB/s rd, 24 MiB/s wr, 5.41k op/s 2024-09-10T11:50:09.754 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:09 smithi017 ceph-mon[30817]: pgmap v563: 97 pgs: 97 active+clean; 337 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 174 KiB/s rd, 24 MiB/s wr, 5.41k op/s 2024-09-10T11:50:09.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:09 smithi026 ceph-mon[34817]: pgmap v563: 97 pgs: 97 active+clean; 337 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 174 KiB/s rd, 24 MiB/s wr, 5.41k op/s 2024-09-10T11:50:09.874 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:50:09.874 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:09.874 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 717, 2024-09-10T11:50:09.874 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 699, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 747568, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 267338, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.084118202, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.026622758, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.034853542, 2024-09-10T11:50:09.875 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.021384655, 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 699, 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.097935105, 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000140107 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:09.876 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 569152, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 98480 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 397, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 516, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 4294468, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 415868, 2024-09-10T11:50:09.877 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.052650308, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.016431568, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.016233476, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.013942277, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 514, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.058039601, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000112917 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.878 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 289872 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 601, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 603, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 5192648, 2024-09-10T11:50:09.879 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 191119, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.058088545, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.015505747, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.020732321, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.017119694, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 601, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.033487616, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000055719 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.880 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.881 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2665, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.075072882, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000028169 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:09.883 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 39, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 39, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 39, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 0, 2024-09-10T11:50:09.884 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 1, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T11:50:09.885 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:09.886 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:09.887 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:09.888 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T11:50:09.889 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T11:50:09.890 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 7730, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 10, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 13426553, 2024-09-10T11:50:09.891 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 13424902, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 7730 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 4, 2024-09-10T11:50:09.892 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 52, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 48, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 2, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 14, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 12, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 39, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 87, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 48, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 0, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 0, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 0, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 51208, 2024-09-10T11:50:09.893 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 215328 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.894 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.895 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.896 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.897 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T11:50:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T11:50:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.900 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.900 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.900 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T11:50:09.900 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.901 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.903 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:09.904 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.908 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T11:50:09.909 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.909 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.909 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T11:50:09.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.911 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-10T11:50:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 1527, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:09.916 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 198247, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 56, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 154, 2024-09-10T11:50:09.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 39496, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 183, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.918 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 1528, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 21, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 3, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 1528, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1528, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 28.352711778, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.018555439 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T11:50:09.919 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1528, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1529 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 1528, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 1528, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 884, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 642, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T11:50:09.920 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 0, 2024-09-10T11:50:09.921 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T11:50:09.922 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T11:50:09.923 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 86, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 2, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 6, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 6, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 0, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 2, 2024-09-10T11:50:09.924 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 0 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 0, 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T11:50:09.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:09.926 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1711, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 10068418, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1711, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1711, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 10068418, 2024-09-10T11:50:09.927 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:09.928 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1528, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 9232254, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1528, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 9232254, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1528, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 1528, 2024-09-10T11:50:09.930 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1528, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1528, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T11:50:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55c626c206e0": { 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:09.934 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:50:10.560 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T11:50:10.561 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T11:50:10.561 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-10T11:50:10.561 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T11:50:10.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T11:50:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:11.441 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:50:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-10T11:50:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-10T11:50:11.441 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001386638, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000243812, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:11.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 167, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 164, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 463408, 2024-09-10T11:50:11.443 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 100048, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.025524377, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.010671662, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.018921930, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 163, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.016574321, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000101682 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.444 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 463408, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 100048 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 5, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 126, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3152, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 100752, 2024-09-10T11:50:11.445 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.011378962, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.006977376, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003305715, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 125, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.008821399, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000070571 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:11.446 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 100752 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:11.447 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:11.448 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:11.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149007, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T11:50:11.450 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T11:50:11.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 168, 2024-09-10T11:50:11.452 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 439827, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 168, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 168, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 439827, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:11.453 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:50:11.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:11 smithi081 ceph-mon[35059]: pgmap v564: 97 pgs: 97 active+clean; 57 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 167 KiB/s rd, 603 KiB/s wr, 409 op/s 2024-09-10T11:50:11.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:11 smithi026 ceph-mon[34817]: pgmap v564: 97 pgs: 97 active+clean; 57 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 167 KiB/s rd, 603 KiB/s wr, 409 op/s 2024-09-10T11:50:11.764 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:11 smithi017 ceph-mon[30817]: pgmap v564: 97 pgs: 97 active+clean; 57 MiB data, 61 GiB used, 1011 GiB / 1.0 TiB avail; 167 KiB/s rd, 603 KiB/s wr, 409 op/s 2024-09-10T11:50:12.135 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T11:50:12.136 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T11:50:12.136 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-10T11:50:12.136 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T11:50:12.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T11:50:12.393 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:12.908 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 687, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 671, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 735712, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 259266, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.080929641, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.031049641, 2024-09-10T11:50:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.032624843, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.016715725, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 670, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.068062740, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000101586 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 566704, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 99312 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1019, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1137, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 5547330, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 613005, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.095459420, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.024078144, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.034344248, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.030972656, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1136, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.044546601, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000039213 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 290496 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-09-10T11:50:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 6, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1629, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 1284, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001423260, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000061212, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001149265, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000089166, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002336034, 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000584008 2024-09-10T11:50:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2592, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.066899246, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000025809 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 0, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 0, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 26, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 26, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 26, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T11:50:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 1, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2024-09-10T11:50:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T11:50:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T11:50:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 4445, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 6, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T11:50:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 9480274, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 9477982, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 4445 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 4, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 39, 2024-09-10T11:50:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 35, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 2, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 14, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 12, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 26, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 61, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 35, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 0, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 0, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 0, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 53536, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 215328 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 0, 2024-09-10T11:50:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T11:50:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T11:50:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.936 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:12.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.938 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.940 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.941 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 2, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 1, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T11:50:12.942 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 1534, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:12.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:12.944 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:12.945 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 197520, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 56, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 154, 2024-09-10T11:50:12.946 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 30352, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 132, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T11:50:12.947 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 1521, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 21, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 3, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 1521, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1521, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 76.343217277, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.050192779 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1521, 2024-09-10T11:50:12.948 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1522 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 1521, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 1521, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 914, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 605, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T11:50:12.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T11:50:12.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T11:50:12.951 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 86, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 2, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 6, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 6, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T11:50:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 0, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 2, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 0 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 0, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1706, 2024-09-10T11:50:12.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 6118751, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1706, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1706, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 6118751, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:12.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1521, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 5286563, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1521, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 5286563, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.956 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1521, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 1521, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1521, 2024-09-10T11:50:12.957 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1521, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:12.958 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x556d7efba6e0": { 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:12.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:12.960 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:50:13.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:13 smithi081 ceph-mon[35059]: pgmap v565: 97 pgs: 97 active+clean; 57 MiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 342 op/s 2024-09-10T11:50:13.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:13 smithi026 ceph-mon[34817]: pgmap v565: 97 pgs: 97 active+clean; 57 MiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 342 op/s 2024-09-10T11:50:13.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:13 smithi017 ceph-mon[30817]: pgmap v565: 97 pgs: 97 active+clean; 57 MiB data, 57 GiB used, 1016 GiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 342 op/s 2024-09-10T11:50:13.805 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T11:50:13.805 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T11:50:13.805 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-10T11:50:13.806 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T11:50:13.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T11:50:14.062 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:14.602 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T11:50:14.602 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:14.602 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001270571, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000289858, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:14.603 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:14.604 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 5, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 128, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3152, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 101104, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.013526999, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.009159419, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003425035, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 127, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.014452882, 2024-09-10T11:50:14.605 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000113802 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 101104 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 169, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 166, 2024-09-10T11:50:14.606 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 463952, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 101328, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.025120138, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.010427102, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.018620661, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 165, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.012426348, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000075311 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:14.607 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 463952, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 101328 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:14.608 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:14.609 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:14.610 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148967, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 29, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T11:50:14.611 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:14.612 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 170, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 440087, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 170, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T11:50:14.613 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 170, 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 440087, 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T11:50:14.614 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T11:50:15.205 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T11:50:15.205 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T11:50:15.205 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-10T11:50:15.205 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T11:50:15.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T11:50:15.460 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:50:15.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:15 smithi026 ceph-mon[34817]: pgmap v566: 97 pgs: 97 active+clean; 57 MiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 318 op/s 2024-09-10T11:50:15.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:15 smithi017 ceph-mon[30817]: pgmap v566: 97 pgs: 97 active+clean; 57 MiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 318 op/s 2024-09-10T11:50:15.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:15 smithi081 ceph-mon[35059]: pgmap v566: 97 pgs: 97 active+clean; 57 MiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 303 KiB/s wr, 318 op/s 2024-09-10T11:50:16.004 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 2985, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 2509, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 1319008, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 8737006, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 11, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.225537067, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.079008005, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.123755382, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.036110059, 2024-09-10T11:50:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2508, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.159588581, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000063631 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 3960, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000810728, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000204 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.006 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 7425, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 7991, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 3123630, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 3019690, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 14, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 5, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.566642162, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.177487501, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.515334823, 2024-09-10T11:50:16.007 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.010638912, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 7990, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 3.350230650, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000419302 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 11732, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.002684444, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000228 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 595856, 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 108304 2024-09-10T11:50:16.008 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 434, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 572, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 173161, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 694431, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 23, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 9, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.049580404, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.015025930, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.018437247, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.012078458, 2024-09-10T11:50:16.009 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 570, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.054719732, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000095999 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 91, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000017375, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000190 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 294272 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.010 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 1, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-MDSRank": { 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 926, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1.778646858, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.001920784 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:16.011 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 754, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.023376011, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000031002 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "request": 181, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "reply": 172, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "reply_latency": { 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 172, 2024-09-10T11:50:16.012 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 27.004080707, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.157000469 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_reply": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "forward": 9, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_commit": 11, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_split": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_merge": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes": 15, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_top": 0, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_bottom": 1, 2024-09-10T11:50:16.013 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pin_tail": 14, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pinned": 14, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_expired": 353, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_with_caps": 2, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": 2, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "subtrees": 3, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse": 337, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_hit": 281, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_forward": 8, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_discover": 6, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:16.014 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_lock": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "load_cent": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "q": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "exported": 4, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "exported_inodes": 287, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "imported": 4, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "imported_inodes": 302, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_backtrace_fetch": 288, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rfiles": 325, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rbytes": 13424230450, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rsnaps": 0, 2024-09-10T11:50:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_fetch": 288, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_inodes": 69, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dirfrag_rstats": 69, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_file_inodes": 219, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_inode_file_caps": 26, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_revoke": 194, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_grant": 255, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:16.016 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps": 6506, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps_dirty": 6242, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_cap_release": 14, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "process_request_cap_release": 54 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_cache": { 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update": 0, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update_receipt": 3, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_try_discover": 2, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_send_discover": 8, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:16.017 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_created": 28, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_enqueued": 28, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_migrated": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_started": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_completed": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:16.018 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_exportdir": 4, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_flush": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_inodestats": 0 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_log": { 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evlrg": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evadd": 6499, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evex": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evtrm": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "ev": 6499, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evexg": 0, 2024-09-10T11:50:16.019 INFO:teuthology.orchestra.run.smithi026.stdout: "evexd": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segadd": 9, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segex": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segtrm": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "seg": 9, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segmjr": 2, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segexg": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "segexd": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "expos": 4194304, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "wrpos": 12139135, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "rdpos": 0, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "jlat": { 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 289, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 14.476537085, 2024-09-10T11:50:16.020 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.050091823 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "replayed": 0 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_mem": { 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 19, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "ino+": 236, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "ino-": 217, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dir": 18, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dir+": 100, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dir-": 82, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dn": 15, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dn+": 411, 2024-09-10T11:50:16.021 INFO:teuthology.orchestra.run.smithi026.stdout: "dn-": 396, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "cap": 2, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "cap+": 226, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "cap-": 224, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "rss": 58812, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "heap": 223520 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_server": { 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_client_request": 318, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_server_request": 14, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_request": 181, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_session": 9, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_peer_request": 57, 2024-09-10T11:50:16.022 INFO:teuthology.orchestra.run.smithi026.stdout: "req_create_latency": { 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getattr_latency": { 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 76, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 26.867261452, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.353516598 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.023 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "req_link_latency": { 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookup_latency": { 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 39, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.053249798, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.001365379 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:16.024 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupino_latency": { 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000221160, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000221160 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupname_latency": { 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.025 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lssnap_latency": { 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.026 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mkdir_latency": { 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mknod_latency": { 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mksnap_latency": { 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.027 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "req_open_latency": { 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 27, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.019613284, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000726417 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "req_readdir_latency": { 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000667486, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000667486 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.028 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rename_latency": { 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.029 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmdir_latency": { 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.030 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.031 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.031 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.031 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setattr_latency": { 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.032 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setlayout_latency": { 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setxattr_latency": { 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "req_symlink_latency": { 2024-09-10T11:50:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "req_unlink_latency": { 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 28, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.063067527, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.002252411 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.034 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_sessions": { 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "session_count": 1, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "session_add": 1, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "session_remove": 0, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_open": 1, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_stale": 0, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "total_load": 69, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "average_load": 69, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "avg_session_uptime": 466, 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:16.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:16.036 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:16.037 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:16.038 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 315039, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 132, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:16.039 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 154, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 78021, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 350, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2024-09-10T11:50:16.040 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "objecter": { 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_active": 0, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_laggy": 0, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send": 1409, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send_bytes": 7985608, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_resend": 29, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_reply": 1409, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_latency": { 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1409, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 544.089248579, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.386152766 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.041 INFO:teuthology.orchestra.run.smithi026.stdout: "op_inflight": 0, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "oplen_avg": { 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1409, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1489 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "op": 1409, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "op_r": 290, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "op_w": 1119, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "op_rmw": 0, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "op_pg": 0, 2024-09-10T11:50:16.042 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_stat": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_create": 10, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_read": 2, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_write": 291, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writefull": 31, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writesame": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_append": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_zero": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_truncate": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_delete": 713, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_mapext": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:16.043 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_getxattr": 288, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_setxattr": 20, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_call": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_watch": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_notify": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls": 0, 2024-09-10T11:50:16.044 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_other": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_active": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_send": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_resend": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_ping": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_active": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_send": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_resend": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_active": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_send": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_resend": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_active": 0, 2024-09-10T11:50:16.045 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_send": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_resend": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "command_active": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "command_send": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "command_resend": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "map_epoch": 86, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "map_full": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "map_inc": 2, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_sessions": 12, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_open": 12, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_close": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_laggy": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_wr": 93, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_rd": 0, 2024-09-10T11:50:16.046 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_del": 41 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "oft": { 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_objs": 1, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_updates": 0, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_removes": 0 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "osd-slow-ops": { 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_ops_count": 0 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "purge_queue": { 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:16.047 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops_high_water": 25, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing": 0, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_high_water": 1, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed_ops": 700, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed": 28, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 10840, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 3625797, 2024-09-10T11:50:16.048 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 10840, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 10840, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 3625797, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.049 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1409, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 7988436, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1409, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 7988436, 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:16.050 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 1024, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:16.051 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1409, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 1409, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1409, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 1409, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:16.052 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 28, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 2828, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 28, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 2, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 2828, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.053 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle-0x55d2669ba500": { 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 6499, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 7944831, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 6499, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:16.054 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 289, 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 7944831, 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:16.055 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-09-10T11:50:16.813 INFO:tasks.check_counter:Daemon mds.b mds.exported=4 2024-09-10T11:50:16.813 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-09-10T11:50:16.813 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-10T11:50:16.813 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T11:50:16.813 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T11:50:17.065 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:50:17.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:17 smithi026 ceph-mon[34817]: pgmap v567: 97 pgs: 97 active+clean; 57 MiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 106 op/s 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 761, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 763, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 8627881, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 242008, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 6, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 2, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.078044522, 2024-09-10T11:50:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.026361133, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.022954993, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.021916684, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 761, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.027380745, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000035979 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:17.698 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 749, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 873, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 12246896, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 530298, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.065694079, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.015860277, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.025030123, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.020695144, 2024-09-10T11:50:17.699 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 871, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.028140672, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000032308 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 292368 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.700 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 472, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 454, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 9031437, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 191203, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.058756826, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.017405283, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.035772463, 2024-09-10T11:50:17.701 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.009173523, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 454, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.045947550, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000101206 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 570944, 2024-09-10T11:50:17.702 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 102480 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 1, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-MDSRank": { 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2964, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.068392864, 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000023074 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.703 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "request": 0, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "reply": 0, 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "reply_latency": { 2024-09-10T11:50:17.704 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_reply": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "forward": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_commit": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_split": 0, 2024-09-10T11:50:17.705 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_merge": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes": 946, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_top": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_bottom": 946, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pinned": 946, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_expired": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "subtrees": 2, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_hit": 0, 2024-09-10T11:50:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_forward": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_discover": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_lock": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "load_cent": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "q": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "exported": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "exported_inodes": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "imported": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "imported_inodes": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rfiles": 4, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rbytes": 234, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rsnaps": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_file_inodes": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_cap_release": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "process_request_cap_release": 0 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_cache": { 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_try_discover": 0, 2024-09-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_send_discover": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_created": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_enqueued": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_migrated": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_started": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_completed": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_exportdir": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_flush": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_inodestats": 0 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_log": { 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "evlrg": 0, 2024-09-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi026.stdout: "evadd": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "evex": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "evtrm": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "ev": 13512, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "evexg": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "evexd": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segadd": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segex": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segtrm": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "seg": 17, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segmjr": 3, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segexg": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "segexd": 0, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "expos": 4194304, 2024-09-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi026.stdout: "wrpos": 33028021, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "rdpos": 33024263, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "jlat": { 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "replayed": 13512 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_mem": { 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 46, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "ino+": 1072, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "ino-": 1026, 2024-09-10T11:50:17.713 INFO:teuthology.orchestra.run.smithi026.stdout: "dir": 41, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dir+": 193, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dir-": 152, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dn": 946, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dn+": 1772, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dn-": 826, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "cap": 0, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "cap+": 0, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "cap-": 0, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "rss": 52080, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "heap": 215328 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_server": { 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_client_request": 0, 2024-09-10T11:50:17.714 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_server_request": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_request": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_session": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_peer_request": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "req_create_latency": { 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getattr_latency": { 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.715 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "req_link_latency": { 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookup_latency": { 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.716 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupino_latency": { 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupname_latency": { 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.717 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lssnap_latency": { 2024-09-10T11:50:17.718 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mkdir_latency": { 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mknod_latency": { 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mksnap_latency": { 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "req_open_latency": { 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "req_readdir_latency": { 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rename_latency": { 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:17.721 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmdir_latency": { 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setattr_latency": { 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.723 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setlayout_latency": { 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.724 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setxattr_latency": { 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "req_symlink_latency": { 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "req_unlink_latency": { 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.725 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_sessions": { 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "session_count": 1, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "session_add": 2, 2024-09-10T11:50:17.726 INFO:teuthology.orchestra.run.smithi026.stdout: "session_remove": 1, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_open": 1, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_stale": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "total_load": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "average_load": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "avg_session_uptime": 1821, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:17.727 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:17.728 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:17.729 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 199340, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 86, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:17.730 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 154, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 829770, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 8156, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:17.731 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "objecter": { 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_active": 0, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_laggy": 0, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send": 1788, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send_bytes": 26, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_resend": 4, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_reply": 1788, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "op_latency": { 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1788, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 51.739270004, 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.028936951 2024-09-10T11:50:17.732 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op_inflight": 0, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "oplen_avg": { 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1788, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1789 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op": 1788, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op_r": 1788, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op_w": 0, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op_rmw": 0, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "op_pg": 0, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_stat": 1081, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_create": 0, 2024-09-10T11:50:17.733 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_read": 704, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_write": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writefull": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writesame": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_append": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_zero": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_truncate": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_delete": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_mapext": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_getxattr": 2, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_setxattr": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:17.734 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_call": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_watch": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_notify": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_other": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_active": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_send": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_resend": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_ping": 0, 2024-09-10T11:50:17.735 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_active": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_send": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_resend": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_active": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_send": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_resend": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_active": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_send": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_resend": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "command_active": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "command_send": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "command_resend": 0, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "map_epoch": 86, 2024-09-10T11:50:17.736 INFO:teuthology.orchestra.run.smithi026.stdout: "map_full": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "map_inc": 2, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_sessions": 6, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_open": 6, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_close": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_laggy": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_wr": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_rd": 2, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_del": 0 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "oft": { 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_objs": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_updates": 0, 2024-09-10T11:50:17.737 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_removes": 0 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "osd-slow-ops": { 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_ops_count": 0 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "purge_queue": { 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_high_water": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed_ops": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed": 0, 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:17.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 1978, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 29715560, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 1978, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1978, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 29715560, 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:17.739 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:17.740 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1788, 2024-09-10T11:50:17.741 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 28836408, 2024-09-10T11:50:17.741 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1788, 2024-09-10T11:50:17.741 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 28836408, 2024-09-10T11:50:17.741 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:17 smithi081 ceph-mon[35059]: pgmap v567: 97 pgs: 97 active+clean; 57 MiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 106 op/s 2024-09-10T11:50:17.741 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 1024, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:17.742 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1788, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 1788, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1788, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 1788, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:17.743 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.744 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle-0x5598ae4706e0": { 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:17.745 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 0, 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 0, 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:17.746 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-09-10T11:50:17.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:17 smithi017 ceph-mon[30817]: pgmap v567: 97 pgs: 97 active+clean; 57 MiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 106 op/s 2024-09-10T11:50:18.425 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T11:50:18.425 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T11:50:18.426 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-10T11:50:18.426 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T11:50:18.426 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T11:50:18.679 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:50:19.164 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 4762, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 4951, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 1690543, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 6023332, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 14, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 5, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.393779521, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.124396168, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.322715173, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.013398116, 2024-09-10T11:50:19.165 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 4948, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 2.558437080, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000517064 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 7361, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.002370677, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000322 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 4576, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.166 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 1949, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 2057, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 1158451, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 829631, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 13, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 7, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.166616479, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.054706874, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.095904931, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.027832113, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2056, 2024-09-10T11:50:19.167 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.090349283, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000043944 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2673, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000527207, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000197 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 581040, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 110208 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:19.168 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 477, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 598, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 240246, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 1833945, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 22, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 5, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.058591118, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.021707888, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.020593093, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.012931577, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 598, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.067099480, 2024-09-10T11:50:19.169 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000112206 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 167, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000030556, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000182 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 294032 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 1, 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2024-09-10T11:50:19.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-MDSRank": { 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 518, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.977003941, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.001886107 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 674, 2024-09-10T11:50:19.171 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.021981516, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000032613 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "request": 79, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "reply": 77, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "reply_latency": { 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 77, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.074977862, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000973738 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.172 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_reply": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "forward": 2, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_commit": 11, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_split": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_merge": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes": 16, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_top": 1, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_bottom": 15, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pinned": 13, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_expired": 10, 2024-09-10T11:50:19.173 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "subtrees": 3, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse": 161, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_hit": 104, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_forward": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_discover": 4, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_lock": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "load_cent": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "q": 0, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "exported": 2, 2024-09-10T11:50:19.174 INFO:teuthology.orchestra.run.smithi026.stdout: "exported_inodes": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "imported": 2, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "imported_inodes": 25, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_backtrace_fetch": 125, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_peer_discover": 1, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rfiles": 325, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rbytes": 13424230450, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rsnaps": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_fetch": 125, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:19.175 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_file_inodes": 125, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_revoke": 2, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_grant": 266, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps": 4305, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps_dirty": 4179, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_cap_release": 5, 2024-09-10T11:50:19.176 INFO:teuthology.orchestra.run.smithi026.stdout: "process_request_cap_release": 53 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_cache": { 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update_receipt": 3, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_try_discover": 2, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_send_discover": 5, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_created": 25, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_enqueued": 25, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:19.177 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_migrated": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_started": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_completed": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_exportdir": 2, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_flush": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:19.178 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_inodestats": 0 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_log": { 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evlrg": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evadd": 4445, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evex": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evtrm": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "ev": 4445, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evexg": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "evexd": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "segadd": 6, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "segex": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "segtrm": 0, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "seg": 6, 2024-09-10T11:50:19.179 INFO:teuthology.orchestra.run.smithi026.stdout: "segmjr": 2, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "segexg": 0, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "segexd": 0, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "expos": 4194304, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "wrpos": 9480274, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "rdpos": 0, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "jlat": { 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 148, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 17.745508105, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.119902081 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "replayed": 0 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.180 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_mem": { 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 20, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "ino+": 50, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "ino-": 30, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dir": 19, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dir+": 26, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dir-": 7, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dn": 16, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dn+": 76, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "dn-": 60, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "cap": 0, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "cap+": 44, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "cap-": 44, 2024-09-10T11:50:19.181 INFO:teuthology.orchestra.run.smithi026.stdout: "rss": 57000, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "heap": 223520 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_server": { 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_client_request": 182, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_server_request": 1, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_request": 79, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_session": 11, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_peer_request": 27, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "req_create_latency": { 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.182 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getattr_latency": { 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000238422, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000238422 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "req_link_latency": { 2024-09-10T11:50:19.183 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookup_latency": { 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 24, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.005664115, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000236004 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupino_latency": { 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupname_latency": { 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.185 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lssnap_latency": { 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mkdir_latency": { 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.186 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mknod_latency": { 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mksnap_latency": { 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "req_open_latency": { 2024-09-10T11:50:19.187 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 25, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.014619574, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000584782 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "req_readdir_latency": { 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000861526, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000430763 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rename_latency": { 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.188 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmdir_latency": { 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.189 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setattr_latency": { 2024-09-10T11:50:19.190 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.191 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setlayout_latency": { 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setxattr_latency": { 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "req_symlink_latency": { 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.192 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "req_unlink_latency": { 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 25, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.053594225, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.002143769 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.193 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_sessions": { 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "session_count": 1, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "session_add": 2, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "session_remove": 1, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_open": 1, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_stale": 0, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "total_load": 54, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "average_load": 54, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "avg_session_uptime": 461, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.194 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:19.195 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:19.196 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 292274, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 116, 2024-09-10T11:50:19.197 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 154, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2024-09-10T11:50:19.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 81253, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 343, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "objecter": { 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_active": 0, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_laggy": 0, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send": 1036, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send_bytes": 5311411, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_resend": 28, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_reply": 1036, 2024-09-10T11:50:19.199 INFO:teuthology.orchestra.run.smithi026.stdout: "op_latency": { 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1036, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 50.015295501, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.048277312 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "op_inflight": 0, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "oplen_avg": { 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1036, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1128 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "op": 1036, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "op_r": 126, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "op_w": 910, 2024-09-10T11:50:19.200 INFO:teuthology.orchestra.run.smithi026.stdout: "op_rmw": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "op_pg": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_stat": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_create": 10, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_read": 1, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_write": 149, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writefull": 29, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writesame": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_append": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_zero": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_truncate": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_delete": 638, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_mapext": 0, 2024-09-10T11:50:19.201 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_getxattr": 125, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_setxattr": 20, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_call": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_watch": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_notify": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_other": 0, 2024-09-10T11:50:19.202 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_active": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_send": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_resend": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_ping": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_active": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_send": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_resend": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_active": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_send": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_resend": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_active": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_send": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_resend": 0, 2024-09-10T11:50:19.203 INFO:teuthology.orchestra.run.smithi026.stdout: "command_active": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "command_send": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "command_resend": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "map_epoch": 86, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "map_full": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "map_inc": 2, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_sessions": 12, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_open": 12, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_close": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_laggy": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_wr": 106, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_rd": 0, 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_del": 50 2024-09-10T11:50:19.204 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "oft": { 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_objs": 1, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_updates": 0, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_removes": 0 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "osd-slow-ops": { 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_ops_count": 0 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "purge_queue": { 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops_high_water": 25, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing": 0, 2024-09-10T11:50:19.205 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_high_water": 1, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed_ops": 625, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed": 25, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 7184, 2024-09-10T11:50:19.206 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 2428171, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 7184, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 7184, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 2428171, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.207 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:19.208 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1036, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 5313936, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1036, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 5313936, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 1024, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1036, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 1036, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1036, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 1036, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.210 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 25, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 2525, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 25, 2024-09-10T11:50:19.211 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 2525, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle-0x56392f9ba500": { 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:19.212 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 4445, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 5285970, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 4445, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 148, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 5285970, 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:19.213 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:19.214 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:19.214 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:19.214 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.214 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:19.214 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-09-10T11:50:19.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:19 smithi081 ceph-mon[35059]: pgmap v568: 97 pgs: 97 active+clean; 57 MiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 93 op/s 2024-09-10T11:50:19.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:19 smithi026 ceph-mon[34817]: pgmap v568: 97 pgs: 97 active+clean; 57 MiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 93 op/s 2024-09-10T11:50:19.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:19 smithi017 ceph-mon[30817]: pgmap v568: 97 pgs: 97 active+clean; 57 MiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 93 op/s 2024-09-10T11:50:20.038 INFO:tasks.check_counter:Daemon mds.h mds.exported=2 2024-09-10T11:50:20.038 INFO:tasks.check_counter:Daemon mds.h mds.imported=2 2024-09-10T11:50:20.038 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-10T11:50:20.038 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T11:50:20.038 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T11:50:20.289 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T11:50:20.773 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-09-10T11:50:20.773 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:20.773 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 276, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 278, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 4267083, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 87832, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 6, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 2, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.030601012, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.009907076, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.009808232, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.007597272, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 276, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.015686176, 2024-09-10T11:50:20.774 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000056833 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 714, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 696, 2024-09-10T11:50:20.775 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 4187174, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 269287, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.072357808, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.021839070, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.036129877, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.015213786, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 696, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.038328164, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000055069 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.776 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 571600, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 104240 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 780, 2024-09-10T11:50:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 906, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 238234, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 542058, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 4, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.085454384, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.028129874, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.021368103, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.027672475, 2024-09-10T11:50:20.778 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 904, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.059196470, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000065482 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 294336 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.779 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 1, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-MDSRank": { 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 2689, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.069664742, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000025907 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:20.780 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "request": 0, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "reply": 0, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "reply_latency": { 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.781 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_reply": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "forward": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_commit": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_split": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_merge": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes": 32, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_top": 0, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_bottom": 32, 2024-09-10T11:50:20.782 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pinned": 32, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_expired": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "subtrees": 1, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_hit": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_forward": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_discover": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_lock": 0, 2024-09-10T11:50:20.783 INFO:teuthology.orchestra.run.smithi026.stdout: "load_cent": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "q": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "exported": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "exported_inodes": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "imported": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "imported_inodes": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rfiles": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rbytes": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rsnaps": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:20.784 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_file_inodes": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps": 0, 2024-09-10T11:50:20.785 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_cap_release": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "process_request_cap_release": 0 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_cache": { 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_try_discover": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_send_discover": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:20.786 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_created": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_enqueued": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_migrated": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_started": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_completed": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_exportdir": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_flush": 0, 2024-09-10T11:50:20.787 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_inodestats": 0 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_log": { 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evlrg": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evadd": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evex": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evtrm": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "ev": 6445, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evexg": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "evexd": 0, 2024-09-10T11:50:20.788 INFO:teuthology.orchestra.run.smithi026.stdout: "segadd": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "segex": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "segtrm": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "seg": 8, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "segmjr": 2, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "segexg": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "segexd": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "expos": 4194304, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "wrpos": 11872166, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "rdpos": 11870515, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "jlat": { 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.789 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "replayed": 6445 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_mem": { 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 4, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "ino+": 45, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "ino-": 41, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "dir": 2, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "dir+": 14, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "dir-": 12, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "dn": 32, 2024-09-10T11:50:20.790 INFO:teuthology.orchestra.run.smithi026.stdout: "dn+": 73, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "dn-": 41, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "cap": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "cap+": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "cap-": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "rss": 51224, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "heap": 215328 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_server": { 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_client_request": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_server_request": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_request": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_session": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_peer_request": 0, 2024-09-10T11:50:20.791 INFO:teuthology.orchestra.run.smithi026.stdout: "req_create_latency": { 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getattr_latency": { 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.792 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "req_link_latency": { 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookup_latency": { 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.793 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupino_latency": { 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupname_latency": { 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.794 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.795 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lssnap_latency": { 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mkdir_latency": { 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mknod_latency": { 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.796 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mksnap_latency": { 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "req_open_latency": { 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "req_readdir_latency": { 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.797 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rename_latency": { 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:20.798 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmdir_latency": { 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.799 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setattr_latency": { 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.800 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setlayout_latency": { 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setxattr_latency": { 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.801 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "req_symlink_latency": { 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "req_unlink_latency": { 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:20.802 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_sessions": { 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "session_count": 1, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "session_add": 2, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "session_remove": 1, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_open": 1, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_stale": 0, 2024-09-10T11:50:20.803 INFO:teuthology.orchestra.run.smithi026.stdout: "total_load": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "average_load": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "avg_session_uptime": 1822, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:20.804 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:20.805 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:20.806 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 198287, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 57, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 154, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:20.807 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 34576, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 156, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "objecter": { 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "op_active": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "op_laggy": 0, 2024-09-10T11:50:20.808 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send": 1574, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send_bytes": 21, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op_resend": 3, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op_reply": 1574, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op_latency": { 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1574, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 55.166220371, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.035048424 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op_inflight": 0, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "oplen_avg": { 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1574, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1575 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.809 INFO:teuthology.orchestra.run.smithi026.stdout: "op": 1574, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "op_r": 1574, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "op_w": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "op_rmw": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "op_pg": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_stat": 940, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_create": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_read": 632, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_write": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writefull": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writesame": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_append": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_zero": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_truncate": 0, 2024-09-10T11:50:20.810 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_delete": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_mapext": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_getxattr": 1, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_setxattr": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_call": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_watch": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_notify": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:20.811 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_other": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_active": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_send": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_resend": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_ping": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_active": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_send": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_resend": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_active": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_send": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_resend": 0, 2024-09-10T11:50:20.812 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_active": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_send": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_resend": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "command_active": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "command_send": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "command_resend": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "map_epoch": 86, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "map_full": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "map_inc": 2, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_sessions": 6, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_open": 6, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_close": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_laggy": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_wr": 0, 2024-09-10T11:50:20.813 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_rd": 2, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_del": 0 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "oft": { 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_objs": 0, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_updates": 0, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_removes": 0 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "osd-slow-ops": { 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_ops_count": 0 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "purge_queue": { 2024-09-10T11:50:20.814 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_high_water": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed_ops": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 1766, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 8520807, 2024-09-10T11:50:20.815 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 1766, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1766, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 8520807, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:20.816 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1574, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 7678015, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1574, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 7678015, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.817 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 1024, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 1574, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 1574, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 1574, 2024-09-10T11:50:20.818 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 1574, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:20.819 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle-0x560d7372c6e0": { 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2024-09-10T11:50:20.820 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2024-09-10T11:50:20.821 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.822 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-09-10T11:50:20.822 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-09-10T11:50:21.631 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T11:50:21.631 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T11:50:21.632 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-10T11:50:21.632 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T11:50:21.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T11:50:21.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:21 smithi081 ceph-mon[35059]: pgmap v569: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-10T11:50:21.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:21 smithi026 ceph-mon[34817]: pgmap v569: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-10T11:50:21.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:21 smithi017 ceph-mon[30817]: pgmap v569: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 14 op/s 2024-09-10T11:50:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:50:22.325 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1916, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2127, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1218765, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 4736325, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 9, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.186177957, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.089190601, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.094192623, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.012439845, 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2130, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.224213411, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000105264 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2924, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001308365, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000447 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 593728, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 113632 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 653, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 775, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 228606, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 3710503, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 16, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.075952589, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.027537973, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.023614347, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.020274090, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 774, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.068543846, 2024-09-10T11:50:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000088557 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 82, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000015033, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000183 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 296368 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6920, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 7145, 2024-09-10T11:50:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2428189, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 2748144, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 24, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 8, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.448724333, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.142069249, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.493966335, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.011997133, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7139, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.516811690, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000212468 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 11110, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.003060048, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000275 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 736 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 561, 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.226353951, 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002186014 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 835, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.023945156, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000028676 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 102, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 96, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 96, 2024-09-10T11:50:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.085917889, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000894978 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 6, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 11, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 11, 2024-09-10T11:50:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 1, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 10, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 10, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 46, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 2, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 201, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 130, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 6, 2024-09-10T11:50:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 3, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 2, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 31, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 2, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 31, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 155, 2024-09-10T11:50:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 325, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 13424230450, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 155, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 155, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 2, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 4, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 326, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 6291, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 6124, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 6, 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 64 2024-09-10T11:50:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 3, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 2, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 4, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 31, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 31, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-10T11:50:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 2, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-10T11:50:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 6445, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 6445, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 8, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-10T11:50:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 8, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 11872166, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 165, 2024-09-10T11:50:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 8.177777116, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.049562285 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 15, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 56, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 41, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 13, 2024-09-10T11:50:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 26, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 13, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 11, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 88, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 77, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 49, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 49, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 57848, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 223520 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 226, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 2, 2024-09-10T11:50:22.345 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 102, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 10, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 35, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-10T11:50:22.347 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 32, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007863883, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000245746 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.348 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:22.349 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.350 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.351 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 31, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.018604376, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000600141 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001264824, 2024-09-10T11:50:22.352 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000632412 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.353 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.355 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.356 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 31, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.058184806, 2024-09-10T11:50:22.357 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001876929 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-10T11:50:22.358 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 2, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 68, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 68, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 390, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:22.359 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:22.360 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:22.361 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 276203, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 110, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 58888, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 242, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:22.363 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 1247, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 7706136, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 33, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 1247, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1247, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 42.024193751, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.033700235 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.364 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1247, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1350 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 1247, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 156, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 1091, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 166, 2024-09-10T11:50:22.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 32, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 788, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 155, 2024-09-10T11:50:22.366 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-10T11:50:22.367 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-10T11:50:22.368 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 86, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 122, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 56 2024-09-10T11:50:22.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:22.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 25, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 1, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 775, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 31, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:22.371 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 9485, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3007026, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 9485, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 9485, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3007026, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1247, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 7709267, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1247, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 7709267, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-10T11:50:22.374 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1247, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1247, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1247, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1247, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 31, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3131, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 31, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3131, 2024-09-10T11:50:22.376 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55f1334e8500": { 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 6445, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 7677862, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 6445, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 165, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 7677862, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:22.378 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T11:50:23.304 INFO:tasks.check_counter:Daemon mds.c mds.exported=2 2024-09-10T11:50:23.304 INFO:tasks.check_counter:Daemon mds.c mds.imported=2 2024-09-10T11:50:23.304 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-10T11:50:23.304 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T11:50:23.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T11:50:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:50:23.559 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:23 smithi081 ceph-mon[35059]: pgmap v570: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:50:23.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:23 smithi026 ceph-mon[34817]: pgmap v570: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:50:23.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:23 smithi017 ceph-mon[30817]: pgmap v570: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2104, 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2444, 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 743750, 2024-09-10T11:50:24.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 5952279, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 10, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.198833695, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.086101156, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.090768923, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.026011659, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2447, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.146468362, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000059856 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:24.089 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3083, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000771749, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000250 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 701, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 682, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 825967, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 4576345, 2024-09-10T11:50:24.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 8, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.074607957, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.029428387, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.035227362, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.014166750, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 681, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.059983735, 2024-09-10T11:50:24.091 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000088081 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 158, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000035413, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000224 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 588800, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 115936 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 8231, 2024-09-10T11:50:24.092 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 8642, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2821478, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 3554137, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 30, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 10, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.506486817, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.169205871, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.590789864, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.012824446, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8636, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.827700817, 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000327431 2024-09-10T11:50:24.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 12795, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.002900789, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000226 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 296128 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-10T11:50:24.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 597, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.427342767, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002390858 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:24.095 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1012, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.029856989, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000029502 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 121, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 117, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 117, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.104375117, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000892095 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.096 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 4, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 11, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 11, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 1, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 10, 2024-09-10T11:50:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 10, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 53, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 2, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 241, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 158, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 4, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 3, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-10T11:50:24.098 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 2, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 38, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 2, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 38, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 190, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 325, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 13424230450, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 190, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:24.099 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 190, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 3, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 384, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 7560, 2024-09-10T11:50:24.100 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 7385, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 6, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 78 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 3, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 2, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 4, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:24.101 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 38, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 38, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 2, 2024-09-10T11:50:24.102 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 7730, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 7730, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-10T11:50:24.103 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 10, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 10, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 13426553, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 165, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 6.319840158, 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.038302061 2024-09-10T11:50:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 15, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 63, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 48, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 13, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 26, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 13, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 11, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 102, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 91, 2024-09-10T11:50:24.105 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 59, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 59, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 58052, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 223520 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 273, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 1, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 121, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 6, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 40, 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-10T11:50:24.106 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.107 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 39, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.009519594, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000244092 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.109 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-10T11:50:24.110 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.111 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 38, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.023511429, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000618721 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000980023, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000490011 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.112 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.113 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-10T11:50:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.115 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.116 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 38, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.070364071, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001851686 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 82, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 82, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 393, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:24.118 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:24.119 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:24.120 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 292879, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 124, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-10T11:50:24.121 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:24.122 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 58888, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 242, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 1457, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 9262365, 2024-09-10T11:50:24.123 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 33, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 1457, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1457, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 40.944214898, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.028101726 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1457, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1557 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 1457, 2024-09-10T11:50:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 191, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 1266, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 166, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 31, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 964, 2024-09-10T11:50:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 190, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-10T11:50:24.127 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 86, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 120, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 55 2024-09-10T11:50:24.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 25, 2024-09-10T11:50:24.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 1, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 950, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 38, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 11032, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3383645, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 11032, 2024-09-10T11:50:24.130 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 11032, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3383645, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:24.131 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1457, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 9266203, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1457, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 9266203, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1457, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1457, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1457, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1457, 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:24.133 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 38, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3838, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 38, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:24.134 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3838, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x563c02474500": { 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 7730, 2024-09-10T11:50:24.135 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 9232249, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 7730, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 165, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 9232249, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:24.136 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T11:50:24.844 INFO:tasks.check_counter:Daemon mds.f mds.exported=2 2024-09-10T11:50:24.845 INFO:tasks.check_counter:Daemon mds.f mds.imported=2 2024-09-10T11:50:24.845 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-10T11:50:24.845 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T11:50:24.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T11:50:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:50:25.513 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:25 smithi081 ceph-mon[35059]: pgmap v571: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 18827, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 23515, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 7085498, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 15226607, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 13, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 1.181283107, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.434662022, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 1.124796643, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.088332244, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 23517, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5.257918813, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000223579 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 32241, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007479409, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000231 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 661984, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 146336 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 3685, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 3463, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1174895, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 13317922, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 12, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.289659158, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.127700397, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.125316648, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.053678216, 2024-09-10T11:50:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3461, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.354589392, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000102452 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3169, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000657303, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000207 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 302096 2024-09-10T11:50:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4382, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4019, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1458135, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 11258362, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 72, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 9, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.331350491, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.139018692, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.187710099, 2024-09-10T11:50:25.622 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.035521775, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4015, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.733011367, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000182568 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5785, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001167301, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000201 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4232, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5.976452385, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001412205 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:25.624 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1541, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.091034446, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000059074 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 2452, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 2448, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2448, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 31.520785980, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.012876138 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.625 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 4, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 21, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 1, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 163, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 35, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 45, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 83, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 112, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 528, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 2, 2024-09-10T11:50:25.626 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 2, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 6, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 3320, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 3119, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 51, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 26, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 10, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 396, 2024-09-10T11:50:25.627 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 10, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 356, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 1341, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 4, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 234, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 1341, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 397, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 7, 2024-09-10T11:50:25.628 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 390, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 944, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 9, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 353, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 3364, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 6, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 11348, 2024-09-10T11:50:25.629 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 10473, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 134, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 1217 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 4, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 21, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 28, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:25.630 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 812, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 723, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 61, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 7, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 10, 2024-09-10T11:50:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 1, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 13512, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 13512, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-10T11:50:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 17, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 17, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 3, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 33028021, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1914, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 58.526009398, 2024-09-10T11:50:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.030577852 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 60, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 1093, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 1033, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 55, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 207, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 152, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 163, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 1927, 2024-09-10T11:50:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 1764, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 2, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 1105, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 1103, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 71812, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 231712 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 3325, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 123, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 2452, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 23, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 268, 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-10T11:50:25.635 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 765, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.756971034, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000989504 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 76, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010480277, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000137898 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.636 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 61, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.044617584, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000731435 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 289, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 18.429658617, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.063770445 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:25.637 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000192044, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000192044 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.638 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.639 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 105, 2024-09-10T11:50:25.640 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.108765536, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001035862 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 58, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.025141252, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000433469 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 170, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.801424158, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.004714259 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 113, 2024-09-10T11:50:25.642 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 8.848005849, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.078300936 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-10T11:50:25.643 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 99, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.453289019, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.014679687 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.028846866, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.004120980 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:25.645 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001423446, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000355861 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.019450805, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002778686 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.646 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 13, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007415229, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000570402 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 680, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.985104264, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001448682 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 2, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 426, 2024-09-10T11:50:25.648 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 426, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 477, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:25.649 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:25.650 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:25.651 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 314781, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 154, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 352, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 4, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:25.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 342410, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 6709, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-10T11:50:25.653 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 4881, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 29191364, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 32, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 4881, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4881, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 593.732440101, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.121641557 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-10T11:50:25.654 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4881, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 5019 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 4881, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 1378, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 3503, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 11, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 30, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 1937, 2024-09-10T11:50:25.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 49, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 1, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 1393, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1348, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 22, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:25.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-10T11:50:25.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 6, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-10T11:50:25.658 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 86, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-09-10T11:50:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 171, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 51 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-10T11:50:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 26, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 6, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 875, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 723, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.661 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 26890, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 7276852, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 26890, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 26890, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 7276852, 2024-09-10T11:50:25.662 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:25.663 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 4881, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 29264395, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4881, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 29264395, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.664 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 4881, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 4881, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4881, 2024-09-10T11:50:25.665 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 4881, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 723, 2024-09-10T11:50:25.666 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 73031, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 723, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 23, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 73031, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:25.667 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x558b1e62e500": { 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 13512, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 28833717, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 13512, 2024-09-10T11:50:25.668 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1914, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 28833717, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:25.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T11:50:25.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:25 smithi026 ceph-mon[34817]: pgmap v571: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T11:50:25.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:25 smithi017 ceph-mon[30817]: pgmap v571: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T11:50:26.465 INFO:tasks.check_counter:Daemon mds.i mds.exported=10 2024-09-10T11:50:26.465 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2024-09-10T11:50:26.465 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-09-10T11:50:26.465 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T11:50:26.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T11:50:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T11:50:27.189 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 755, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 739, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 757920, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 284110, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.082882212, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.027069846, 2024-09-10T11:50:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.035773087, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.020494102, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 738, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.036420251, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000049349 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 569424, 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 105712 2024-09-10T11:50:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 3, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 131, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 716, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 297002, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.007546468, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.005194704, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001161945, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000053881, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 129, 2024-09-10T11:50:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.006698416, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000051925 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 296304 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1171, 2024-09-10T11:50:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1171, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 8244672, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 371561, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.085559807, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.023145702, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.027440303, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.029847962, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1170, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.060669300, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000051854 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2938, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.070032904, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000023836 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-10T11:50:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 30, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 30, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 30, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-10T11:50:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-10T11:50:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T11:50:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-10T11:50:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-10T11:50:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 6499, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 9, 2024-09-10T11:50:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 12139135, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 12136971, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 6499 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 5, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 228, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 223, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 3, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 91, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 88, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 30, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 346, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 316, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-10T11:50:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 50952, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215328 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-10T11:50:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-10T11:50:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.215 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.216 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-09-10T11:50:27.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 1795, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T11:50:27.220 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-10T11:50:27.221 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-10T11:50:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 181281, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 46, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-10T11:50:27.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7496, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 154, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 36672, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 159, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-10T11:50:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 1730, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 1730, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1730, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 17.132668145, 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.009903276 2024-09-10T11:50:27.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1730, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1731 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 1730, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 1730, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1026, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 702, 2024-09-10T11:50:27.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-10T11:50:27.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-10T11:50:27.228 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 86, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-10T11:50:27.229 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 4, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 4, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:27.231 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 1925, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 8817158, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 1925, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1925, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 8817158, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1730, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 7944886, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1730, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 7944886, 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:27.233 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 1730, 2024-09-10T11:50:27.234 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1730, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1730, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1730, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:27.235 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x564f6c3fe6e0": { 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-10T11:50:27.236 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T11:50:27.237 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T11:50:27.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:27 smithi081 ceph-mon[35059]: pgmap v572: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:27.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:27 smithi026 ceph-mon[34817]: pgmap v572: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:27.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:27 smithi017 ceph-mon[30817]: pgmap v572: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:27.947 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-10T11:50:27.947 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-10T11:50:27.947 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-10T11:50:27.948 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T11:50:27.958 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T11:50:27.958 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:50:27.958 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:50:27.982 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T11:50:27.982 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T11:50:28.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T11:50:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.066+0000 7f56fd811640 1 -- 172.21.15.17:0/3687044541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102790 msgr2=0x7f56f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.066+0000 7f56fd811640 1 --2- 172.21.15.17:0/3687044541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102790 0x7f56f81067e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009900 tx=0x7f56ec02a410 comp rx=0 tx=0).stop 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.066+0000 7f56fd811640 1 -- 172.21.15.17:0/3687044541 shutdown_connections 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.066+0000 7f56fd811640 1 --2- 172.21.15.17:0/3687044541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.066+0000 7f56fd811640 1 --2- 172.21.15.17:0/3687044541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8102790 0x7f56f81067e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 --2- 172.21.15.17:0/3687044541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8101de0 0x7f56f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 -- 172.21.15.17:0/3687044541 >> 172.21.15.17:0/3687044541 conn(0x7f56f80fd8c0 msgr2=0x7f56f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 -- 172.21.15.17:0/3687044541 shutdown_connections 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 -- 172.21.15.17:0/3687044541 wait complete. 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 Processor -- start 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.067+0000 7f56fd811640 1 -- start start 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102790 0x7f56f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8111f70 con 0x7f56f8101de0 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8111df0 con 0x7f56f8102790 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56fd811640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81120f0 con 0x7f56f8106f10 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50786/0 (socket says 172.21.15.17:50786) 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 -- 172.21.15.17:0/1277363716 learned_addr learned my addr 172.21.15.17:0/1277363716 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f77fe640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f67fc640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102790 0x7f56f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 -- 172.21.15.17:0/1277363716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 msgr2=0x7f56f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 -- 172.21.15.17:0/1277363716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102790 msgr2=0x7f56f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102790 0x7f56f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 -- 172.21.15.17:0/1277363716 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f81a6940 con 0x7f56f8101de0 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f77fe640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.068+0000 7f56f6ffd640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9f0 tx=0x7f56e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.069+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e800ccc0 con 0x7f56f8101de0 2024-09-10T11:50:29.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.069+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e8010910 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.069+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f81a6c30 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.069+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e80188a0 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.069+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81a7140 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.070+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f81021c0 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.072+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f56e8010ac0 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.072+0000 7f56fc80f640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 0x7f56e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.073+0000 7f56f67fc640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 0x7f56e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.073+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f56e80cf970 con 0x7f56f8101de0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.073+0000 7f56f67fc640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 0x7f56e00a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009230 tx=0x7f56ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.076+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56e809c880 con 0x7f56f8101de0 2024-09-10T11:50:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.312+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56f8075a20 con 0x7f56f8101de0 2024-09-10T11:50:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.312+0000 7f56fc80f640 1 -- 172.21.15.17:0/1277363716 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+586 (secure 0 0 0) 0x7f56f8075a20 con 0x7f56f8101de0 2024-09-10T11:50:29.313 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2483128501 2024-09-11T11:33:53.328197+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2456904864 2024-09-11T11:33:53.328197+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2456904864 2024-09-11T11:33:53.328197+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2953600041 2024-09-11T11:33:53.328197+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/456613680 2024-09-11T11:33:53.328197+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/710238438 2024-09-11T11:33:29.648083+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/817290704 2024-09-11T11:33:29.648083+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/817290704 2024-09-11T11:33:29.648083+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/25951598 2024-09-11T11:33:29.648083+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2863615588 2024-09-11T11:33:29.648083+0000 2024-09-10T11:50:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-10T11:50:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 msgr2=0x7f56e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 0x7f56e00a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009230 tx=0x7f56ec0058d0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 msgr2=0x7f56f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9f0 tx=0x7f56e800edf0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 shutdown_connections 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f56e00a2b80 0x7f56e00a5040 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f8106f10 0x7f56f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f56f8102790 0x7f56f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 --2- 172.21.15.17:0/1277363716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56f8101de0 0x7f56f80744f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 >> 172.21.15.17:0/1277363716 conn(0x7f56f80fd8c0 msgr2=0x7f56f80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 shutdown_connections 2024-09-10T11:50:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:29.314+0000 7f56fd811640 1 -- 172.21.15.17:0/1277363716 wait complete. 2024-09-10T11:50:29.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:29 smithi017 ceph-mon[30817]: pgmap v573: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-10T11:50:29.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:29 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1277363716' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:50:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:29 smithi081 ceph-mon[35059]: pgmap v573: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-10T11:50:29.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:29 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1277363716' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:50:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:29 smithi026 ceph-mon[34817]: pgmap v573: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-10T11:50:29.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:29 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1277363716' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T11:50:30.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T11:50:30.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:50:30.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T11:50:30.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:50:30.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:50:30.263 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T11:50:30.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:50:30.303 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T11:50:30.361 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T11:50:30.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:50:30.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T11:50:30.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T11:50:30.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-10T11:50:30.517 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T11:50:30.527 INFO:tasks.cephadm:Teardown begin 2024-09-10T11:50:30.527 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T11:50:30.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:50:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 -- 172.21.15.17:0/2670759536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20106f10 msgr2=0x7f5c2010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 --2- 172.21.15.17:0/2670759536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20106f10 0x7f5c2010ea90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009900 tx=0x7f5c1802a410 comp rx=0 tx=0).stop 2024-09-10T11:50:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 -- 172.21.15.17:0/2670759536 shutdown_connections 2024-09-10T11:50:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 --2- 172.21.15.17:0/2670759536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20102790 0x7f5c201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 --2- 172.21.15.17:0/2670759536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20106f10 0x7f5c2010ea90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 --2- 172.21.15.17:0/2670759536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 0x7f5c201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 -- 172.21.15.17:0/2670759536 >> 172.21.15.17:0/2670759536 conn(0x7f5c200fd8c0 msgr2=0x7f5c200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 -- 172.21.15.17:0/2670759536 shutdown_connections 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.287+0000 7f5c24954640 1 -- 172.21.15.17:0/2670759536 wait complete. 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 Processor -- start 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 -- start start 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 0x7f5c201983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20106f10 0x7f5c2019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20111f70 con 0x7f5c20102790 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20111df0 con 0x7f5c20101de0 2024-09-10T11:50:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.288+0000 7f5c24954640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c201120f0 con 0x7f5c20106f10 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50818/0 (socket says 172.21.15.17:50818) 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 -- 172.21.15.17:0/2563079286 learned_addr learned my addr 172.21.15.17:0/2563079286 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1ed9d640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20106f10 0x7f5c2019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1e59c640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 0x7f5c201983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 -- 172.21.15.17:0/2563079286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20106f10 msgr2=0x7f5c2019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20106f10 0x7f5c2019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 -- 172.21.15.17:0/2563079286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 msgr2=0x7f5c201983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 0x7f5c201983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 -- 172.21.15.17:0/2563079286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2019d360 con 0x7f5c20102790 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c1dd9b640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400db80 tx=0x7f5c1400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14017070 con 0x7f5c20102790 2024-09-10T11:50:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2019d650 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c14003b70 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140106c0 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.289+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c201a4f30 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.290+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c201021c0 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.291+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5c14004020 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.292+0000 7f5c0f7fe640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.292+0000 7f5c1e59c640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.292+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f5c140cede0 con 0x7f5c20102790 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.293+0000 7f5c1e59c640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 0x7f5c080a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c10005fd0 tx=0x7f5c10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.297+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c14020070 con 0x7f5c20102790 2024-09-10T11:50:31.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.508+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c2010a150 con 0x7f5c20102790 2024-09-10T11:50:31.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:31 smithi017 ceph-mon[30817]: pgmap v574: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:50:31.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.508+0000 7f5c0f7fe640 1 -- 172.21.15.17:0/2563079286 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11960 (secure 0 0 0) 0x7f5c1409bd50 con 0x7f5c20102790 2024-09-10T11:50:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:50:31.510 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-09-10T11:50:03:364278+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:50:02.676692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:50:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 msgr2=0x7f5c080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 0x7f5c080a5040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c10005fd0 tx=0x7f5c10005850 comp rx=0 tx=0).stop 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 msgr2=0x7f5c201988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400db80 tx=0x7f5c1400b630 comp rx=0 tx=0).stop 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 shutdown_connections 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c20106f10 0x7f5c2019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20102790 0x7f5c201988f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 --2- 172.21.15.17:0/2563079286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c20101de0 0x7f5c201983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 >> 172.21.15.17:0/2563079286 conn(0x7f5c200fd8c0 msgr2=0x7f5c200fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 shutdown_connections 2024-09-10T11:50:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:31.511+0000 7f5c24954640 1 -- 172.21.15.17:0/2563079286 wait complete. 2024-09-10T11:50:31.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:31 smithi081 ceph-mon[35059]: pgmap v574: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:50:31.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:31 smithi026 ceph-mon[34817]: pgmap v574: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T11:50:32.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T11:50:32.399 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:32.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:32 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/2563079286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:32.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:32 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/2563079286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:32.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:32 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/2563079286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- 172.21.15.17:0/2155324816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314108300 msgr2=0x7fd31410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 --2- 172.21.15.17:0/2155324816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314108300 0x7fd31410ec70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009cd0 tx=0x7fd30c02a8d0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- 172.21.15.17:0/2155324816 shutdown_connections 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 --2- 172.21.15.17:0/2155324816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314103780 0x7fd314107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 --2- 172.21.15.17:0/2155324816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314108300 0x7fd31410ec70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 --2- 172.21.15.17:0/2155324816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314102dd0 0x7fd3141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- 172.21.15.17:0/2155324816 >> 172.21.15.17:0/2155324816 conn(0x7fd3140fc7d0 msgr2=0x7fd3140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- 172.21.15.17:0/2155324816 shutdown_connections 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- 172.21.15.17:0/2155324816 wait complete. 2024-09-10T11:50:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 Processor -- start 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.885+0000 7fd31acdd640 1 -- start start 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 0x7fd314198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd3141120d0 con 0x7fd314102dd0 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd314111f50 con 0x7fd314103780 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31acdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd314112250 con 0x7fd314108300 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd318a79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:43090/0 (socket says 172.21.15.17:43090) 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd318a79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50788/0 (socket says 172.21.15.17:50788) 2024-09-10T11:50:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 -- 172.21.15.17:0/1635984709 learned_addr learned my addr 172.21.15.17:0/1635984709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd313fff640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 0x7fd314198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 -- 172.21.15.17:0/1635984709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 msgr2=0x7fd314198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 0x7fd314198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 -- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 msgr2=0x7fd314198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 -- 172.21.15.17:0/1635984709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31419d540 con 0x7fd314108300 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd313fff640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 0x7fd314198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd318a79640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.886+0000 7fd31927a640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009ca0 tx=0x7fd30c02f3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.887+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0317e0 con 0x7fd314108300 2024-09-10T11:50:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.887+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd30c003e50 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.887+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31419d7d0 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.887+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c030590 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.887+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141a5110 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.888+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3141031b0 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.889+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd30c004040 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.890+0000 7fd311ffb640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 0x7fd2fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.890+0000 7fd318a79640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 0x7fd2fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.890+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fd30c0f00f0 con 0x7fd314108300 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.890+0000 7fd318a79640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 0x7fd2fc0a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3040058c0 tx=0x7fd30400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:32.893+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd30c0bd060 con 0x7fd314108300 2024-09-10T11:50:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.106+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd31410a290 con 0x7fd314108300 2024-09-10T11:50:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.107+0000 7fd311ffb640 1 -- 172.21.15.17:0/1635984709 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11960 (secure 0 0 0) 0x7fd30c0bc960 con 0x7fd314108300 2024-09-10T11:50:33.109 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:50:33.109 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-09-10T11:50:03:364278+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3226558545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3226558545},{"type":"v1","addr":"172.21.15.17:6835","nonce":3226558545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3582550652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3582550652},{"type":"v1","addr":"172.21.15.17:6837","nonce":3582550652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T11:40:40.061818+0000","modified":"2024-09-10T11:50:02.676692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24523,"mds_1":24512,"mds_2":24508,"mds_3":24496,"mds_4":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/2696186701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2696186701},{"type":"v1","addr":"172.21.15.17:6839","nonce":2696186701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6841/1429826923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":1429826923},{"type":"v1","addr":"172.21.15.17:6841","nonce":1429826923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6833/3177397418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3177397418},{"type":"v1","addr":"172.21.15.26:6833","nonce":3177397418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/230246363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":230246363},{"type":"v1","addr":"172.21.15.81:6833","nonce":230246363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.26:6835/3091242502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3091242502},{"type":"v1","addr":"172.21.15.26:6835","nonce":3091242502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/2783390333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":2783390333},{"type":"v1","addr":"172.21.15.26:6837","nonce":2783390333}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.81:6835/997801833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":997801833},{"type":"v1","addr":"172.21.15.81:6835","nonce":997801833}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/4227780996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":4227780996},{"type":"v1","addr":"172.21.15.81:6837","nonce":4227780996}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.26:6839/1530868796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1530868796},{"type":"v1","addr":"172.21.15.26:6839","nonce":1530868796}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/193630272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":193630272},{"type":"v1","addr":"172.21.15.81:6839","nonce":193630272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24523,"qdb_cluster":[24485,24496,24508,24512,24523]},"id":1}]} 2024-09-10T11:50:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 msgr2=0x7fd2fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 0x7fd2fc0a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3040058c0 tx=0x7fd30400a2d0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 msgr2=0x7fd31419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009ca0 tx=0x7fd30c02f3b0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 shutdown_connections 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fd2fc0a2b80 0x7fd2fc0a5040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd314108300 0x7fd31419ce60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd314103780 0x7fd314198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 --2- 172.21.15.17:0/1635984709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd314102dd0 0x7fd314198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 >> 172.21.15.17:0/1635984709 conn(0x7fd3140fc7d0 msgr2=0x7fd314105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 shutdown_connections 2024-09-10T11:50:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:33.110+0000 7fd31acdd640 1 -- 172.21.15.17:0/1635984709 wait complete. 2024-09-10T11:50:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:33 smithi081 ceph-mon[35059]: pgmap v575: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:33.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:33 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1635984709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:33.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:33 smithi026 ceph-mon[34817]: pgmap v575: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:33.755 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:33 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1635984709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:33 smithi017 ceph-mon[30817]: pgmap v575: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T11:50:33.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:33 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1635984709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T11:50:33.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T11:50:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 -- 172.21.15.17:0/2576901431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c102790 msgr2=0x7fbc2c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 --2- 172.21.15.17:0/2576901431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c102790 0x7fbc2c1067e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009900 tx=0x7fbc2002a410 comp rx=0 tx=0).stop 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 -- 172.21.15.17:0/2576901431 shutdown_connections 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 --2- 172.21.15.17:0/2576901431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 0x7fbc2c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 --2- 172.21.15.17:0/2576901431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c102790 0x7fbc2c1067e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 --2- 172.21.15.17:0/2576901431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c101de0 0x7fbc2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 -- 172.21.15.17:0/2576901431 >> 172.21.15.17:0/2576901431 conn(0x7fbc2c0fd8c0 msgr2=0x7fbc2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 -- 172.21.15.17:0/2576901431 shutdown_connections 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.626+0000 7fbc3409c640 1 -- 172.21.15.17:0/2576901431 wait complete. 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 Processor -- start 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 -- start start 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c102790 0x7fbc2c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 0x7fbc2c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c111f70 con 0x7fbc2c101de0 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c111df0 con 0x7fbc2c106f10 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc3409c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c1120f0 con 0x7fbc2c102790 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc31e38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc31e38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50806/0 (socket says 172.21.15.17:50806) 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc31e38640 1 -- 172.21.15.17:0/3273595182 learned_addr learned my addr 172.21.15.17:0/3273595182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.627+0000 7fbc31637640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c102790 0x7fbc2c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc32639640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 0x7fbc2c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 -- 172.21.15.17:0/3273595182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c102790 msgr2=0x7fbc2c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c102790 0x7fbc2c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 -- 172.21.15.17:0/3273595182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 msgr2=0x7fbc2c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 0x7fbc2c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 -- 172.21.15.17:0/3273595182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c19d4c0 con 0x7fbc2c101de0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc31e38640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e9f0 tx=0x7fbc2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400cd80 con 0x7fbc2c101de0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc24005500 con 0x7fbc2c101de0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c19d7b0 con 0x7fbc2c101de0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24010690 con 0x7fbc2c101de0 2024-09-10T11:50:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.628+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c1a5090 con 0x7fbc2c101de0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.629+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c1021c0 con 0x7fbc2c101de0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.630+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbc240046c0 con 0x7fbc2c101de0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.631+0000 7fbc2affd640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 0x7fbc140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.631+0000 7fbc31637640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 0x7fbc140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.631+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fbc240cf4c0 con 0x7fbc2c101de0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.632+0000 7fbc31637640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 0x7fbc140a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009230 tx=0x7fbc200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.635+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc2409c430 con 0x7fbc2c101de0 2024-09-10T11:50:34.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:34 smithi026 ceph-mon[34817]: pgmap v576: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T11:50:34.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:34 smithi017 ceph-mon[30817]: pgmap v576: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T11:50:34.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.814+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc2c10a150 con 0x7fbc2c101de0 2024-09-10T11:50:34.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.815+0000 7fbc2affd640 1 -- 172.21.15.17:0/3273595182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22612 (secure 0 0 0) 0x7fbc2409bd30 con 0x7fbc2c101de0 2024-09-10T11:50:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T11:50:34.817 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"44611ec8-6f68-11ef-bcea-c7b262605968","created":"2024-09-10T11:32:58.310121+0000","modified":"2024-09-10T11:40:54.542676+0000","last_up_change":"2024-09-10T11:39:50.260455+0000","last_in_change":"2024-09-10T11:39:26.530843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:36:09.827861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:40:36.301628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:40:38.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cb884aa2-728d-4f58-b002-3bd444435819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6803","nonce":3742829700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6805","nonce":3742829700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6809","nonce":3742829700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3742829700},{"type":"v1","addr":"172.21.15.17:6807","nonce":3742829700}]},"public_addr":"172.21.15.17:6803/3742829700","cluster_addr":"172.21.15.17:6805/3742829700","heartbeat_back_addr":"172.21.15.17:6809/3742829700","heartbeat_front_addr":"172.21.15.17:6807/3742829700","state":["exists","up"]},{"osd":1,"uuid":"097fdd5d-de3c-4a64-83c4-0841e483863b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6801","nonce":3714938498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6803","nonce":3714938498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6807","nonce":3714938498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3714938498},{"type":"v1","addr":"172.21.15.26:6805","nonce":3714938498}]},"public_addr":"172.21.15.26:6801/3714938498","cluster_addr":"172.21.15.26:6803/3714938498","heartbeat_back_addr":"172.21.15.26:6807/3714938498","heartbeat_front_addr":"172.21.15.26:6805/3714938498","state":["exists","up"]},{"osd":2,"uuid":"b13f41eb-280d-4533-bea8-6b7793493dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6801","nonce":318742081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6803","nonce":318742081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6807","nonce":318742081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":318742081},{"type":"v1","addr":"172.21.15.81:6805","nonce":318742081}]},"public_addr":"172.21.15.81:6801/318742081","cluster_addr":"172.21.15.81:6803/318742081","heartbeat_back_addr":"172.21.15.81:6807/318742081","heartbeat_front_addr":"172.21.15.81:6805/318742081","state":["exists","up"]},{"osd":3,"uuid":"87dcd823-ec3a-4980-a67c-12cf81196b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6811","nonce":3673598588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6813","nonce":3673598588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6817","nonce":3673598588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3673598588},{"type":"v1","addr":"172.21.15.17:6815","nonce":3673598588}]},"public_addr":"172.21.15.17:6811/3673598588","cluster_addr":"172.21.15.17:6813/3673598588","heartbeat_back_addr":"172.21.15.17:6817/3673598588","heartbeat_front_addr":"172.21.15.17:6815/3673598588","state":["exists","up"]},{"osd":4,"uuid":"8257cbe0-747a-4bcd-8aa4-1e78c14c151f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6809","nonce":1261155050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6811","nonce":1261155050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6815","nonce":1261155050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":1261155050},{"type":"v1","addr":"172.21.15.26:6813","nonce":1261155050}]},"public_addr":"172.21.15.26:6809/1261155050","cluster_addr":"172.21.15.26:6811/1261155050","heartbeat_back_addr":"172.21.15.26:6815/1261155050","heartbeat_front_addr":"172.21.15.26:6813/1261155050","state":["exists","up"]},{"osd":5,"uuid":"f15ffb10-de2f-44fc-9a53-676c63a25e4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6809","nonce":2098201169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6811","nonce":2098201169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6815","nonce":2098201169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2098201169},{"type":"v1","addr":"172.21.15.81:6813","nonce":2098201169}]},"public_addr":"172.21.15.81:6809/2098201169","cluster_addr":"172.21.15.81:6811/2098201169","heartbeat_back_addr":"172.21.15.81:6815/2098201169","heartbeat_front_addr":"172.21.15.81:6813/2098201169","state":["exists","up"]},{"osd":6,"uuid":"ac8679de-8c70-44cb-b0bf-528b334c3e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6819","nonce":3749111347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6821","nonce":3749111347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6825","nonce":3749111347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3749111347},{"type":"v1","addr":"172.21.15.17:6823","nonce":3749111347}]},"public_addr":"172.21.15.17:6819/3749111347","cluster_addr":"172.21.15.17:6821/3749111347","heartbeat_back_addr":"172.21.15.17:6825/3749111347","heartbeat_front_addr":"172.21.15.17:6823/3749111347","state":["exists","up"]},{"osd":7,"uuid":"57a224a6-f735-4d6a-ac05-574a5b979db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6817","nonce":2390923493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6819","nonce":2390923493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6823","nonce":2390923493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":2390923493},{"type":"v1","addr":"172.21.15.26:6821","nonce":2390923493}]},"public_addr":"172.21.15.26:6817/2390923493","cluster_addr":"172.21.15.26:6819/2390923493","heartbeat_back_addr":"172.21.15.26:6823/2390923493","heartbeat_front_addr":"172.21.15.26:6821/2390923493","state":["exists","up"]},{"osd":8,"uuid":"8ba82601-c53f-4ac8-a80d-b3432adeee27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6817","nonce":476521742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6819","nonce":476521742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6823","nonce":476521742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":476521742},{"type":"v1","addr":"172.21.15.81:6821","nonce":476521742}]},"public_addr":"172.21.15.81:6817/476521742","cluster_addr":"172.21.15.81:6819/476521742","heartbeat_back_addr":"172.21.15.81:6823/476521742","heartbeat_front_addr":"172.21.15.81:6821/476521742","state":["exists","up"]},{"osd":9,"uuid":"e8603dea-46ab-4afe-a9e8-4e443d826420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6827","nonce":356908580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6829","nonce":356908580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6833","nonce":356908580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":356908580},{"type":"v1","addr":"172.21.15.17:6831","nonce":356908580}]},"public_addr":"172.21.15.17:6827/356908580","cluster_addr":"172.21.15.17:6829/356908580","heartbeat_back_addr":"172.21.15.17:6833/356908580","heartbeat_front_addr":"172.21.15.17:6831/356908580","state":["exists","up"]},{"osd":10,"uuid":"dcd1f56e-b6ac-4db6-aff0-f2dc33cafcec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6825","nonce":926527219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6827","nonce":926527219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6831","nonce":926527219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":926527219},{"type":"v1","addr":"172.21.15.26:6829","nonce":926527219}]},"public_addr":"172.21.15.26:6825/926527219","cluster_addr":"172.21.15.26:6827/926527219","heartbeat_back_addr":"172.21.15.26:6831/926527219","heartbeat_front_addr":"172.21.15.26:6829/926527219","state":["exists","up"]},{"osd":11,"uuid":"f1eceb2e-7cf2-4177-94e7-67fe68ea78a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6825","nonce":2880107876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6827","nonce":2880107876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6831","nonce":2880107876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2880107876},{"type":"v1","addr":"172.21.15.81:6829","nonce":2880107876}]},"public_addr":"172.21.15.81:6825/2880107876","cluster_addr":"172.21.15.81:6827/2880107876","heartbeat_back_addr":"172.21.15.81:6831/2880107876","heartbeat_front_addr":"172.21.15.81:6829/2880107876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:16.758068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:35:41.385214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:06.241865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:30.943611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:36:56.061665+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:20.840527+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:37:45.661642+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:10.520445+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:34.416153+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:59.158556+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:23.286499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:39:48.242447+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2483128501":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6800/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:6801/2456904864":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/2953600041":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/456613680":"2024-09-11T11:33:53.328197+0000","172.21.15.17:0/710238438":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6801/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:6800/817290704":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/25951598":"2024-09-11T11:33:29.648083+0000","172.21.15.17:0/2863615588":"2024-09-11T11:33:29.648083+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.817+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 msgr2=0x7fbc140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.817+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 0x7fbc140a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009230 tx=0x7fbc200058d0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.817+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 msgr2=0x7fbc2c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.817+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e9f0 tx=0x7fbc2400edf0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 shutdown_connections 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7fbc140a2b80 0x7fbc140a5040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc2c102790 0x7fbc2c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc2c106f10 0x7fbc2c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 --2- 172.21.15.17:0/3273595182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c101de0 0x7fbc2c198510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 >> 172.21.15.17:0/3273595182 conn(0x7fbc2c0fd8c0 msgr2=0x7fbc2c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 shutdown_connections 2024-09-10T11:50:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:34.818+0000 7fbc3409c640 1 -- 172.21.15.17:0/3273595182 wait complete. 2024-09-10T11:50:34.955 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:34 smithi081 ceph-mon[35059]: pgmap v576: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-10T11:50:35.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T11:50:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:35.754 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:35 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3273595182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:35.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:35 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3273595182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:35.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:35 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3273595182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 -- 172.21.15.17:0/1807494214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc1027a0 msgr2=0x7f2fcc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/1807494214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1067f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009900 tx=0x7f2fb802a3f0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 -- 172.21.15.17:0/1807494214 shutdown_connections 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/1807494214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 0x7f2fcc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/1807494214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1067f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/1807494214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 -- 172.21.15.17:0/1807494214 >> 172.21.15.17:0/1807494214 conn(0x7f2fcc0fd8f0 msgr2=0x7f2fcc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 -- 172.21.15.17:0/1807494214 shutdown_connections 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.251+0000 7f2fd2bad640 1 -- 172.21.15.17:0/1807494214 wait complete. 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 Processor -- start 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 -- start start 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 0x7f2fcc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111fa0 con 0x7f2fcc101df0 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc111e20 con 0x7f2fcc1027a0 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd2bad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc112120 con 0x7f2fcc106f20 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd0949640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd0949640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50826/0 (socket says 172.21.15.17:50826) 2024-09-10T11:50:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd0949640 1 -- 172.21.15.17:0/289224040 learned_addr learned my addr 172.21.15.17:0/289224040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fd114a640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 0x7f2fcc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.252+0000 7f2fcbfff640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 -- 172.21.15.17:0/289224040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 msgr2=0x7f2fcc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 0x7f2fcc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 -- 172.21.15.17:0/289224040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc1027a0 msgr2=0x7f2fcc1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 -- 172.21.15.17:0/289224040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc19d450 con 0x7f2fcc101df0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd0949640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000b4a0 tx=0x7f2fc000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0014070 con 0x7f2fcc101df0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc0010af0 con 0x7f2fcc101df0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc19d740 con 0x7f2fcc101df0 2024-09-10T11:50:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0017d10 con 0x7f2fcc101df0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.253+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1a5020 con 0x7f2fcc101df0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.254+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc1021d0 con 0x7f2fcc101df0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.255+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2fc0017070 con 0x7f2fcc101df0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.256+0000 7f2fc9ffb640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 0x7f2fbc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.256+0000 7f2fcbfff640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 0x7f2fbc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.256+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f2fc00ce270 con 0x7f2fcc101df0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.257+0000 7f2fcbfff640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 0x7f2fbc0a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000c00 tx=0x7f2fb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.260+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fc009ab90 con 0x7f2fcc101df0 2024-09-10T11:50:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.475+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2fcc10a100 con 0x7f2fcc101df0 2024-09-10T11:50:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.477+0000 7f2fc9ffb640 1 -- 172.21.15.17:0/289224040 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f2fc009ee90 con 0x7f2fcc101df0 2024-09-10T11:50:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 msgr2=0x7f2fbc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 0x7f2fbc0a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000c00 tx=0x7f2fb80058d0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 msgr2=0x7f2fcc1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000b4a0 tx=0x7f2fc000b960 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 shutdown_connections 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f2fbc0a2c00 0x7f2fbc0a50c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fcc106f20 0x7f2fcc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fcc1027a0 0x7f2fcc1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.481+0000 7f2fd2bad640 1 --2- 172.21.15.17:0/289224040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fcc101df0 0x7f2fcc1984a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.482+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 >> 172.21.15.17:0/289224040 conn(0x7f2fcc0fd8f0 msgr2=0x7f2fcc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.482+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 shutdown_connections 2024-09-10T11:50:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:36.482+0000 7f2fd2bad640 1 -- 172.21.15.17:0/289224040 wait complete. 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a[30813]: 2024-09-10T11:50:36.476+0000 7fe0810dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: pgmap v577: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:50:36.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mon[30817]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mds[71495]: -- 172.21.15.17:0/1158953472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bbae459860 con 0x55bbae437000 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: starting mds.a at 2024-09-10T11:50:36.773 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.774 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.774 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-mds[71081]: -- 172.21.15.17:0/3495247124 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55627bed9c20 con 0x55627beb6800 2024-09-10T11:50:36.774 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:50:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: starting mds.g at 2024-09-10T11:50:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: pgmap v577: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T11:50:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:50:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:50:36.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mon[35059]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mds[65048]: -- 172.21.15.81:0/3447999543 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629cee67860 con 0x5629cee45400 2024-09-10T11:50:36.954 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: starting mds.c at 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mds[64747]: -- 172.21.15.81:0/3109770969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee168d3860 con 0x55ee168b0800 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: starting mds.f at 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mds[65348]: -- 172.21.15.81:0/1242223474 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c761445860 con 0x55c761422800 2024-09-10T11:50:36.955 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: starting mds.i at 2024-09-10T11:50:36.956 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:36.956 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:36.956 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mds[64448]: -- 172.21.15.81:0/3105962713 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564b50602680 con 0x564b505d6800 2024-09-10T11:50:36.956 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-mds[64448]: -- 172.21.15.81:0/3105962713 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b505f9860 con 0x564b505d6800 2024-09-10T11:50:36.956 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:50:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: starting mds.l at 2024-09-10T11:50:37.004 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mds[64435]: -- 172.21.15.26:0/776065478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b44321b860 con 0x55b4431f8800 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: starting mds.k at 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mds[64748]: -- 172.21.15.26:0/1911386749 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5638b41e3860 con 0x5638b41c1000 2024-09-10T11:50:37.005 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: starting mds.e at 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: starting mds.h at 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: pgmap v577: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/289224040' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T11:50:37.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T11:50:37.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mon[34817]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T11:50:37.007 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: ignoring --setuser ceph since I am not root 2024-09-10T11:50:37.007 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: ignoring --setgroup ceph since I am not root 2024-09-10T11:50:37.007 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-mds[65351]: -- 172.21.15.26:0/1211958719 <== mon.2 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55defdce1860 con 0x55defdcbe800 2024-09-10T11:50:37.007 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:50:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: starting mds.b at 2024-09-10T11:50:37.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T11:50:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 -- 172.21.15.17:0/2811878425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4106a60 msgr2=0x7f6cd4106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/2811878425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4106a60 0x7f6cd4106e40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009930 tx=0x7f6cd002a420 comp rx=0 tx=0).stop 2024-09-10T11:50:37.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 -- 172.21.15.17:0/2811878425 shutdown_connections 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/2811878425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4101400 0x7f6cd410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/2811878425 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4100a60 0x7f6cd4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/2811878425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4106a60 0x7f6cd4106e40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 -- 172.21.15.17:0/2811878425 >> 172.21.15.17:0/2811878425 conn(0x7f6cd40fc780 msgr2=0x7f6cd40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 -- 172.21.15.17:0/2811878425 shutdown_connections 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.936+0000 7f6cdb77c640 1 -- 172.21.15.17:0/2811878425 wait complete. 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 Processor -- start 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 -- start start 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4101400 0x7f6cd4198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 0x7f6cd419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4110e20 con 0x7f6cd4100a60 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4110ca0 con 0x7f6cd4101400 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cdb77c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4110fa0 con 0x7f6cd4106a60 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cd9518640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cd9518640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50862/0 (socket says 172.21.15.17:50862) 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cd9518640 1 -- 172.21.15.17:0/538041287 learned_addr learned my addr 172.21.15.17:0/538041287 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cd8d17640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4101400 0x7f6cd4198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.937+0000 7f6cd9d19640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 0x7f6cd419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 -- 172.21.15.17:0/538041287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 msgr2=0x7f6cd419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 0x7f6cd419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 -- 172.21.15.17:0/538041287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4101400 msgr2=0x7f6cd4198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4101400 0x7f6cd4198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 -- 172.21.15.17:0/538041287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd419d3b0 con 0x7f6cd4100a60 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9d19640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 0x7f6cd419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:50:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cd9518640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009230 tx=0x7f6cd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd003f030 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd419d640 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cd0003ad0 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0035070 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.938+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd41a4f80 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.939+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd41021a0 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.940+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6cd0042030 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.941+0000 7f6cca7fc640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 0x7f6cc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.941+0000 7f6cd8d17640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 0x7f6cc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.941+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8641+0+0 (secure 0 0 0) 0x7f6cd00ef890 con 0x7f6cd4100a60 2024-09-10T11:50:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.941+0000 7f6cd8d17640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 0x7f6cc00a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406b7e0 tx=0x7f6cc400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:37.945+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cd00bc630 con 0x7f6cd4100a60 2024-09-10T11:50:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.155+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6cd41a5150 con 0x7f6cd4100a60 2024-09-10T11:50:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.514+0000 7f6cca7fc640 1 -- 172.21.15.17:0/538041287 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f6cd00bbf30 con 0x7f6cd4100a60 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 msgr2=0x7f6cc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 0x7f6cc00a5040 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406b7e0 tx=0x7f6cc400a2d0 comp rx=0 tx=0).stop 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 msgr2=0x7f6cd4198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009230 tx=0x7f6cd0004270 comp rx=0 tx=0).stop 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 shutdown_connections 2024-09-10T11:50:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f6cc00a2b80 0x7f6cc00a5040 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cd4106a60 0x7f6cd419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6cd4101400 0x7f6cd4198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 --2- 172.21.15.17:0/538041287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd4100a60 0x7f6cd4198400 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 >> 172.21.15.17:0/538041287 conn(0x7f6cd40fc780 msgr2=0x7f6cd4104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 shutdown_connections 2024-09-10T11:50:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:38.517+0000 7f6cdb77c640 1 -- 172.21.15.17:0/538041287 wait complete. 2024-09-10T11:50:38.770 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6838/2283975992,v1:172.21.15.17:6840/2283975992] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.17:6839/2426025696,v1:172.21.15.17:6841/2426025696] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6832/1180210765,v1:172.21.15.81:6834/1180210765] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6832/2111797353,v1:172.21.15.26:6835/2111797353] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6833/1395705142,v1:172.21.15.81:6835/1395705142] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6833/557046988,v1:172.21.15.26:6834/557046988] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6836/2036872320,v1:172.21.15.81:6838/2036872320] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.81:6837/1715394560,v1:172.21.15.81:6839/1715394560] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6836/100148064,v1:172.21.15.26:6838/100148064] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: mds.? [v2:172.21.15.26:6837/3963962968,v1:172.21.15.26:6839/3963962968] up:boot 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T11:50:38.771 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: pgmap v579: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:38.772 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:38 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6838/2283975992,v1:172.21.15.17:6840/2283975992] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.17:6839/2426025696,v1:172.21.15.17:6841/2426025696] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6832/1180210765,v1:172.21.15.81:6834/1180210765] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6832/2111797353,v1:172.21.15.26:6835/2111797353] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6833/1395705142,v1:172.21.15.81:6835/1395705142] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6833/557046988,v1:172.21.15.26:6834/557046988] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6836/2036872320,v1:172.21.15.81:6838/2036872320] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.81:6837/1715394560,v1:172.21.15.81:6839/1715394560] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6836/100148064,v1:172.21.15.26:6838/100148064] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: mds.? [v2:172.21.15.26:6837/3963962968,v1:172.21.15.26:6839/3963962968] up:boot 2024-09-10T11:50:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: pgmap v579: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:38 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6838/2283975992,v1:172.21.15.17:6840/2283975992] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.17:6839/2426025696,v1:172.21.15.17:6841/2426025696] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6832/1180210765,v1:172.21.15.81:6834/1180210765] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6832/2111797353,v1:172.21.15.26:6835/2111797353] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6833/1395705142,v1:172.21.15.81:6835/1395705142] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6833/557046988,v1:172.21.15.26:6834/557046988] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6836/2036872320,v1:172.21.15.81:6838/2036872320] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.81:6837/1715394560,v1:172.21.15.81:6839/1715394560] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6836/100148064,v1:172.21.15.26:6838/100148064] up:boot 2024-09-10T11:50:39.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: mds.? [v2:172.21.15.26:6837/3963962968,v1:172.21.15.26:6839/3963962968] up:boot 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T11:50:39.006 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T11:50:39.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='mgr.14150 172.21.15.17:0/1490392321' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T11:50:39.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: pgmap v579: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:39.007 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:38 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T11:50:39.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T11:50:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:39.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:39 smithi017 ceph-mon[30817]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:50:39.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:39 smithi017 ceph-mon[30817]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:50:39.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:39 smithi017 ceph-mon[30817]: Cluster is now healthy 2024-09-10T11:50:39.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:39 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:50:39.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:39 smithi017 ceph-mon[30817]: fsmap 12 up:standby 2024-09-10T11:50:39.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 -- 172.21.15.17:0/1880064710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8100a80 msgr2=0x7f06e8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 --2- 172.21.15.17:0/1880064710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8100a80 0x7f06e8100ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009930 tx=0x7f06d002a420 comp rx=0 tx=0).stop 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 -- 172.21.15.17:0/1880064710 shutdown_connections 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 --2- 172.21.15.17:0/1880064710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8101420 0x7f06e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 --2- 172.21.15.17:0/1880064710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8100a80 0x7f06e8100ee0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 --2- 172.21.15.17:0/1880064710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8106a80 0x7f06e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 -- 172.21.15.17:0/1880064710 >> 172.21.15.17:0/1880064710 conn(0x7f06e80fc7a0 msgr2=0x7f06e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 -- 172.21.15.17:0/1880064710 shutdown_connections 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.931+0000 7f06ed637640 1 -- 172.21.15.17:0/1880064710 wait complete. 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 Processor -- start 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 -- start start 2024-09-10T11:50:39.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8100a80 0x7f06e8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 0x7f06e8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8110e40 con 0x7f06e8106a80 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8110cc0 con 0x7f06e8100a80 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06ed637640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8110fc0 con 0x7f06e8101420 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06de7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 0x7f06e8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50870/0 (socket says 172.21.15.17:50870) 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06e6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8100a80 0x7f06e8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.932+0000 7f06e77fe640 1 -- 172.21.15.17:0/1412667257 learned_addr learned my addr 172.21.15.17:0/1412667257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 -- 172.21.15.17:0/1412667257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 msgr2=0x7f06e8102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 0x7f06e8102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 -- 172.21.15.17:0/1412667257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8100a80 msgr2=0x7f06e8102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8100a80 0x7f06e8102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 -- 172.21.15.17:0/1412667257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81a6920 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06de7fc640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 0x7f06e8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e77fe640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f06e000eaa0 tx=0x7f06e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e000cdb0 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e0005020 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81a6c10 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00116b0 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.933+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81a7120 con 0x7f06e8106a80 2024-09-10T11:50:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.934+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8100ee0 con 0x7f06e8106a80 2024-09-10T11:50:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.935+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06e0005560 con 0x7f06e8106a80 2024-09-10T11:50:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.936+0000 7f06e4ff9640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 0x7f06d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.936+0000 7f06e6ffd640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 0x7f06d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.936+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8641+0+0 (secure 0 0 0) 0x7f06e00cf6a0 con 0x7f06e8106a80 2024-09-10T11:50:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.937+0000 7f06e6ffd640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 0x7f06d40a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009b50 tx=0x7f06d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:39.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:39.939+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06e0016030 con 0x7f06e8106a80 2024-09-10T11:50:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:39 smithi081 ceph-mon[35059]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:50:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:39 smithi081 ceph-mon[35059]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:50:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:39 smithi081 ceph-mon[35059]: Cluster is now healthy 2024-09-10T11:50:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:39 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:50:39.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:39 smithi081 ceph-mon[35059]: fsmap 12 up:standby 2024-09-10T11:50:40.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:39 smithi026 ceph-mon[34817]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T11:50:40.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:39 smithi026 ceph-mon[34817]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T11:50:40.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:39 smithi026 ceph-mon[34817]: Cluster is now healthy 2024-09-10T11:50:40.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:39 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/538041287' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T11:50:40.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:39 smithi026 ceph-mon[34817]: fsmap 12 up:standby 2024-09-10T11:50:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.114+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f06e8103b80 con 0x7f06e8106a80 2024-09-10T11:50:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.530+0000 7f06e4ff9640 1 -- 172.21.15.17:0/1412667257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f06e8103b80 con 0x7f06e8106a80 2024-09-10T11:50:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T11:50:40.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 msgr2=0x7f06d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:40.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 0x7f06d40a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009b50 tx=0x7f06d8005f90 comp rx=0 tx=0).stop 2024-09-10T11:50:40.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 msgr2=0x7f06e81030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:40.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f06e000eaa0 tx=0x7f06e000ef60 comp rx=0 tx=0).stop 2024-09-10T11:50:40.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 shutdown_connections 2024-09-10T11:50:40.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f06d40a2c00 0x7f06d40a50c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e8101420 0x7f06e8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8106a80 0x7f06e81030d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 --2- 172.21.15.17:0/1412667257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06e8100a80 0x7f06e8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.533+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 >> 172.21.15.17:0/1412667257 conn(0x7f06e80fc7a0 msgr2=0x7f06e8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.534+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 shutdown_connections 2024-09-10T11:50:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:40.534+0000 7f06ed637640 1 -- 172.21.15.17:0/1412667257 wait complete. 2024-09-10T11:50:40.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:40 smithi017 ceph-mon[30817]: pgmap v580: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:40.772 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:40 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:40 smithi081 ceph-mon[35059]: pgmap v580: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:40.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:40 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:41.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:40 smithi026 ceph-mon[34817]: pgmap v580: 97 pgs: 97 active+clean; 57 MiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T11:50:41.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:40 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:41.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T11:50:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T11:50:41.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:41 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:41.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:41 smithi017 ceph-mon[30817]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:50:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:41 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:41.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:41 smithi081 ceph-mon[35059]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:50:42.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:41 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/1412667257' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:42.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:41 smithi026 ceph-mon[34817]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T11:50:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- 172.21.15.17:0/3180978988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830102d40 msgr2=0x7f4830103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 --2- 172.21.15.17:0/3180978988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830102d40 0x7f4830103120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4820009900 tx=0x7f482002a480 comp rx=0 tx=0).stop 2024-09-10T11:50:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- 172.21.15.17:0/3180978988 shutdown_connections 2024-09-10T11:50:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 --2- 172.21.15.17:0/3180978988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f483010c170 0x7f483010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 --2- 172.21.15.17:0/3180978988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830103660 0x7f483010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 --2- 172.21.15.17:0/3180978988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830102d40 0x7f4830103120 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- 172.21.15.17:0/3180978988 >> 172.21.15.17:0/3180978988 conn(0x7f48300fc7a0 msgr2=0x7f48300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- 172.21.15.17:0/3180978988 shutdown_connections 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- 172.21.15.17:0/3180978988 wait complete. 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 Processor -- start 2024-09-10T11:50:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.095+0000 7f4836783640 1 -- start start 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 0x7f483019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f483010c170 0x7f483019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111f70 con 0x7f4830103660 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4830111df0 con 0x7f483010c170 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4836783640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48301120f0 con 0x7f4830102d40 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40152/0 (socket says 172.21.15.17:40152) 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 0x7f483019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482f7fe640 1 -- 172.21.15.17:0/3516253891 learned_addr learned my addr 172.21.15.17:0/3516253891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f4834d20640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f483010c170 0x7f483019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 -- 172.21.15.17:0/3516253891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f483010c170 msgr2=0x7f483019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f483010c170 0x7f483019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 -- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 msgr2=0x7f483019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 -- 172.21.15.17:0/3516253891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483019f5a0 con 0x7f4830102d40 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482f7fe640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.096+0000 7f482ffff640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 0x7f483019a5f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4820005940 tx=0x7f4820004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.097+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482003f030 con 0x7f4830102d40 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.097+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4820003ad0 con 0x7f4830102d40 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.097+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483019f830 con 0x7f4830102d40 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.097+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820035070 con 0x7f4830102d40 2024-09-10T11:50:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.097+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48301a7170 con 0x7f4830102d40 2024-09-10T11:50:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.098+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483006b070 con 0x7f4830102d40 2024-09-10T11:50:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.099+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4820042030 con 0x7f4830102d40 2024-09-10T11:50:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.099+0000 7f482d7fa640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 0x7f48180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:50:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.100+0000 7f482f7fe640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 0x7f48180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:50:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.100+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8145+0+0 (secure 0 0 0) 0x7f48200ef5a0 con 0x7f4830102d40 2024-09-10T11:50:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.100+0000 7f482f7fe640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 0x7f48180a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f483010ea90 tx=0x7f482400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:50:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.104+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48200bbeb0 con 0x7f4830102d40 2024-09-10T11:50:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.280+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4830103120 con 0x7f4830102d40 2024-09-10T11:50:42.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.548+0000 7f482d7fa640 1 -- 172.21.15.17:0/3516253891 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f48200c01b0 con 0x7f4830102d40 2024-09-10T11:50:42.551 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 msgr2=0x7f48180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 0x7f48180a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f483010ea90 tx=0x7f482400a2d0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 msgr2=0x7f483019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 0x7f483019a5f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4820005940 tx=0x7f4820004270 comp rx=0 tx=0).stop 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 shutdown_connections 2024-09-10T11:50:42.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:6800/3008774641,v1:172.21.15.17:6801/3008774641] conn(0x7f48180a2b80 0x7f48180a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f483010c170 0x7f483019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4830103660 0x7f483019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 --2- 172.21.15.17:0/3516253891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4830102d40 0x7f483019a5f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:50:42.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.554+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 >> 172.21.15.17:0/3516253891 conn(0x7f48300fc7a0 msgr2=0x7f483010d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:50:42.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.557+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 shutdown_connections 2024-09-10T11:50:42.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T11:50:42.559+0000 7f4836783640 1 -- 172.21.15.17:0/3516253891 wait complete. 2024-09-10T11:50:42.896 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:42 smithi017 ceph-mon[30817]: pgmap v582: 65 pgs: 65 active+clean; 577 KiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:50:42.896 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:42 smithi017 ceph-mon[30817]: from='client.? 172.21.15.17:0/3516253891' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:42.896 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:42 smithi017 ceph-mon[30817]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:42 smithi081 ceph-mon[35059]: pgmap v582: 65 pgs: 65 active+clean; 577 KiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:50:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:42 smithi081 ceph-mon[35059]: from='client.? 172.21.15.17:0/3516253891' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:42.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:42 smithi081 ceph-mon[35059]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:43.004 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:42 smithi026 ceph-mon[34817]: pgmap v582: 65 pgs: 65 active+clean; 577 KiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T11:50:43.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:42 smithi026 ceph-mon[34817]: from='client.? 172.21.15.17:0/3516253891' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:43.005 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:42 smithi026 ceph-mon[34817]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T11:50:43.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:50:43.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:50:43.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:50:43.294 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T11:50:43.294 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:50:43.310 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:50:43.325 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T11:50:43.349 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T11:50:43.349 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T11:50:43.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a 2024-09-10T11:50:43.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 systemd[1]: Stopping Ceph mon.a for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:43.830 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:43 smithi026 ceph-mon[34817]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:43.830 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:43 smithi026 ceph-mon[34817]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:50:43.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:43 smithi081 ceph-mon[35059]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:43.953 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:43 smithi081 ceph-mon[35059]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:50:43.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 ceph-mon[30817]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T11:50:43.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 ceph-mon[30817]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T11:50:43.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a[30813]: 2024-09-10T11:50:43.641+0000 7fe0868e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:43.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a[30813]: 2024-09-10T11:50:43.642+0000 7fe0868e8640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T11:50:43.977 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:43 smithi017 podman[98155]: 2024-09-10 11:50:43.683280617 +0000 UTC m=+0.143204654 container died 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:50:44.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:44 smithi017 podman[98155]: 2024-09-10 11:50:44.06655519 +0000 UTC m=+0.526479217 container cleanup 12bb9e07be0434817f666fee877df1734cbc1628259047198128bed48001356a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T11:50:44.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 10 11:50:44 smithi017 bash[98155]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-a 2024-09-10T11:50:44.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T11:50:44.522 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:44.522 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T11:50:44.522 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T11:50:44.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.b 2024-09-10T11:50:44.819 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:44 smithi026 systemd[1]: Stopping Ceph mon.b for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:45.157 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:44 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-b[34813]: 2024-09-10T11:50:44.839+0000 7fee139cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:45.157 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:44 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-b[34813]: 2024-09-10T11:50:44.839+0000 7fee139cd640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T11:50:45.157 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:44 smithi026 podman[68952]: 2024-09-10 11:50:44.900175755 +0000 UTC m=+0.187092400 container died 32ea2e4b196a6ddc841ce7c1002fd4fe2169a00fdc1b98b2c47a7ce01ecf850d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:50:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:45 smithi026 podman[68952]: 2024-09-10 11:50:45.372263853 +0000 UTC m=+0.659180489 container cleanup 32ea2e4b196a6ddc841ce7c1002fd4fe2169a00fdc1b98b2c47a7ce01ecf850d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T11:50:45.504 INFO:journalctl@ceph.mon.b.smithi026.stdout:Sep 10 11:50:45 smithi026 bash[68952]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-b 2024-09-10T11:50:45.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T11:50:45.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:45.847 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T11:50:45.847 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T11:50:45.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.c 2024-09-10T11:50:46.142 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:45 smithi081 systemd[1]: Stopping Ceph mon.c for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:46.453 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-c[35055]: 2024-09-10T11:50:46.140+0000 7fd20b40d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:46.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-c[35055]: 2024-09-10T11:50:46.140+0000 7fd20b40d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T11:50:46.454 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:46 smithi081 podman[68915]: 2024-09-10 11:50:46.262965161 +0000 UTC m=+0.218443406 container died 8eb946e014dc90483c30466d309aad5f8fc1f225cfa84b58317ed6b0d09dee57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T11:50:46.926 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:46 smithi081 podman[68915]: 2024-09-10 11:50:46.640693767 +0000 UTC m=+0.596172010 container cleanup 8eb946e014dc90483c30466d309aad5f8fc1f225cfa84b58317ed6b0d09dee57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:50:46.927 INFO:journalctl@ceph.mon.c.smithi081.stdout:Sep 10 11:50:46 smithi081 bash[68915]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mon-c 2024-09-10T11:50:47.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T11:50:47.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:47.121 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T11:50:47.121 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T11:50:47.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x 2024-09-10T11:50:47.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 systemd[1]: Stopping Ceph mgr.x for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:47.771 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:50:47.446+0000 7f60ca907640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:47.772 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x[31046]: 2024-09-10T11:50:47.446+0000 7f60ca907640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T11:50:47.772 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 podman[98280]: 2024-09-10 11:50:47.47698373 +0000 UTC m=+0.155130471 container died 7e7c8a1a0bd2dcbe2bc4d87c136dffb099d2d18f2361a71f8c6e4c87b0322bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:50:48.064 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 podman[98280]: 2024-09-10 11:50:47.879649264 +0000 UTC m=+0.557796002 container cleanup 7e7c8a1a0bd2dcbe2bc4d87c136dffb099d2d18f2361a71f8c6e4c87b0322bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:50:48.065 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:47 smithi017 bash[98280]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x 2024-09-10T11:50:48.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T11:50:48.335 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:48 smithi017 podman[98292]: 2024-09-10 11:50:48.064249458 +0000 UTC m=+0.583860158 container remove 7e7c8a1a0bd2dcbe2bc4d87c136dffb099d2d18f2361a71f8c6e4c87b0322bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:50:48.335 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:48 smithi017 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-10T11:50:48.336 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:48 smithi017 systemd[1]: Stopped Ceph mgr.x for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:50:48.336 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 10 11:50:48 smithi017 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.x.service: Consumed 45.260s CPU time. 2024-09-10T11:50:48.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:48.349 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T11:50:48.349 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T11:50:48.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.y 2024-09-10T11:50:48.673 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:50:48 smithi026 systemd[1]: Stopping Ceph mgr.y for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:48.970 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:50:48 smithi026 podman[69077]: 2024-09-10 11:50:48.672616396 +0000 UTC m=+0.127559398 container died cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T11:50:49.254 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:50:49 smithi026 podman[69077]: 2024-09-10 11:50:49.051476975 +0000 UTC m=+0.506419974 container cleanup cb5f776d2a08d4bde36c439980ae03a9eee13a63e2e14f8ba486563b27ee8b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-10T11:50:49.254 INFO:journalctl@ceph.mgr.y.smithi026.stdout:Sep 10 11:50:49 smithi026 bash[69077]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-y 2024-09-10T11:50:49.635 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T11:50:49.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:49.670 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T11:50:49.670 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T11:50:49.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.z 2024-09-10T11:50:49.953 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:50:49 smithi081 systemd[1]: Stopping Ceph mgr.z for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:50.288 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:50:49 smithi081 podman[69038]: 2024-09-10 11:50:49.975112723 +0000 UTC m=+0.121266991 container died a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:50:50.589 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:50:50 smithi081 podman[69038]: 2024-09-10 11:50:50.362613435 +0000 UTC m=+0.508767700 container cleanup a2abf571127abb27280c7146316692967e9789caf61637f289075815fca28568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T11:50:50.589 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Sep 10 11:50:50 smithi081 bash[69038]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mgr-z 2024-09-10T11:50:50.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T11:50:50.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:50.777 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T11:50:50.778 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T11:50:50.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.0 2024-09-10T11:50:51.076 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:50 smithi017 systemd[1]: Stopping Ceph osd.0 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:51.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:50:51.075+0000 7fd6e4437640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:51.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:50:51.075+0000 7fd6e4437640 -1 osd.0 89 *** Got signal Terminated *** 2024-09-10T11:50:51.522 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0[44860]: 2024-09-10T11:50:51.075+0000 7fd6e4437640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:50:56.986 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:56 smithi017 podman[98403]: 2024-09-10 11:50:56.693320299 +0000 UTC m=+5.715468202 container died 0a92d1b713bd1987176768be34f7d7fa49f29896d62026381336436ad344933a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T11:50:57.271 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98403]: 2024-09-10 11:50:57.092660496 +0000 UTC m=+6.114808388 container cleanup 0a92d1b713bd1987176768be34f7d7fa49f29896d62026381336436ad344933a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:50:57.272 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 bash[98403]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0 2024-09-10T11:50:57.712 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98419]: 2024-09-10 11:50:57.369162381 +0000 UTC m=+0.671461529 container remove 0a92d1b713bd1987176768be34f7d7fa49f29896d62026381336436ad344933a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:50:58.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98508]: 2024-09-10 11:50:57.711541413 +0000 UTC m=+0.102151948 container create 80160864ba1059defb14a6899727e4fc68b5c37f1f7ecad0657b234e9aed5d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:50:58.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98508]: 2024-09-10 11:50:57.625768945 +0000 UTC m=+0.016379493 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:50:58.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98508]: 2024-09-10 11:50:57.939088944 +0000 UTC m=+0.329699487 container init 80160864ba1059defb14a6899727e4fc68b5c37f1f7ecad0657b234e9aed5d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T11:50:58.022 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:57 smithi017 podman[98508]: 2024-09-10 11:50:57.942533792 +0000 UTC m=+0.333144326 container start 80160864ba1059defb14a6899727e4fc68b5c37f1f7ecad0657b234e9aed5d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T11:50:58.421 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:58 smithi017 podman[98508]: 2024-09-10 11:50:58.034986203 +0000 UTC m=+0.425596749 container attach 80160864ba1059defb14a6899727e4fc68b5c37f1f7ecad0657b234e9aed5d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T11:50:58.421 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 10 11:50:58 smithi017 podman[98508]: 2024-09-10 11:50:58.138828698 +0000 UTC m=+0.529439232 container died 80160864ba1059defb14a6899727e4fc68b5c37f1f7ecad0657b234e9aed5d82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T11:50:58.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T11:50:58.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:50:58.770 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T11:50:58.770 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T11:50:58.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.1 2024-09-10T11:50:59.065 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:50:58 smithi026 systemd[1]: Stopping Ceph osd.1 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:50:59.504 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:50:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:50:59.063+0000 7f0cb385d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:50:59.505 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:50:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:50:59.063+0000 7f0cb385d640 -1 osd.1 89 *** Got signal Terminated *** 2024-09-10T11:50:59.505 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:50:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1[39292]: 2024-09-10T11:50:59.063+0000 7f0cb385d640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:51:04.848 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:04 smithi026 podman[69200]: 2024-09-10 11:51:04.527826786 +0000 UTC m=+5.557275635 container died 6b6cb3fc519159e011a905302162dadd4589d274f8004d34b51613a998315d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T11:51:05.140 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:04 smithi026 podman[69200]: 2024-09-10 11:51:04.947281296 +0000 UTC m=+5.976730144 container cleanup 6b6cb3fc519159e011a905302162dadd4589d274f8004d34b51613a998315d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:51:05.141 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:04 smithi026 bash[69200]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1 2024-09-10T11:51:05.504 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69216]: 2024-09-10 11:51:05.139986113 +0000 UTC m=+0.608090571 container remove 6b6cb3fc519159e011a905302162dadd4589d274f8004d34b51613a998315d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T11:51:05.885 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69304]: 2024-09-10 11:51:05.478499908 +0000 UTC m=+0.016238051 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:51:05.885 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69304]: 2024-09-10 11:51:05.607896274 +0000 UTC m=+0.145634405 container create 2260773bede31bc1c4c4068e3b7b66f63b9a7e4b94edadfaddd416bf4ece5075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T11:51:05.885 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69304]: 2024-09-10 11:51:05.884849852 +0000 UTC m=+0.422587983 container init 2260773bede31bc1c4c4068e3b7b66f63b9a7e4b94edadfaddd416bf4ece5075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:51:06.255 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69304]: 2024-09-10 11:51:05.888178311 +0000 UTC m=+0.425916450 container start 2260773bede31bc1c4c4068e3b7b66f63b9a7e4b94edadfaddd416bf4ece5075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T11:51:06.255 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:05 smithi026 podman[69304]: 2024-09-10 11:51:05.968213589 +0000 UTC m=+0.505951726 container attach 2260773bede31bc1c4c4068e3b7b66f63b9a7e4b94edadfaddd416bf4ece5075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T11:51:06.255 INFO:journalctl@ceph.osd.1.smithi026.stdout:Sep 10 11:51:06 smithi026 podman[69304]: 2024-09-10 11:51:06.081475761 +0000 UTC m=+0.619213908 container died 2260773bede31bc1c4c4068e3b7b66f63b9a7e4b94edadfaddd416bf4ece5075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T11:51:06.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T11:51:06.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:51:06.733 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T11:51:06.736 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T11:51:06.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2 2024-09-10T11:51:07.017 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:06 smithi081 systemd[1]: Stopping Ceph osd.2 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:51:07.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:51:07.016+0000 7ff11d17e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:51:07.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:51:07.016+0000 7ff11d17e640 -1 osd.2 89 *** Got signal Terminated *** 2024-09-10T11:51:07.453 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2[40070]: 2024-09-10T11:51:07.016+0000 7ff11d17e640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:51:37.393 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 bash[69160]: time="2024-09-10T11:51:37Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2 in 30 seconds, resorting to SIGKILL" 2024-09-10T11:51:37.393 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 podman[69160]: 2024-09-10 11:51:37.129519206 +0000 UTC m=+30.213903258 container died 9487a9c87c2cf26e4ca1ba51f04d771d1c96db31151ff31dda0e62ba1aabc27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T11:51:37.665 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 podman[69160]: 2024-09-10 11:51:37.490752943 +0000 UTC m=+30.575136989 container cleanup 9487a9c87c2cf26e4ca1ba51f04d771d1c96db31151ff31dda0e62ba1aabc27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T11:51:37.665 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 bash[69160]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2 2024-09-10T11:51:37.953 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 podman[69179]: 2024-09-10 11:51:37.742198254 +0000 UTC m=+0.611415599 container remove 9487a9c87c2cf26e4ca1ba51f04d771d1c96db31151ff31dda0e62ba1aabc27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T11:51:37.953 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:37 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2.service: Main process exited, code=exited, status=137/n/a 2024-09-10T11:51:38.404 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:37.98855979 +0000 UTC m=+0.016874840 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:51:38.404 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:38.093150327 +0000 UTC m=+0.121465362 container create f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T11:51:38.405 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:38.329096289 +0000 UTC m=+0.357411325 container init f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T11:51:38.405 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:38.332334852 +0000 UTC m=+0.360649897 container start f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T11:51:38.703 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:38.404068572 +0000 UTC m=+0.432383624 container attach f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:51:38.703 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:38 smithi081 podman[69277]: 2024-09-10 11:51:38.527540499 +0000 UTC m=+0.555855545 container died f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:51:39.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T11:51:39.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:39 smithi081 podman[69302]: 2024-09-10 11:51:39.04936478 +0000 UTC m=+0.515566403 container remove f6f2aaa770a65f14814ef3193cdcee9445e414bea246228517e3dcb31ef27130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:51:39.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:39 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2.service: Failed with result 'exit-code'. 2024-09-10T11:51:39.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:39 smithi081 systemd[1]: Stopped Ceph osd.2 for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:51:39.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Sep 10 11:51:39 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.2.service: Consumed 6min 35.609s CPU time. 2024-09-10T11:51:39.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:51:39.107 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T11:51:39.107 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T11:51:39.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.3 2024-09-10T11:51:39.428 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:39 smithi017 systemd[1]: Stopping Ceph osd.3 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:51:39.710 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:51:39.426+0000 7fa4881cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:51:39.710 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:51:39.426+0000 7fa4881cc640 -1 osd.3 89 *** Got signal Terminated *** 2024-09-10T11:51:39.711 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3[51352]: 2024-09-10T11:51:39.426+0000 7fa4881cc640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:51:45.272 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:44 smithi017 podman[98620]: 2024-09-10 11:51:44.977521047 +0000 UTC m=+5.663999890 container died 41af02fcf013a0deea38a8efbe3dedac4f752e17e11414d5f0386111e805c65f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T11:51:45.771 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:45 smithi017 podman[98620]: 2024-09-10 11:51:45.551621916 +0000 UTC m=+6.238100756 container cleanup 41af02fcf013a0deea38a8efbe3dedac4f752e17e11414d5f0386111e805c65f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:51:45.772 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:45 smithi017 bash[98620]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3 2024-09-10T11:51:46.180 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:45 smithi017 podman[98649]: 2024-09-10 11:51:45.820261019 +0000 UTC m=+0.840694674 container remove 41af02fcf013a0deea38a8efbe3dedac4f752e17e11414d5f0386111e805c65f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T11:51:46.499 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.179562882 +0000 UTC m=+0.112687205 container create 1362b02431b5c4baab825e3ad3811b83213b6774fd6fc2e64d75135f8b825109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T11:51:46.499 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.083418902 +0000 UTC m=+0.016543194 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:51:46.499 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.390351702 +0000 UTC m=+0.323475982 container init 1362b02431b5c4baab825e3ad3811b83213b6774fd6fc2e64d75135f8b825109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T11:51:46.499 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.394031278 +0000 UTC m=+0.327155559 container start 1362b02431b5c4baab825e3ad3811b83213b6774fd6fc2e64d75135f8b825109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:51:46.500 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.498473667 +0000 UTC m=+0.431597963 container attach 1362b02431b5c4baab825e3ad3811b83213b6774fd6fc2e64d75135f8b825109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T11:51:46.772 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 10 11:51:46 smithi017 podman[98740]: 2024-09-10 11:51:46.588601474 +0000 UTC m=+0.521725767 container died 1362b02431b5c4baab825e3ad3811b83213b6774fd6fc2e64d75135f8b825109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T11:51:47.391 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T11:51:47.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:51:47.437 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T11:51:47.437 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T11:51:47.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.4 2024-09-10T11:51:47.731 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:47 smithi026 systemd[1]: Stopping Ceph osd.4 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:51:48.004 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:51:47.730+0000 7f0fabed1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:51:48.004 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:51:47.730+0000 7f0fabed1640 -1 osd.4 89 *** Got signal Terminated *** 2024-09-10T11:51:48.004 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4[46226]: 2024-09-10T11:51:47.730+0000 7f0fabed1640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:51:53.504 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:53 smithi026 podman[69427]: 2024-09-10 11:51:53.190227526 +0000 UTC m=+5.550915979 container died c0612471713e5b0300cabfffc4986d4d16b97501fdd25b4505412b78fa7a1c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:51:53.948 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:53 smithi026 podman[69427]: 2024-09-10 11:51:53.671699641 +0000 UTC m=+6.032388082 container cleanup c0612471713e5b0300cabfffc4986d4d16b97501fdd25b4505412b78fa7a1c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T11:51:53.948 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:53 smithi026 bash[69427]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4 2024-09-10T11:51:54.254 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:53 smithi026 podman[69443]: 2024-09-10 11:51:53.947970572 +0000 UTC m=+0.750402886 container remove c0612471713e5b0300cabfffc4986d4d16b97501fdd25b4505412b78fa7a1c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:51:54.593 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.298777802 +0000 UTC m=+0.112780644 container create a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T11:51:54.593 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.202204233 +0000 UTC m=+0.016207014 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:51:54.593 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.509187864 +0000 UTC m=+0.323190647 container init a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T11:51:54.593 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.512438557 +0000 UTC m=+0.326441346 container start a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux ) 2024-09-10T11:51:54.593 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.592538251 +0000 UTC m=+0.406541047 container attach a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:51:54.996 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:54 smithi026 podman[69530]: 2024-09-10 11:51:54.714201703 +0000 UTC m=+0.528204486 container died a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:51:55.254 INFO:journalctl@ceph.osd.4.smithi026.stdout:Sep 10 11:51:55 smithi026 podman[69552]: 2024-09-10 11:51:55.237561767 +0000 UTC m=+0.516450347 container remove a67888d3713939939723cc92e187bffe4380fa05c7af772f5d33ba1f8cd8f403 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:51:55.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T11:51:55.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:51:55.304 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T11:51:55.304 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T11:51:55.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.5 2024-09-10T11:51:55.595 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:51:55 smithi081 systemd[1]: Stopping Ceph osd.5 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:51:55.953 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:51:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:51:55.592+0000 7f628c659640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:51:55.953 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:51:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:51:55.592+0000 7f628c659640 -1 osd.5 89 *** Got signal Terminated *** 2024-09-10T11:51:55.953 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:51:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:51:55.592+0000 7f628c659640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:51:57.953 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:51:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:51:57.460+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:51:58.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:51:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:51:58.419+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:51:58.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:51:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:51:58.443+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:51:59.398 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:51:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:51:59.127+0000 7f6284c56640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.766085+0000 front 2024-09-10T11:50:54.766073+0000 (oldest deadline 2024-09-10T11:51:58.265814+0000) 2024-09-10T11:51:59.704 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:51:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:51:59.396+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:51:59.705 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:51:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:51:59.502+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:51:59.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:51:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:51:59.446+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:00.364 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5[46592]: 2024-09-10T11:52:00.081+0000 7f6284c56640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.766085+0000 front 2024-09-10T11:50:54.766073+0000 (oldest deadline 2024-09-10T11:51:58.265814+0000) 2024-09-10T11:52:00.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:00 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:00.031+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:00.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:00.363+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:00.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:00.455+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:00.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:00.456+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:01.006 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:00 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:00.688+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:01.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:01 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:01.005+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:01.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:01.375+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:01.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:01.463+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:01.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:01.418+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:01.978 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:01 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:01.648+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:02.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:01 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:01.977+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:02.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:02.373+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:02.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:02.440+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:02.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:02.462+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:03.003 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:02 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:02.685+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:03.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:03 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:03.002+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:03.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:03.391+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:03.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:03.470+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:03.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:03.499+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:03.995 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:03 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:03.721+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:04.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:03 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:03.994+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:04.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:04.438+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:04.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:04.481+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:04.755 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:04 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:04.484+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:05.024 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:04 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:04.962+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:05.025 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:04 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:04.736+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:05.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:05.426+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:05.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:05.477+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:06.001 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:05 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:05.532+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:06.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:05 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:05.980+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:06.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:05 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:05.733+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:06.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:05 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:05.733+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:06.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:06.407+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:06.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:06.407+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:06.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:06.465+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:06.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:06 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:06.489+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:07.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:06 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:06.950+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:07.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:06 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:06.725+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:07.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:06 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:06.725+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:07.429+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:07.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:07.422+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:07.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:07.422+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:08.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:07 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:07.520+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:08.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:07 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:07.962+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:08.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:07 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:07.962+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:08.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:07 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:07.728+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:08.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:07 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:07.728+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:08.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:08.411+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:08.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:08.411+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:08.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:08.442+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:08.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:08.442+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:08.959 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:08 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:08.957+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:08.959 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:08 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:08.957+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:08.959 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:08 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:08.707+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:08.959 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:08 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:08.707+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:09.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:08 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:08.566+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:09.881 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:09 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:09.612+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:09.881 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:09 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:09.612+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:09.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:09.462+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:09.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:09.462+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:09.954 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:09.460+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:09.954 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:09.460+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:09.991 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:09 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:09.662+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:09.991 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:09 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:09.662+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:10.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:09 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:09.880+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:10.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:09 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:09.989+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:10.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:09 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:09.989+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:10.448+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:10.448+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:10.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:10.462+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:10.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:10.462+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:10.855 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:10 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:10.564+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:10.855 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:10 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:10.564+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:10.985 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:10 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:10.678+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:10.985 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:10 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:10.678+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:11.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:10 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:10.853+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:11.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:10 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:10.984+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:11.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:10 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:10.984+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:11.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:11.458+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:11.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:11.458+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:11.954 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:11.457+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:11.954 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:11.457+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:11.984 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:11 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:11.694+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:11.984 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:11 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:11.694+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:12.004 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:11 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:11.846+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:12.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:11 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:11.602+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:12.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:11 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:11.602+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:12.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:11 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:11.982+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:12.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:11 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:11.982+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:12.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:12.431+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:12.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:12.431+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:12.487+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:12.487+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:12.897 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:12 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:12.576+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:12.897 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:12 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:12.576+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:12.957 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:12 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:12.674+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:12.957 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:12 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:12.674+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:13.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:12 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:12.895+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:13.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:12 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:12.955+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:13.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:12 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:12.955+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:13.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:13 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:13.450+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:13.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:13 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:13.450+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:13.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:13 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:13.458+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:13.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:13 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:13.458+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:13.876 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:13 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:13.598+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:13.876 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:13 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:13.598+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:13.877 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:13 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:13.874+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:14.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:13 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:13.919+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:14.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:13 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:13.919+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:14.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:13 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:13.686+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:14.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:13 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:13.686+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:14.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:14 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:14.457+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:14.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:14 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:14.457+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:14 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:14.436+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:14 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:14.436+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:14.910 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:14 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:14.636+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:14.910 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:14 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:14.636+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:15.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:14 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:14.882+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:15.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:14 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:14.882+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:15.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:14 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:14.648+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:15.023 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:14 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:14.648+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:15.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:14 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:14.908+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:15.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:15 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:15.415+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:15.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:15 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:15.415+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:15.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:15 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:15.405+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:15.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:15 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:15.405+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:15.906 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:15 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:15.643+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:15.906 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:15 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:15.643+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:16.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:15.893+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:16.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:15.893+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:16.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:15.669+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:16.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:15.669+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:16.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:15 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:15.905+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:16.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:16 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:16.414+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:16.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:16 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:16.414+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:16.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:16 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:16.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:16.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:16 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:16.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:16.934 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:16 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:16.634+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:16.934 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:16 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:16.634+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:16.935 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:16.651+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:16.935 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:16.651+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:17.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:16 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:16.932+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:17.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:16.934+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:17.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:16 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:16.934+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:17.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:17 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:17.402+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:17.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:17 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:17.402+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:17.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:17 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:17.393+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:17.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:17 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:17.393+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:17.960 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:17.686+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:17.960 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:17.686+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:17.979 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:17 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:17.632+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:17.979 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:17 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:17.632+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:18.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:17 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:17.978+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:18.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:17.959+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:18.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:17.959+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:18.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:18 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:18.403+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:18.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:18 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:18.403+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:18.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:18 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:18.425+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:18.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:18 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:18.425+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:18.955 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:18 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:18.682+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:18.956 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:18 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:18.682+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:18.992 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:18.717+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:18.992 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:18.717+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:19.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:18 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:18.954+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:19.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:18.991+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:19.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:18 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:18.991+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:19.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:19.369+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:19.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:19.369+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:19.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:19.414+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:19.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:19 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:19.414+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:19.961 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:19 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:19.652+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:19.961 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:19 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:19.652+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:20.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:19 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:19.965+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:20.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:19 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:19.965+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:20.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:19 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:19.724+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:20.023 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:19 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:19.724+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:20.255 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:19 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:19.957+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:20.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:20 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:20.411+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:20.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:20 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:20.412+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:20.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:20 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:20.464+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:20.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:20 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:20.464+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:20.987 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:20 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:20.716+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:20.987 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:20 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:20.716+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:20.989 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:20 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:20.679+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:20.989 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:20 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:20.679+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:21.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:20 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:20.988+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:21.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:20 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:20.986+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:21.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:20 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:20.986+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:21.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:21.383+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:21.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:21.383+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:21.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:21.433+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:21.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:21 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:21.433+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:21.993 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:21.708+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:21.994 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:21.708+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:22.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:21 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:21.631+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:22.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:21 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:21.631+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:22.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:21.992+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:22.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:21.992+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:22.504 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:22 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:22.034+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:22.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:22 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:22.430+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:22.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:22 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:22.430+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:22.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:22 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:22.393+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:22.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:22 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:22.393+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:22.995 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:22 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:22.595+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:22.996 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:22 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:22.595+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:23.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:22 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:22.756+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:23.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:22 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:22.756+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:23.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:22 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:22.994+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:23.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:23 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:23.029+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:23.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:23 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:23.029+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:23.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:23 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:23.410+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:23.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:23 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:23.410+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:23.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:23 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:23.369+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:23.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:23 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:23.369+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:23.964 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:23 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:23.580+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:23.964 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:23 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:23.580+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:24.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:23 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:23.737+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:24.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:23 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:23.737+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:24.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:23 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:23.962+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:24.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:24.051+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:24.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:24.051+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:24.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:24 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:24.415+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:24.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:24 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:24.415+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:24.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:24 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:24.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:24.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:24 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:24.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:25.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:24 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:24.617+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:25.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:24 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:24.617+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:25.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:24.735+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:25.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:24 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:24.735+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:25.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:25 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:25.002+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:25.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:25.089+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:25.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:25.089+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:25.703 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:25 smithi081 bash[69381]: time="2024-09-10T11:52:25Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5 in 30 seconds, resorting to SIGKILL" 2024-09-10T11:52:25.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:25 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:25.411+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:25.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:25 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:25.411+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:25.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:25 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:25.384+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:25.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:25 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:25.384+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:25.969 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:25 smithi081 podman[69381]: 2024-09-10 11:52:25.708900588 +0000 UTC m=+30.215389484 container died f6b6a0211ff1985b55913f95458a7118e4a8a45dbcf476b42efb747168d12e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T11:52:26.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:25 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:25.625+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:26.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:25 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:25.625+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:26.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:25.733+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:26.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:25.733+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:26.336 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69381]: 2024-09-10 11:52:26.059727728 +0000 UTC m=+30.566216615 container cleanup f6b6a0211ff1985b55913f95458a7118e4a8a45dbcf476b42efb747168d12e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T11:52:26.337 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 bash[69381]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5 2024-09-10T11:52:26.504 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:26 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:26.003+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:26.525 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:26.066+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:26.525 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:26.066+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:26.682 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69397]: 2024-09-10 11:52:26.344426141 +0000 UTC m=+0.636305316 container remove f6b6a0211ff1985b55913f95458a7118e4a8a45dbcf476b42efb747168d12e9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T11:52:26.682 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.5.service: Main process exited, code=exited, status=137/n/a 2024-09-10T11:52:26.683 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:26 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:26.385+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:26.683 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:26 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:26.385+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:26.683 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:26 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:26.335+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:26.683 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:26 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:26.335+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:26.940 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69488]: 2024-09-10 11:52:26.584451297 +0000 UTC m=+0.015681072 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:52:26.940 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69488]: 2024-09-10 11:52:26.70368693 +0000 UTC m=+0.134916738 container create 6c74f04e6f694eb027acc297bf69e7dfba9acb7fbacc29f7c0358a2c4c0b907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:52:27.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:26 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:26.626+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:27.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:26 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:26.626+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:27.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:26.759+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:27.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:26 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:26.759+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:27.203 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69488]: 2024-09-10 11:52:26.939648335 +0000 UTC m=+0.370878102 container init 6c74f04e6f694eb027acc297bf69e7dfba9acb7fbacc29f7c0358a2c4c0b907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:52:27.203 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:26 smithi081 podman[69488]: 2024-09-10 11:52:26.943047151 +0000 UTC m=+0.374276918 container start 6c74f04e6f694eb027acc297bf69e7dfba9acb7fbacc29f7c0358a2c4c0b907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:52:27.203 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:27 smithi081 podman[69488]: 2024-09-10 11:52:27.014632038 +0000 UTC m=+0.445861813 container attach 6c74f04e6f694eb027acc297bf69e7dfba9acb7fbacc29f7c0358a2c4c0b907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:52:27.203 INFO:journalctl@ceph.osd.5.smithi081.stdout:Sep 10 11:52:27 smithi081 podman[69488]: 2024-09-10 11:52:27.128692663 +0000 UTC m=+0.559922430 container died 6c74f04e6f694eb027acc297bf69e7dfba9acb7fbacc29f7c0358a2c4c0b907b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T11:52:27.505 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:27 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:27.019+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:27.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:27.068+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:27.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:27.068+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:27.629 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:27 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:27.412+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:27.629 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:27 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:27.412+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:27.629 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:27 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:27.313+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:27.630 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:27 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:27.313+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:27.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T11:52:27.761 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:52:27.761 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T11:52:27.761 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T11:52:27.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.6 2024-09-10T11:52:27.983 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:27 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:27.603+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:27.983 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:27 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:27.603+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:28.021 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:27 smithi017 systemd[1]: Stopping Ceph osd.6 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:52:28.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:27.761+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:28.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:27 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:27.761+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:28.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:27 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:27.982+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:28.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:28.061+0000 7f0d4ba7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:52:28.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:28.061+0000 7f0d4ba7b640 -1 osd.6 89 *** Got signal Terminated *** 2024-09-10T11:52:28.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:28.061+0000 7f0d4ba7b640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:52:28.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:28.073+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:28.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:28.073+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:28.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:28 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:28.371+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:28.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:28 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:28.371+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:28.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:28 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:28.269+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:28.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:28 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:28.269+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:28.976 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:28 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:28.637+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:28.976 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:28 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:28.637+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:29.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:28.732+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:29.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:28 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:28.732+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:29.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:28 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:28.975+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:29.521 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:29.043+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:29.522 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:29.043+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:29.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:29 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:29.352+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:29.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:29 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:29.352+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:29.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:29 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:29.274+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:29.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:29 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:29.274+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:29.985 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:29 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:29.591+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:29.985 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:29 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:29.591+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:30.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:29 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:29.984+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:30.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:29.998+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:30.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:29.998+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:30.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:29.772+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:30.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:29 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:29.772+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:30.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:30 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:30.363+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:30.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:30 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:30.363+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:30.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:30 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:30.293+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:30.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:30 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:30.293+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:30.981 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:30 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:30.606+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:30.981 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:30 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:30.606+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:31.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:30 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:30.979+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:31.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:30 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:30.956+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:31.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:30 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:30.956+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:31.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:30 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:30.772+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:31.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:30 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:30.772+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:31.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:31 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:31.323+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:31.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:31 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:31.323+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:31.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:31 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:31.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:31.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:31 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:31.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:32.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:31 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:31.631+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:32.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:31 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:31.631+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:32.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:31.810+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:32.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:31.810+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:32.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:31.987+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:32.272 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:31 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:31.987+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:32.504 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:32 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:32.029+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:32.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:32 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:32.321+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:32.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:32 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:32.322+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:32.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:32 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:32.285+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:32.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:32 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:32.285+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:32.989 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:32 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:32.639+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:32.989 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:32 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:32.639+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:33.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:32 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:32.769+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:33.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:32 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:32.769+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:33.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:32 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:32.965+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.811663+0000 front 2024-09-10T11:50:53.811765+0000 (oldest deadline 2024-09-10T11:51:59.111585+0000) 2024-09-10T11:52:33.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:32 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6[57864]: 2024-09-10T11:52:32.965+0000 7f0d48080640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:01.913271+0000 front 2024-09-10T11:51:01.913338+0000 (oldest deadline 2024-09-10T11:52:07.213325+0000) 2024-09-10T11:52:33.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:32 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:32.987+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:33.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:33 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:33.290+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:33.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:33 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:33.290+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:33.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:33 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:33.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:33.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:33 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:33.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:33.771 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:33 smithi017 podman[98855]: 2024-09-10 11:52:33.458309841 +0000 UTC m=+5.494921494 container died 70c5d64467fb3d93841161bc5c85e830c65e9e2489a4ebef0876cb14215aba9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T11:52:33.949 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:33 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:33.595+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:33.949 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:33 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:33.595+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:34.180 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:33 smithi017 podman[98855]: 2024-09-10 11:52:33.944711503 +0000 UTC m=+5.981323149 container cleanup 70c5d64467fb3d93841161bc5c85e830c65e9e2489a4ebef0876cb14215aba9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T11:52:34.181 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:33 smithi017 bash[98855]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6 2024-09-10T11:52:34.181 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:33 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:33.777+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:34.181 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:33 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:33.777+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:34.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:33 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:33.948+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:34.497 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98871]: 2024-09-10 11:52:34.179514275 +0000 UTC m=+0.716285690 container remove 70c5d64467fb3d93841161bc5c85e830c65e9e2489a4ebef0876cb14215aba9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:52:34.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:34 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:34.283+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:34.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:34 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:34.283+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:34.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:34 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:34.364+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:34.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:34 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:34.364+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:34.762 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98959]: 2024-09-10 11:52:34.39939739 +0000 UTC m=+0.016225394 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:52:34.762 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98959]: 2024-09-10 11:52:34.65569426 +0000 UTC m=+0.272522254 container create f0dc2f0f6299eed061b51ae751b32ff08a9718232f741c54dd6869de7013f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T11:52:34.961 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:34 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:34.573+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:34.961 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:34 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:34.573+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:35.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:34.764+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:35.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:34 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:34.764+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:35.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98959]: 2024-09-10 11:52:34.899943014 +0000 UTC m=+0.516771022 container init f0dc2f0f6299eed061b51ae751b32ff08a9718232f741c54dd6869de7013f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-10T11:52:35.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98959]: 2024-09-10 11:52:34.903323906 +0000 UTC m=+0.520151906 container start f0dc2f0f6299eed061b51ae751b32ff08a9718232f741c54dd6869de7013f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T11:52:35.022 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:34 smithi017 podman[98959]: 2024-09-10 11:52:34.983083432 +0000 UTC m=+0.599911443 container attach f0dc2f0f6299eed061b51ae751b32ff08a9718232f741c54dd6869de7013f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T11:52:35.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:34 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:34.960+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:35.428 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 10 11:52:35 smithi017 podman[98959]: 2024-09-10 11:52:35.101212961 +0000 UTC m=+0.718040956 container died f0dc2f0f6299eed061b51ae751b32ff08a9718232f741c54dd6869de7013f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T11:52:35.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:35.285+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:35.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:35.285+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:35.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:35.349+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:35.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:35 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:35.349+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:35.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T11:52:35.754 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:52:35.754 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T11:52:35.755 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T11:52:35.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.7 2024-09-10T11:52:35.810 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:35 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:35.546+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:35.811 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:35 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:35.546+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:36.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:35 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:35.774+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:36.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:35 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:35.774+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:36.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:35 smithi026 systemd[1]: Stopping Ceph osd.7 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:52:36.255 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:36.001+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:36.255 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:36.045+0000 7f5024443640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:52:36.255 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:36.045+0000 7f5024443640 -1 osd.7 89 *** Got signal Terminated *** 2024-09-10T11:52:36.255 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:36.045+0000 7f5024443640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:52:36.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:36.295+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:36.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:36.295+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:36.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:36.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:36.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:36 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:36.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:36.996 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:36.541+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:36.996 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:36.541+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:37.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:36.752+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:37.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:36 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:36.752+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:37.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:36 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:36.995+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:37.604 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:37 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:37.360+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:37.604 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:37 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:37.360+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:37.604 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:37 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:37.310+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:37.605 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:37 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:37.310+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:38.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:37 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:37.574+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:38.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:37 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:37.574+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:38.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:37 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:37.574+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:38.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:37 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:37.783+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:38.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:37 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:37.783+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:38.504 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:38 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:38.008+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:38.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:38.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:38.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:38.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:38.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:38.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:38.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:38.299+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:38.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:38.299+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:38.704 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:38 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:38.299+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:38.984 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:38 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:38.619+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:38.984 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:38 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:38.619+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:38.984 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:38 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:38.619+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:39.173 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:38 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:38.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:39.173 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:38 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:38.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:39.173 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:38 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:38.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:39.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:38 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:38.982+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:39.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:39.328+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:39.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:39.328+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:39.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:39.328+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:39.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:39.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:39.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:39.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:39.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:39 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:39.333+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:39.951 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:39 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:39.666+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:39.951 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:39 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:39.666+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:39.951 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:39 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:39.666+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:40.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:39 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:39.950+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:40.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:39 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:39.950+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:11.978771+0000 front 2024-09-10T11:51:11.978751+0000 (oldest deadline 2024-09-10T11:52:39.481777+0000) 2024-09-10T11:52:40.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:39.802+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:40.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:39.802+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:40.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:39 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:39.802+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:40.348+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:40.348+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:40.348+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:40.373+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:40.373+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:40.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:40 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:40.373+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:41.004 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:40.940+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.976560+0000 front 2024-09-10T11:51:03.976617+0000 (oldest deadline 2024-09-10T11:52:09.876644+0000) 2024-09-10T11:52:41.004 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7[53083]: 2024-09-10T11:52:40.940+0000 7f5020a48640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:11.978771+0000 front 2024-09-10T11:51:11.978751+0000 (oldest deadline 2024-09-10T11:52:39.481777+0000) 2024-09-10T11:52:41.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:40.693+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:41.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:40.693+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:41.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:40 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:40.693+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:41.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:40 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:40.768+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:41.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:40 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:40.768+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:41.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:40 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:40.768+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:41.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:41.313+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:41.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:41.313+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:41.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:41.313+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:41.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:41.360+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:41.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:41.360+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:41.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:41 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:41.360+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:41.949 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:41 smithi026 podman[69642]: 2024-09-10 11:52:41.552227019 +0000 UTC m=+5.590627457 container died 7a55631848c86a479423203446379316658fc7d01e86cf7cd51329e6b62706e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T11:52:41.949 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:41 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:41.727+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:41.949 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:41 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:41.727+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:41.949 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:41 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:41.727+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:42.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:41 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:41.751+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:42.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:41 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:41.751+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:42.022 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:41 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:41.751+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:42.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69642]: 2024-09-10 11:52:42.020984328 +0000 UTC m=+6.059384757 container cleanup 7a55631848c86a479423203446379316658fc7d01e86cf7cd51329e6b62706e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T11:52:42.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 bash[69642]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7 2024-09-10T11:52:42.582 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69657]: 2024-09-10 11:52:42.272356842 +0000 UTC m=+0.714662622 container remove 7a55631848c86a479423203446379316658fc7d01e86cf7cd51329e6b62706e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T11:52:42.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:42.287+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:42.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:42.287+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:42.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:42.287+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:42.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:42.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:42.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:42.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:42.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:42 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:42.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:42.917 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:42 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:42.697+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:42 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:42.697+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:42 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:42.697+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69748]: 2024-09-10 11:52:42.581537692 +0000 UTC m=+0.109382862 container create 48ed2cf2e5c36e9569bb057cf27c05f2ef21c378aa847ae82811eecf8f81b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69748]: 2024-09-10 11:52:42.488292812 +0000 UTC m=+0.016137951 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69748]: 2024-09-10 11:52:42.825713763 +0000 UTC m=+0.353558903 container init 48ed2cf2e5c36e9569bb057cf27c05f2ef21c378aa847ae82811eecf8f81b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69748]: 2024-09-10 11:52:42.828970361 +0000 UTC m=+0.356815488 container start 48ed2cf2e5c36e9569bb057cf27c05f2ef21c378aa847ae82811eecf8f81b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:52:42.918 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:42 smithi026 podman[69748]: 2024-09-10 11:52:42.917306491 +0000 UTC m=+0.445151624 container attach 48ed2cf2e5c36e9569bb057cf27c05f2ef21c378aa847ae82811eecf8f81b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T11:52:43.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:42 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:42.764+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:43.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:42 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:42.764+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:43.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:42 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:42.764+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:43.254 INFO:journalctl@ceph.osd.7.smithi026.stdout:Sep 10 11:52:43 smithi026 podman[69748]: 2024-09-10 11:52:43.022647611 +0000 UTC m=+0.550492736 container died 48ed2cf2e5c36e9569bb057cf27c05f2ef21c378aa847ae82811eecf8f81b857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T11:52:43.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T11:52:43.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:52:43.686 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T11:52:43.686 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T11:52:43.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.8 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.263+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.263+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.263+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:43.438+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:43.438+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:43.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:43.438+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:43.972 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 systemd[1]: Stopping Ceph osd.8 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:52:44.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:43 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:43.650+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:44.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:43 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:43.650+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:44.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:43 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:43.650+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:44.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:43 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:43.775+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:44.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:43 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:43.775+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:44.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:43 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:43.775+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:44.312 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.971+0000 7fe5271f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:52:44.312 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.971+0000 7fe5271f5640 -1 osd.8 89 *** Got signal Terminated *** 2024-09-10T11:52:44.312 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:43 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:43.971+0000 7fe5271f5640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:52:44.312 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:44.310+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:44.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:44.310+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:44.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:44.310+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:44.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:44.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:44.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:44.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:44.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:44 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:44.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:45.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:44 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:44.678+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:45.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:44 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:44.678+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:45.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:44 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:44.678+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:45.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:44 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:44.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:45.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:44 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:44.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:45.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:44 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:44.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:45.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:45.271+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:45.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:45.271+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:45.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:45.271+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:45.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:45.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:45.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:45.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:45.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:45.406+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:46.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:45 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:45.654+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:46.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:45 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:45.654+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:46.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:45 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:45.654+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:46.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:45 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:45.818+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:46.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:45 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:45.818+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:46.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:45 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:45.818+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:46.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:46.273+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:46.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:46.273+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:46.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:46.273+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:46.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:46.382+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:46.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:46.382+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:46.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:46 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:46.382+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:47.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:46 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:46.634+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:47.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:46 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:46.634+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:47.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:46 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:46.634+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:47.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:46.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:47.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:46.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:47.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:46.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:47.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:46 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:46.791+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:47.431+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:47.431+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:47.431+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:47.259+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:47.259+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:47.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:47.259+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:47.704 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:47 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:47.259+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.112719+0000 front 2024-09-10T11:51:44.112796+0000 (oldest deadline 2024-09-10T11:52:46.412535+0000) 2024-09-10T11:52:48.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:47.667+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:48.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:47.667+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:48.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:47 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:47.667+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:48.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:47.792+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:48.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:47.792+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:48.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:47.792+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:48.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:47 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:47.792+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:48.408+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:48.408+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:48.408+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:48.286+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.706519+0000 front 2024-09-10T11:50:54.706402+0000 (oldest deadline 2024-09-10T11:51:56.906799+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:48.286+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:00.308034+0000 front 2024-09-10T11:51:00.307972+0000 (oldest deadline 2024-09-10T11:52:05.607925+0000) 2024-09-10T11:52:48.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:48.286+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:12.009030+0000 front 2024-09-10T11:51:12.009050+0000 (oldest deadline 2024-09-10T11:52:38.211795+0000) 2024-09-10T11:52:48.704 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:48 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8[53159]: 2024-09-10T11:52:48.286+0000 7fe51f7f2640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.112719+0000 front 2024-09-10T11:51:44.112796+0000 (oldest deadline 2024-09-10T11:52:46.412535+0000) 2024-09-10T11:52:49.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:48 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:48.715+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:49.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:48 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:48.715+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:49.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:48 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:48.715+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:49.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:48 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:48.715+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:49.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:48.831+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:49.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:48.831+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:49.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:48.831+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:49.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:48 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:48.831+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:49.703 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:49 smithi081 podman[69604]: 2024-09-10 11:52:49.538685221 +0000 UTC m=+5.657657209 container died 5bb1923969419f78bf4bb4bc90da899728f937d7c3571cc28ccbe7db29ff1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T11:52:49.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:49.443+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:49.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:49.443+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:49.704 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:49.443+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:50.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:49 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:49.724+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:50.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:49 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:49.724+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:50.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:49 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:49.724+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:50.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:49 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:49.724+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:50.139 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:49 smithi081 podman[69604]: 2024-09-10 11:52:49.887845639 +0000 UTC m=+6.006817617 container cleanup 5bb1923969419f78bf4bb4bc90da899728f937d7c3571cc28ccbe7db29ff1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T11:52:50.140 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:49 smithi081 bash[69604]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8 2024-09-10T11:52:50.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:49.850+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:50.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:49.850+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:50.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:49.850+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:50.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:49 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:49.850+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:50.444 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69619]: 2024-09-10 11:52:50.139253035 +0000 UTC m=+0.604637854 container remove 5bb1923969419f78bf4bb4bc90da899728f937d7c3571cc28ccbe7db29ff1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T11:52:50.701 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.395364558 +0000 UTC m=+0.015403934 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:52:50.701 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.498603813 +0000 UTC m=+0.118643225 container create cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:52:50.701 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:50.442+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:50.701 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:50.442+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:50.702 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:50 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:50.442+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:50.953 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.700842608 +0000 UTC m=+0.320881975 container init cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T11:52:50.953 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.704095907 +0000 UTC m=+0.324135276 container start cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T11:52:50.953 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.759089519 +0000 UTC m=+0.379128895 container attach cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-10T11:52:50.954 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:50 smithi081 podman[69710]: 2024-09-10 11:52:50.90284738 +0000 UTC m=+0.522886748 container died cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T11:52:51.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:50 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:50.732+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:51.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:50 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:50.732+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:51.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:50 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:50.732+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:51.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:50 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:50.732+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:51.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:50.855+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:51.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:50.855+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:51.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:50.855+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:51.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:50 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:50.855+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:51.453 INFO:journalctl@ceph.osd.8.smithi081.stdout:Sep 10 11:52:51 smithi081 podman[69733]: 2024-09-10 11:52:51.437836623 +0000 UTC m=+0.529706470 container remove cf35c58f8c5653488348733682deea813a74c7223090883df7812c3a6c16bd4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T11:52:51.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T11:52:51.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:52:51.538 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T11:52:51.538 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T11:52:51.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.9 2024-09-10T11:52:51.848 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 systemd[1]: Stopping Ceph osd.9 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:52:51.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:51.456+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:51.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:51.456+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:51.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:51 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:51.456+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:52.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:51 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:51.745+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:52.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:51 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:51.745+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:52.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:51 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:51.745+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:52.005 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:51 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:51.745+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:52.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.847+0000 7fc43bcee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.847+0000 7fc43bcee640 -1 osd.9 89 *** Got signal Terminated *** 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.847+0000 7fc43bcee640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.873+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.873+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.873+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:52.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:51 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:51.873+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:52.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:52 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:52.430+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:52.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:52 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:52.430+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:52.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:52 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:52.430+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:53.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:52.760+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:53.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:52.760+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:53.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:52.760+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:53.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:52 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:52.760+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:53.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:52.870+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:53.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:52.870+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:53.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:52.870+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:53.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:52 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:52.870+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:53.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:53.424+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:53.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:53.424+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:53.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:53.424+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:54.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:53.777+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:54.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:53.777+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:54.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:53.777+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:54.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:53 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:53.777+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:54.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:53.837+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:54.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:53.837+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:54.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:53.837+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:54.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:53 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:53.837+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:54.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:54.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:54.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:54.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:54.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:54 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:54.391+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:55.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:54.824+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:55.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:54.824+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:55.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:54.824+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:55.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:54 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:54.824+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:55.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:54 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:54.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:55.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:54 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:54.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:55.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:54 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:54.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:55.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:54 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:54.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:55.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:54 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:54.823+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:48.359719+0000 front 2024-09-10T11:51:48.359596+0000 (oldest deadline 2024-09-10T11:52:54.259623+0000) 2024-09-10T11:52:55.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:55.409+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:55.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:55.409+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:55.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:55.409+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:55.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:55 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:55.409+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:52:56.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:55.805+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:56.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:55.805+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:56.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:55.805+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:56.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:55 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:55.805+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:56.271 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:55.841+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:56.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:55.841+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:56.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:55.841+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:56.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:55.841+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:56.272 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:55 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:55.841+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:48.359719+0000 front 2024-09-10T11:51:48.359596+0000 (oldest deadline 2024-09-10T11:52:54.259623+0000) 2024-09-10T11:52:56.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:56 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:56.380+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:56.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:56 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:56.380+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:56.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:56 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:56.380+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:56.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:56 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:56.380+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:52:57.261 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:56.773+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:57.261 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:56.773+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:57.261 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:56.773+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:57.261 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:56 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:56.773+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:57.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:56 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:56.793+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:54.651132+0000 front 2024-09-10T11:50:54.651188+0000 (oldest deadline 2024-09-10T11:51:59.951357+0000) 2024-09-10T11:52:57.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:56 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:56.793+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:50:59.952180+0000 front 2024-09-10T11:50:59.952066+0000 (oldest deadline 2024-09-10T11:52:05.251886+0000) 2024-09-10T11:52:57.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:56 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:56.793+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:10.552886+0000 front 2024-09-10T11:51:10.552912+0000 (oldest deadline 2024-09-10T11:52:37.956919+0000) 2024-09-10T11:52:57.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:56 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:56.793+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:44.358392+0000 front 2024-09-10T11:51:44.358458+0000 (oldest deadline 2024-09-10T11:52:46.658547+0000) 2024-09-10T11:52:57.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:56 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9[64715]: 2024-09-10T11:52:56.793+0000 7fc4342eb640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:48.359719+0000 front 2024-09-10T11:51:48.359596+0000 (oldest deadline 2024-09-10T11:52:54.259623+0000) 2024-09-10T11:52:57.606 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:57 smithi017 podman[99061]: 2024-09-10 11:52:57.338574029 +0000 UTC m=+5.600382877 container died 4782c5e09fb25037b96566cc852ccc37220e9fba6dbf00c7ec7acef682501a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True) 2024-09-10T11:52:57.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:57.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:57.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:57.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:57.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:57.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:57.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:57.338+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:52:58.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:57 smithi017 podman[99061]: 2024-09-10 11:52:57.797180444 +0000 UTC m=+6.058989290 container cleanup 4782c5e09fb25037b96566cc852ccc37220e9fba6dbf00c7ec7acef682501a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:52:58.021 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:57 smithi017 bash[99061]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9 2024-09-10T11:52:58.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:57 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:57.767+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:58.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:57 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:57.767+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:58.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:57 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:57.767+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:58.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:57 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:57.767+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:58.427 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99078]: 2024-09-10 11:52:58.08201436 +0000 UTC m=+0.736495980 container remove 4782c5e09fb25037b96566cc852ccc37220e9fba6dbf00c7ec7acef682501a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:52:58.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:58.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:58.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:58.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:58.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:58.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:58.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:58 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:58.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:52:58.772 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.329342609 +0000 UTC m=+0.016131465 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:52:58.772 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.432776263 +0000 UTC m=+0.119565151 container create 112a409433596b960f5f07e297ed4b1e68bc08ed1c97fea1c4e99027ced9d55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T11:52:58.772 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.643530461 +0000 UTC m=+0.330319316 container init 112a409433596b960f5f07e297ed4b1e68bc08ed1c97fea1c4e99027ced9d55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T11:52:58.772 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.647154791 +0000 UTC m=+0.333943646 container start 112a409433596b960f5f07e297ed4b1e68bc08ed1c97fea1c4e99027ced9d55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T11:52:59.138 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.852011676 +0000 UTC m=+0.538800522 container attach 112a409433596b960f5f07e297ed4b1e68bc08ed1c97fea1c4e99027ced9d55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T11:52:59.139 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 10 11:52:58 smithi017 podman[99171]: 2024-09-10 11:52:58.852249727 +0000 UTC m=+0.539038575 container died 112a409433596b960f5f07e297ed4b1e68bc08ed1c97fea1c4e99027ced9d55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T11:52:59.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:58.784+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:52:59.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:58.784+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:52:59.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:58.784+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:52:59.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:58.784+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:52:59.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:58 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:58.784+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:52:59.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T11:52:59.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:52:59.464 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T11:52:59.464 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T11:52:59.464 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.10 2024-09-10T11:52:59.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:59.376+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:52:59.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:59.376+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:52:59.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:59.376+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:52:59.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:52:59 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:52:59.376+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:52:59.754 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 systemd[1]: Stopping Ceph osd.10 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:00.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.767+0000 7f896e9b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.767+0000 7f896e9b0640 -1 osd.10 89 *** Got signal Terminated *** 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.767+0000 7f896e9b0640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.816+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.816+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.816+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.816+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:53:00.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:52:59 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:52:59.816+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:53:00.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:00.332+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:00.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:00.332+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:00.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:00.332+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:00.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:00 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:00.332+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:01.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:00.845+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:53:01.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:00.845+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:53:01.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:00.845+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:53:01.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:00.845+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:53:01.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:00 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:00.845+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:53:01.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:01.377+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:01.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:01.377+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:01.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:01.377+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:01.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:01 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:01.377+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:02.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:01.876+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:53:02.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:01.876+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:53:02.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:01.876+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:53:02.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:01.876+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:53:02.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:01 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:01.876+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:53:02.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:02.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:02.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:02.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:02.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:02.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:02.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:02 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:02.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:03.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:02.893+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:53:03.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:02.893+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:53:03.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:02.893+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:53:03.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:02.893+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:53:03.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:02 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:02.893+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:53:03.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:03.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:03.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:03.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:03.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:03.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:03.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:03 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:03.358+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:04.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:03.935+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:52.831227+0000 front 2024-09-10T11:50:52.831163+0000 (oldest deadline 2024-09-10T11:51:58.131147+0000) 2024-09-10T11:53:04.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:03.935+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:03.332630+0000 front 2024-09-10T11:51:03.332738+0000 (oldest deadline 2024-09-10T11:52:09.232843+0000) 2024-09-10T11:53:04.254 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:03.935+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:09.233436+0000 front 2024-09-10T11:51:09.233650+0000 (oldest deadline 2024-09-10T11:52:37.237111+0000) 2024-09-10T11:53:04.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:03.935+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-10T11:51:41.938012+0000 front 2024-09-10T11:51:41.938035+0000 (oldest deadline 2024-09-10T11:52:47.838113+0000) 2024-09-10T11:53:04.255 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:03 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10[60133]: 2024-09-10T11:53:03.935+0000 7f896afb5640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:47.838453+0000 front 2024-09-10T11:51:47.838425+0000 (oldest deadline 2024-09-10T11:52:58.438955+0000) 2024-09-10T11:53:04.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:04.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:04.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:04.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:04.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:04.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:04.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:04 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:04.341+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:05.626 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:05 smithi026 podman[69864]: 2024-09-10 11:53:05.34710697 +0000 UTC m=+5.682920643 container died 77f6f295e2e30da2cc9383aafb60e3d2df4e88ef4bb08fac744f67d0c4d48d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T11:53:05.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:05.310+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:05.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:05.310+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:05.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:05.310+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:05.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:05 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:05.310+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:06.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:05 smithi026 podman[69864]: 2024-09-10 11:53:05.715996181 +0000 UTC m=+6.051809844 container cleanup 77f6f295e2e30da2cc9383aafb60e3d2df4e88ef4bb08fac744f67d0c4d48d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:06.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:05 smithi026 bash[69864]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10 2024-09-10T11:53:06.343 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69880]: 2024-09-10 11:53:06.017161899 +0000 UTC m=+0.671287560 container remove 77f6f295e2e30da2cc9383aafb60e3d2df4e88ef4bb08fac744f67d0c4d48d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:06.620 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.342809734 +0000 UTC m=+0.109803742 container create 8f60f6164f9f82c5d7090c9954e5267d23b4f60329688a68e43419bcd3dfff21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T11:53:06.620 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.248898297 +0000 UTC m=+0.015892284 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:53:06.620 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.536672926 +0000 UTC m=+0.303666904 container init 8f60f6164f9f82c5d7090c9954e5267d23b4f60329688a68e43419bcd3dfff21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:06.620 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.540163157 +0000 UTC m=+0.307157127 container start 8f60f6164f9f82c5d7090c9954e5267d23b4f60329688a68e43419bcd3dfff21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T11:53:06.621 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.61987261 +0000 UTC m=+0.386866584 container attach 8f60f6164f9f82c5d7090c9954e5267d23b4f60329688a68e43419bcd3dfff21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T11:53:06.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:06.350+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:06.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:06.350+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:06.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:06.350+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:06.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:06 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:06.350+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:07.004 INFO:journalctl@ceph.osd.10.smithi026.stdout:Sep 10 11:53:06 smithi026 podman[69969]: 2024-09-10 11:53:06.73098566 +0000 UTC m=+0.497979625 container died 8f60f6164f9f82c5d7090c9954e5267d23b4f60329688a68e43419bcd3dfff21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T11:53:07.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T11:53:07.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:07.514 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T11:53:07.514 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T11:53:07.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.11 2024-09-10T11:53:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.367+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.367+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.367+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.367+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:07.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 systemd[1]: Stopping Ceph osd.11 for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:08.083 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.798+0000 7f4e925e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:08.084 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.798+0000 7f4e925e9640 -1 osd.11 89 *** Got signal Terminated *** 2024-09-10T11:53:08.084 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:07 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:07.798+0000 7f4e925e9640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T11:53:08.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:08.403+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:08.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:08.403+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:08.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:08.403+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:08.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:08 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:08.403+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:09.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:09.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:09.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:09.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:09.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:09.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:09.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:09 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:09.411+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:10.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:10.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:10.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:10.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:10 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:10.383+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:11.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:11.412+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:11.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:11.412+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:11.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:11.412+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:11.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:11 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:11.412+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:12.363+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-10T11:50:53.445635+0000 front 2024-09-10T11:50:53.445726+0000 (oldest deadline 2024-09-10T11:51:59.345618+0000) 2024-09-10T11:53:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:12.363+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6804 osd.1 since back 2024-09-10T11:51:04.046614+0000 front 2024-09-10T11:51:04.046565+0000 (oldest deadline 2024-09-10T11:52:08.146540+0000) 2024-09-10T11:53:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:12.363+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-09-10T11:51:08.146788+0000 front 2024-09-10T11:51:08.146912+0000 (oldest deadline 2024-09-10T11:52:38.151673+0000) 2024-09-10T11:53:12.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:12 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11[59746]: 2024-09-10T11:53:12.363+0000 7f4e8ebee640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.26:6812 osd.4 since back 2024-09-10T11:51:50.453883+0000 front 2024-09-10T11:51:50.453869+0000 (oldest deadline 2024-09-10T11:52:54.553772+0000) 2024-09-10T11:53:13.617 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:13 smithi081 podman[69812]: 2024-09-10 11:53:13.357449337 +0000 UTC m=+5.659816236 container died 2fbfc380f2bf1ff7559c852a17c8302d9f1dad4a746cc3ffbaa24dccc7606b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T11:53:13.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:13 smithi081 podman[69812]: 2024-09-10 11:53:13.706942554 +0000 UTC m=+6.009309440 container cleanup 2fbfc380f2bf1ff7559c852a17c8302d9f1dad4a746cc3ffbaa24dccc7606b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:13.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:13 smithi081 bash[69812]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11 2024-09-10T11:53:14.325 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:13 smithi081 podman[69838]: 2024-09-10 11:53:13.992097383 +0000 UTC m=+0.632611870 container remove 2fbfc380f2bf1ff7559c852a17c8302d9f1dad4a746cc3ffbaa24dccc7606b5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:14.702 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.227456036 +0000 UTC m=+0.015651146 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T11:53:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.334576913 +0000 UTC m=+0.122772013 container create 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T11:53:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.512506558 +0000 UTC m=+0.300701661 container init 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T11:53:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.516057909 +0000 UTC m=+0.304253020 container start 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:53:14.703 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.570215336 +0000 UTC m=+0.358410449 container attach 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:14.953 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:14 smithi081 podman[69929]: 2024-09-10 11:53:14.702261496 +0000 UTC m=+0.490456609 container died 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:53:15.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T11:53:15.256 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:15 smithi081 podman[69953]: 2024-09-10 11:53:15.215088176 +0000 UTC m=+0.506615652 container remove 8299785fb66934687de27e3b450299598e1b7869be4dc2bdae95292955a10fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:53:15.256 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:15 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-10T11:53:15.256 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:15 smithi081 systemd[1]: Stopped Ceph osd.11 for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:15.256 INFO:journalctl@ceph.osd.11.smithi081.stdout:Sep 10 11:53:15 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@osd.11.service: Consumed 7min 5.799s CPU time. 2024-09-10T11:53:15.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:15.271 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T11:53:15.271 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T11:53:15.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.a 2024-09-10T11:53:15.574 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:15 smithi017 systemd[1]: Stopping Ceph mds.a for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:15.847 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: 2024-09-10T11:53:15.573+0000 7f2ab5acb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:15.847 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:15 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a[71488]: 2024-09-10T11:53:15.573+0000 7f2ab5acb640 -1 mds.a *** got signal Terminated *** 2024-09-10T11:53:16.857 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:16 smithi017 podman[99274]: 2024-09-10 11:53:16.539405259 +0000 UTC m=+1.065915005 container died 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T11:53:17.271 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:17 smithi017 podman[99274]: 2024-09-10 11:53:17.074072492 +0000 UTC m=+1.600582233 container cleanup 62990aef26ba86aa69d85b49b111cafc6369d49f7c2d9c7dce24a4f5ba078468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:53:17.271 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 10 11:53:17 smithi017 bash[99274]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-a 2024-09-10T11:53:17.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T11:53:17.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:17.540 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T11:53:17.540 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T11:53:17.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.d 2024-09-10T11:53:17.896 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:17 smithi017 systemd[1]: Stopping Ceph mds.d for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:18.271 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d[70304]: 2024-09-10T11:53:17.895+0000 7fa609dd6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:18.272 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:17 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d[70304]: 2024-09-10T11:53:17.895+0000 7fa609dd6640 -1 mds.d *** got signal Terminated *** 2024-09-10T11:53:20.129 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:19 smithi017 podman[99406]: 2024-09-10 11:53:19.866264695 +0000 UTC m=+2.103565733 container died ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T11:53:20.480 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:20 smithi017 podman[99406]: 2024-09-10 11:53:20.294954819 +0000 UTC m=+2.532255895 container cleanup ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T11:53:20.480 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:20 smithi017 bash[99406]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d 2024-09-10T11:53:20.730 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:20 smithi017 podman[99420]: 2024-09-10 11:53:20.479677703 +0000 UTC m=+0.610676891 container remove ee3d6472b30fb94d2dc9a986817fd6585c298e3d3c17e10aea99e870e1b48bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T11:53:20.731 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:20 smithi017 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-10T11:53:20.731 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 10 11:53:20 smithi017 systemd[1]: Stopped Ceph mds.d for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:20.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T11:53:20.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:20.767 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T11:53:20.767 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T11:53:20.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.g 2024-09-10T11:53:21.021 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:20 smithi017 systemd[1]: Stopping Ceph mds.g for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:21.521 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: 2024-09-10T11:53:21.199+0000 7fb058372640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:21.521 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:21 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g[71077]: 2024-09-10T11:53:21.199+0000 7fb058372640 -1 mds.g *** got signal Terminated *** 2024-09-10T11:53:24.950 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:24 smithi017 podman[99526]: 2024-09-10 11:53:24.541452466 +0000 UTC m=+3.553988853 container died f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:53:25.271 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:25 smithi017 podman[99526]: 2024-09-10 11:53:25.132582492 +0000 UTC m=+4.145118876 container cleanup f29c1ed2924fec44cb38987ee3cd5c68841938b4dc371c9c85585ac762a56b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T11:53:25.272 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 10 11:53:25 smithi017 bash[99526]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-g 2024-09-10T11:53:25.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T11:53:25.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:25.554 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T11:53:25.554 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T11:53:25.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.j 2024-09-10T11:53:26.021 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:25 smithi017 systemd[1]: Stopping Ceph mds.j for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:26.022 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j[69887]: 2024-09-10T11:53:25.878+0000 7f6d3215f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:26.022 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:25 smithi017 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j[69887]: 2024-09-10T11:53:25.878+0000 7f6d3215f640 -1 mds.j *** got signal Terminated *** 2024-09-10T11:53:28.563 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:28 smithi017 podman[99649]: 2024-09-10 11:53:28.278912581 +0000 UTC m=+2.501942201 container died aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:53:28.881 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:28 smithi017 podman[99649]: 2024-09-10 11:53:28.712277891 +0000 UTC m=+2.935307551 container cleanup aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T11:53:28.881 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:28 smithi017 bash[99649]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j 2024-09-10T11:53:29.134 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 10 11:53:28 smithi017 podman[99662]: 2024-09-10 11:53:28.88027087 +0000 UTC m=+0.599037484 container remove aac8f66abba44296995b2e7e73769aae15b60bab472c06ea84b13870525f953d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T11:53:29.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T11:53:29.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:29.171 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T11:53:29.171 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T11:53:29.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.b 2024-09-10T11:53:29.504 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:29 smithi026 systemd[1]: Stopping Ceph mds.b for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:29.504 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:29 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: 2024-09-10T11:53:29.439+0000 7ffa3c4df640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:29.505 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:29 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b[65347]: 2024-09-10T11:53:29.439+0000 7ffa3c4df640 -1 mds.b *** got signal Terminated *** 2024-09-10T11:53:32.916 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:32 smithi026 podman[70070]: 2024-09-10 11:53:32.554080975 +0000 UTC m=+3.186264526 container died f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T11:53:33.191 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:32 smithi026 podman[70070]: 2024-09-10 11:53:32.972914089 +0000 UTC m=+3.605097641 container cleanup f5e781d48427453cf8415a46bcc793eeff99ab72ff700bde9c220014c54cbc2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:53:33.191 INFO:journalctl@ceph.mds.b.smithi026.stdout:Sep 10 11:53:32 smithi026 bash[70070]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-b 2024-09-10T11:53:33.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T11:53:33.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:33.446 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T11:53:33.446 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T11:53:33.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.e 2024-09-10T11:53:33.754 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:33 smithi026 systemd[1]: Stopping Ceph mds.e for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:34.254 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:33 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: 2024-09-10T11:53:33.767+0000 7f9e2dd43640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:34.254 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:33 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e[64744]: 2024-09-10T11:53:33.767+0000 7f9e2dd43640 -1 mds.e *** got signal Terminated *** 2024-09-10T11:53:36.802 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:36 smithi026 podman[70203]: 2024-09-10 11:53:36.545092554 +0000 UTC m=+2.880933988 container died 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T11:53:37.053 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:36 smithi026 podman[70203]: 2024-09-10 11:53:36.893216773 +0000 UTC m=+3.229058197 container cleanup 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T11:53:37.053 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:36 smithi026 bash[70203]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e 2024-09-10T11:53:37.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T11:53:37.303 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:37 smithi026 podman[70218]: 2024-09-10 11:53:37.052475243 +0000 UTC m=+0.499986357 container remove 6261bab6e4cf0b5e1ea8a8c5722e814f505e105aea1aed4350f25c848be37cc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T11:53:37.303 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:37 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-10T11:53:37.303 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:37 smithi026 systemd[1]: Stopped Ceph mds.e for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:37.304 INFO:journalctl@ceph.mds.e.smithi026.stdout:Sep 10 11:53:37 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.e.service: Consumed 4.004s CPU time. 2024-09-10T11:53:37.315 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:37.315 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T11:53:37.315 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T11:53:37.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.h 2024-09-10T11:53:37.622 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:37 smithi026 systemd[1]: Stopping Ceph mds.h for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:38.004 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:37 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: 2024-09-10T11:53:37.620+0000 7fc3b947b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:38.004 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:37 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h[65047]: 2024-09-10T11:53:37.620+0000 7fc3b947b640 -1 mds.h *** got signal Terminated *** 2024-09-10T11:53:40.814 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:40 smithi026 podman[70325]: 2024-09-10 11:53:40.561161229 +0000 UTC m=+3.015908391 container died 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T11:53:41.090 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:40 smithi026 podman[70325]: 2024-09-10 11:53:40.887839214 +0000 UTC m=+3.342586376 container cleanup 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:53:41.090 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:40 smithi026 bash[70325]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h 2024-09-10T11:53:41.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T11:53:41.348 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:41 smithi026 podman[70337]: 2024-09-10 11:53:41.08892692 +0000 UTC m=+0.526008968 container remove 88095bc7b65eb09ad5d1eac0de56fa51457f6d5043d331aaae21bf6ad97fa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T11:53:41.349 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:41 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-10T11:53:41.349 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:41 smithi026 systemd[1]: Stopped Ceph mds.h for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:41.349 INFO:journalctl@ceph.mds.h.smithi026.stdout:Sep 10 11:53:41 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.h.service: Consumed 6.825s CPU time. 2024-09-10T11:53:41.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:41.360 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T11:53:41.360 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T11:53:41.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.k 2024-09-10T11:53:41.684 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:41 smithi026 systemd[1]: Stopping Ceph mds.k for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:42.004 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:41 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: 2024-09-10T11:53:41.682+0000 7fd71b74e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:42.004 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:41 smithi026 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k[64431]: 2024-09-10T11:53:41.682+0000 7fd71b74e640 -1 mds.k *** got signal Terminated *** 2024-09-10T11:53:44.809 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:44 smithi026 podman[70445]: 2024-09-10 11:53:44.541704305 +0000 UTC m=+2.961568588 container died 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T11:53:45.068 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:44 smithi026 podman[70445]: 2024-09-10 11:53:44.883177958 +0000 UTC m=+3.303042243 container cleanup 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T11:53:45.068 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:44 smithi026 bash[70445]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k 2024-09-10T11:53:45.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T11:53:45.327 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:45 smithi026 podman[70457]: 2024-09-10 11:53:45.067537721 +0000 UTC m=+0.518404634 container remove 8e15e1cebfd3e37f87a299d0490062f7393179d7ea61b4c60cf29d0736b4e964 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T11:53:45.327 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:45 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-10T11:53:45.327 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:45 smithi026 systemd[1]: Stopped Ceph mds.k for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:45.327 INFO:journalctl@ceph.mds.k.smithi026.stdout:Sep 10 11:53:45 smithi026 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.k.service: Consumed 2.506s CPU time. 2024-09-10T11:53:45.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:45.338 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T11:53:45.338 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T11:53:45.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.c 2024-09-10T11:53:45.625 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:45 smithi081 systemd[1]: Stopping Ceph mds.c for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:45.880 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: 2024-09-10T11:53:45.623+0000 7fc0fde37640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:45.880 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:45 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c[65044]: 2024-09-10T11:53:45.623+0000 7fc0fde37640 -1 mds.c *** got signal Terminated *** 2024-09-10T11:53:48.817 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:48 smithi081 podman[70033]: 2024-09-10 11:53:48.547035509 +0000 UTC m=+3.019155019 container died de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T11:53:49.167 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:48 smithi081 podman[70033]: 2024-09-10 11:53:48.915598696 +0000 UTC m=+3.387718207 container cleanup de8a6f58704ffb9c8a30e215c74e2fe95a48a0c890be91d6db46e0384de8188a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T11:53:49.167 INFO:journalctl@ceph.mds.c.smithi081.stdout:Sep 10 11:53:48 smithi081 bash[70033]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-c 2024-09-10T11:53:49.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T11:53:49.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:49.356 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T11:53:49.356 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T11:53:49.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.f 2024-09-10T11:53:49.678 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:49 smithi081 systemd[1]: Stopping Ceph mds.f for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:49.953 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: 2024-09-10T11:53:49.677+0000 7fa248d9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:49.953 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:49 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f[64743]: 2024-09-10T11:53:49.677+0000 7fa248d9d640 -1 mds.f *** got signal Terminated *** 2024-09-10T11:53:52.795 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:52 smithi081 podman[70167]: 2024-09-10 11:53:52.543216541 +0000 UTC m=+2.973942811 container died f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T11:53:53.071 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:52 smithi081 podman[70167]: 2024-09-10 11:53:52.869172179 +0000 UTC m=+3.299898446 container cleanup f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T11:53:53.071 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:52 smithi081 bash[70167]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f 2024-09-10T11:53:53.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T11:53:53.331 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:53 smithi081 podman[70179]: 2024-09-10 11:53:53.07077896 +0000 UTC m=+0.520766681 container remove f58adb1cd2d0567bd9486d8d96938d9e3fcf6b449c2c0d38be44efe9615418bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0) 2024-09-10T11:53:53.332 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:53 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-10T11:53:53.332 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:53 smithi081 systemd[1]: Stopped Ceph mds.f for 44611ec8-6f68-11ef-bcea-c7b262605968. 2024-09-10T11:53:53.332 INFO:journalctl@ceph.mds.f.smithi081.stdout:Sep 10 11:53:53 smithi081 systemd[1]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.f.service: Consumed 9.558s CPU time. 2024-09-10T11:53:53.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:53.343 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T11:53:53.343 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T11:53:53.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.i 2024-09-10T11:53:53.683 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:53 smithi081 systemd[1]: Stopping Ceph mds.i for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:53.953 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:53:53.681+0000 7f9ced698640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:53.953 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:53 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i[65344]: 2024-09-10T11:53:53.681+0000 7f9ced698640 -1 mds.i *** got signal Terminated *** 2024-09-10T11:53:56.703 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:56 smithi081 podman[70288]: 2024-09-10 11:53:56.552314336 +0000 UTC m=+2.987973793 container died 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T11:53:57.092 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:56 smithi081 podman[70288]: 2024-09-10 11:53:56.831724848 +0000 UTC m=+3.267384305 container cleanup 373505fdd224997ec1d451e81b2c7642a4fbd0857e67ec32340377a90c6088d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T11:53:57.092 INFO:journalctl@ceph.mds.i.smithi081.stdout:Sep 10 11:53:56 smithi081 bash[70288]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-i 2024-09-10T11:53:57.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T11:53:57.292 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:53:57.292 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T11:53:57.293 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T11:53:57.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.l 2024-09-10T11:53:57.703 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:53:57 smithi081 systemd[1]: Stopping Ceph mds.l for 44611ec8-6f68-11ef-bcea-c7b262605968... 2024-09-10T11:53:57.703 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:53:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: 2024-09-10T11:53:57.593+0000 7f524a7c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T11:53:57.703 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:53:57 smithi081 ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l[64444]: 2024-09-10T11:53:57.593+0000 7f524a7c4640 -1 mds.l *** got signal Terminated *** 2024-09-10T11:54:00.811 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:54:00 smithi081 podman[70411]: 2024-09-10 11:54:00.557683691 +0000 UTC m=+3.055213095 container died a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T11:54:01.178 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:54:00 smithi081 podman[70411]: 2024-09-10 11:54:00.910266453 +0000 UTC m=+3.407795850 container cleanup a0b3a07bfc212a1759bf743a9d110c0af556c93f00777f6233b7b77a43b9d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T11:54:01.178 INFO:journalctl@ceph.mds.l.smithi081.stdout:Sep 10 11:54:00 smithi081 bash[70411]: ceph-44611ec8-6f68-11ef-bcea-c7b262605968-mds-l 2024-09-10T11:54:01.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-44611ec8-6f68-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T11:54:01.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T11:54:01.354 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T11:54:01.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:54:01.566 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:54:04.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:54:04.398 INFO:teuthology.orchestra.run.smithi026.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:54:06.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T11:54:07.091 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:54:09.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:54:09.554 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:54:09.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T11:54:09.613 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T11:54:09.615 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi017/crash 2024-09-10T11:54:09.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:54:09.657 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:54:09.657 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:54:09.659 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi026/crash 2024-09-10T11:54:09.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:54:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:tar: /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:54:09.700 INFO:teuthology.orchestra.run.smithi026.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:54:09.702 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi081/crash 2024-09-10T11:54:09.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash -- . 2024-09-10T11:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T11:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-10T11:54:09.745 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T11:54:09.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T11:54:09.790 INFO:tasks.cephadm:Compressing logs... 2024-09-10T11:54:09.790 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:54:09.793 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:54:09.795 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:54:09.818 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T11:54:09.818 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T11:54:09.819 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T11:54:09.819 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:54:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:54:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T11:54:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:54:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T11:54:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T11:54:09.825 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.4% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T11:54:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T11:54:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:54:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:54:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:: No such file or directory 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:54:09.829 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.i.log/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log: 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T11:54:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr: 82.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:54:09.831 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T11:54:09.832 INFO:teuthology.orchestra.run.smithi026.stderr: 90.5% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T11:54:09.832 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T11:54:09.832 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.4% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T11:54:09.832 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log 2024-09-10T11:54:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:54:09.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.8% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T11:54:09.836 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.5% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T11:54:09.837 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T11:54:09.839 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T11:54:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log: 90.9% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T11:54:09.840 INFO:teuthology.orchestra.run.smithi026.stderr: 86.5% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T11:54:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T11:54:09.840 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T11:54:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.j.log: 95.0% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T11:54:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:54:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.7% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T11:54:09.852 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T11:54:09.853 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.h.log: /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:54:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T11:54:09.875 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:54:09.875 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:54:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T11:54:10.042 INFO:teuthology.orchestra.run.smithi017.stderr: 95.9% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T11:54:10.083 INFO:teuthology.orchestra.run.smithi017.stderr: 90.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T11:54:10.114 INFO:teuthology.orchestra.run.smithi026.stderr: 96.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T11:54:10.129 INFO:teuthology.orchestra.run.smithi017.stderr: 96.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T11:54:10.202 INFO:teuthology.orchestra.run.smithi081.stderr: 91.6% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T11:54:10.233 INFO:teuthology.orchestra.run.smithi026.stderr: 91.7% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T11:54:10.258 INFO:teuthology.orchestra.run.smithi081.stderr: 96.1% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T11:54:10.800 INFO:teuthology.orchestra.run.smithi026.stderr: 95.9% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T11:54:10.881 INFO:teuthology.orchestra.run.smithi017.stderr: 90.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T11:54:11.502 INFO:teuthology.orchestra.run.smithi026.stderr: 96.0% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T11:54:11.942 INFO:teuthology.orchestra.run.smithi081.stderr: 96.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T11:54:12.246 INFO:teuthology.orchestra.run.smithi081.stderr: 96.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T11:54:12.270 INFO:teuthology.orchestra.run.smithi026.stderr: 96.0% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T11:54:19.609 INFO:teuthology.orchestra.run.smithi081.stderr: 94.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T11:54:21.601 INFO:teuthology.orchestra.run.smithi017.stderr: 93.4% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T11:54:21.689 INFO:teuthology.orchestra.run.smithi026.stderr: 93.6% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T11:54:21.907 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T11:54:25.204 INFO:teuthology.orchestra.run.smithi026.stderr: 93.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T11:54:26.823 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T11:54:26.868 INFO:teuthology.orchestra.run.smithi017.stderr: 93.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T11:54:27.221 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T11:54:29.207 INFO:teuthology.orchestra.run.smithi026.stderr: 93.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T11:54:30.168 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T11:54:30.170 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T11:54:30.170 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m20.361s 2024-09-10T11:54:30.170 INFO:teuthology.orchestra.run.smithi081.stderr:user 1m18.859s 2024-09-10T11:54:30.170 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m2.594s 2024-09-10T11:54:30.175 INFO:teuthology.orchestra.run.smithi017.stderr: 93.2% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T11:54:32.012 INFO:teuthology.orchestra.run.smithi026.stderr: 93.3% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T11:54:32.014 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-09-10T11:54:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m22.204s 2024-09-10T11:54:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:user 1m11.770s 2024-09-10T11:54:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m2.316s 2024-09-10T11:54:32.620 INFO:teuthology.orchestra.run.smithi017.stderr: 93.1% -- replaced with /var/log/ceph/44611ec8-6f68-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T11:54:32.622 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-10T11:54:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m22.815s 2024-09-10T11:54:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:user 1m11.391s 2024-09-10T11:54:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m2.333s 2024-09-10T11:54:32.623 INFO:tasks.cephadm:Archiving logs... 2024-09-10T11:54:32.623 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi017/log 2024-09-10T11:54:32.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:54:43.157 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi026/log 2024-09-10T11:54:43.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:54:53.267 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi081/log 2024-09-10T11:54:53.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:55:03.676 INFO:tasks.cephadm:Removing cluster... 2024-09-10T11:55:03.677 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force 2024-09-10T11:55:03.891 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:55:04.254 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force 2024-09-10T11:55:04.465 INFO:teuthology.orchestra.run.smithi026.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:55:04.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 44611ec8-6f68-11ef-bcea-c7b262605968 --force 2024-09-10T11:55:05.013 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 44611ec8-6f68-11ef-bcea-c7b262605968 2024-09-10T11:55:05.363 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T11:55:05.364 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:55:05.383 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:55:05.401 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T11:55:05.420 INFO:tasks.cephadm:Teardown complete 2024-09-10T11:55:05.420 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T11:55:05.437 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T11:55:05.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:55:05.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:55:05.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:55:05.551 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T11:55:05.563 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T11:55:05.563 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:55:05.566 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:55:05.568 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:55:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:55:05.582 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:55:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 -27us[+3194ns] +/- 47ms 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -65us[ -34us] +/- 58ms 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +178us[ +208us] +/- 76ms 2024-09-10T11:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:55:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:55:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-10T11:55:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 -35us[ -25us] +/- 47ms 2024-09-10T11:55:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -61us[ -51us] +/- 58ms 2024-09-10T11:55:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +164us[ +174us] +/- 76ms 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -30us[ +11us] +/- 47ms 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -56us[ -15us] +/- 58ms 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +173us[ +214us] +/- 76ms 2024-09-10T11:55:05.589 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:55:05.589 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T11:55:05.601 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T11:55:05.602 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T11:55:05.616 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:55:05.716 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:55:05.788 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:55:05.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:55:05.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:05.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:55:05.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:05.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T11:55:05.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:05.945 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T11:55:05.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T11:55:05.970 INFO:teuthology.task.internal:Duration was 1771.221608 seconds 2024-09-10T11:55:05.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T11:55:05.984 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T11:55:05.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:55:05.987 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:55:05.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:55:06.027 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:55:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:55:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:55:06.549 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T11:55:06.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T11:55:06.549 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:55:06.573 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-09-10T11:55:06.574 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:55:06.618 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T11:55:06.618 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:55:06.649 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T11:55:06.649 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:55:06.652 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:55:06.661 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:55:06.715 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T11:55:06.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:55:06.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:55:06.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:55:07.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T11:55:07.575 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T11:55:07.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:55:07.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:55:07.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:55:07.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T11:55:07.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:07.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:07.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-10T11:55:07.695 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-09-10T11:55:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-10T11:55:08.039 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:08.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:08.054 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:08.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:08.072 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:55:08.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:55:08.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T11:55:08.105 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T11:55:08.106 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi017 2024-09-10T11:55:08.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:55:08.158 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi026 2024-09-10T11:55:08.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:55:08.199 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899087/remote/smithi081 2024-09-10T11:55:08.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:55:08.239 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T11:55:08.239 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:55:08.241 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:55:08.244 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:55:08.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T11:55:08.305 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T11:55:08.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T11:55:08.318 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T11:55:08.318 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:55:08.321 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:55:08.323 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:55:08.334 INFO:teuthology.orchestra.run.smithi017.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:55 /home/ubuntu/cephtest 2024-09-10T11:55:08.338 INFO:teuthology.orchestra.run.smithi026.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:55 /home/ubuntu/cephtest 2024-09-10T11:55:08.345 INFO:teuthology.orchestra.run.smithi081.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:55 /home/ubuntu/cephtest 2024-09-10T11:55:08.347 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T11:55:08.360 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T11:55:08.396 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} duration: 1771.2216081619263 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T11:55:08.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:55:08.469 INFO:teuthology.run:pass